-- Logs begin at Tue 2022-08-30 15:16:43 UTC, end at Tue 2022-08-30 16:15:16 UTC. -- Aug 30 15:45:01.328323 dv-cinder-855058-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 30 15:45:01.336875 dv-cinder-855058-1-smb devstack@keystone.service[81405]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 30 15:45:01.341031 dv-cinder-855058-1-smb devstack@keystone.service[81405]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 15:45:01 2022] *** Aug 30 15:45:01.341031 dv-cinder-855058-1-smb devstack@keystone.service[81405]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 15:45:01.341031 dv-cinder-855058-1-smb devstack@keystone.service[81405]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 15:45:01.341031 dv-cinder-855058-1-smb devstack@keystone.service[81405]: nodename: dv-cinder-855058-1-smb Aug 30 15:45:01.341031 dv-cinder-855058-1-smb devstack@keystone.service[81405]: machine: x86_64 Aug 30 15:45:01.341031 dv-cinder-855058-1-smb devstack@keystone.service[81405]: clock source: unix Aug 30 15:45:01.341031 dv-cinder-855058-1-smb devstack@keystone.service[81405]: pcre jit disabled Aug 30 15:45:01.341031 dv-cinder-855058-1-smb devstack@keystone.service[81405]: detected number of CPU cores: 4 Aug 30 15:45:01.341031 dv-cinder-855058-1-smb devstack@keystone.service[81405]: current working directory: / Aug 30 15:45:01.341031 dv-cinder-855058-1-smb devstack@keystone.service[81405]: detected binary path: /usr/bin/uwsgi-core Aug 30 15:45:01.341031 dv-cinder-855058-1-smb devstack@keystone.service[81405]: your processes number limit is 47680 Aug 30 15:45:01.341031 dv-cinder-855058-1-smb devstack@keystone.service[81405]: your memory page size is 4096 bytes Aug 30 15:45:01.341031 dv-cinder-855058-1-smb devstack@keystone.service[81405]: detected max file descriptor number: 2048 Aug 30 15:45:01.341031 dv-cinder-855058-1-smb devstack@keystone.service[81405]: lock engine: pthread robust mutexes Aug 30 15:45:01.341031 dv-cinder-855058-1-smb devstack@keystone.service[81405]: thunder lock: enabled Aug 30 15:45:01.341031 dv-cinder-855058-1-smb devstack@keystone.service[81405]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 30 15:45:01.341031 dv-cinder-855058-1-smb devstack@keystone.service[81405]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 15:45:01.379699 dv-cinder-855058-1-smb devstack@keystone.service[81405]: Python main interpreter initialized at 0x55646c6df9c0 Aug 30 15:45:01.379699 dv-cinder-855058-1-smb devstack@keystone.service[81405]: python threads support enabled Aug 30 15:45:01.379699 dv-cinder-855058-1-smb devstack@keystone.service[81405]: your server socket listen backlog is limited to 100 connections Aug 30 15:45:01.379699 dv-cinder-855058-1-smb devstack@keystone.service[81405]: your mercy for graceful operations on workers is 90 seconds Aug 30 15:45:01.380088 dv-cinder-855058-1-smb devstack@keystone.service[81405]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 15:45:01.380169 dv-cinder-855058-1-smb devstack@keystone.service[81405]: *** Operational MODE: preforking *** Aug 30 15:45:01.380387 dv-cinder-855058-1-smb devstack@keystone.service[81405]: *** uWSGI is running in multiple interpreter mode *** Aug 30 15:45:01.380387 dv-cinder-855058-1-smb devstack@keystone.service[81405]: spawned uWSGI master process (pid: 81405) Aug 30 15:45:01.380597 dv-cinder-855058-1-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 30 15:45:01.382942 dv-cinder-855058-1-smb devstack@keystone.service[81405]: spawned uWSGI worker 1 (pid: 81419, cores: 1) Aug 30 15:45:01.382942 dv-cinder-855058-1-smb devstack@keystone.service[81405]: spawned uWSGI worker 2 (pid: 81420, cores: 1) Aug 30 15:45:01.382942 dv-cinder-855058-1-smb devstack@keystone.service[81405]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 15:45:05.712577 dv-cinder-855058-1-smb devstack@keystone.service[81420]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 15:45:05.712577 dv-cinder-855058-1-smb devstack@keystone.service[81420]: from cryptography.utils import int_from_bytes Aug 30 15:45:05.713399 dv-cinder-855058-1-smb devstack@keystone.service[81420]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 15:45:05.713399 dv-cinder-855058-1-smb devstack@keystone.service[81420]: from cryptography.utils import int_from_bytes Aug 30 15:45:05.715638 dv-cinder-855058-1-smb devstack@keystone.service[81419]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 15:45:05.715638 dv-cinder-855058-1-smb devstack@keystone.service[81419]: from cryptography.utils import int_from_bytes Aug 30 15:45:05.716087 dv-cinder-855058-1-smb devstack@keystone.service[81419]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 15:45:05.716087 dv-cinder-855058-1-smb devstack@keystone.service[81419]: from cryptography.utils import int_from_bytes Aug 30 15:45:05.763810 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 15:45:05.763996 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 15:45:05.764799 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] command line args: [] {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 15:45:05.765089 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 15:45:05.765313 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ================================================================================ {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 15:45:05.765568 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] admin_token = **** {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.765819 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] config_dir = [] {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.766008 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.766118 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 15:45:05.766205 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] config_source = [] {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.766324 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 15:45:05.766414 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] debug = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.766521 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] command line args: [] {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 15:45:05.766605 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.766796 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 15:45:05.766923 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.767273 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ================================================================================ {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 15:45:05.767373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.767478 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] admin_token = **** {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.767611 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.767719 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] config_dir = [] {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.767862 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.767950 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.768083 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] config_source = [] {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.768168 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] list_limit = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.768273 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] log_config_append = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.768345 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] debug = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.768449 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.768534 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.768619 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] log_dir = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.768677 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.768825 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] log_file = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.768918 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.769031 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.769143 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.769271 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.769397 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.769537 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.769616 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] list_limit = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.769772 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.769862 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] log_config_append = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.769938 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.770067 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.770147 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.770238 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] log_dir = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.770309 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] log_file = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.770372 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.770526 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.770604 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.770775 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.770868 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.771025 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.771152 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.771255 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.771339 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.771457 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.771547 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.771639 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.771716 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.771888 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.771969 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.772136 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.772225 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.772357 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.772596 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.772705 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.772853 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.772949 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] publish_errors = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.773092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.773170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.773343 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.773433 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.773516 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.773591 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.773760 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.773840 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.773997 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.774232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] standard_threads = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.774339 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.774464 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.774542 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] publish_errors = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.774709 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.774796 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.774888 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.774965 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.775066 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] use_journal = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.775161 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.775230 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] use_json = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.775372 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.775449 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] use_stderr = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.775570 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] use_syslog = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.775652 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.775792 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.775866 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] standard_threads = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.776044 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.776122 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.776286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.776363 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.776465 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.776543 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.776659 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] use_journal = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.776774 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.776881 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] use_json = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.776999 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] use_stderr = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.777088 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.777180 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] use_syslog = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.777258 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.777415 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:45:05.777491 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.777674 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.777763 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.777918 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.777994 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.778181 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.778257 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.778425 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.778510 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.778663 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.778745 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.778911 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.778995 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.779147 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.779280 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.779397 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.779471 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.779631 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.779729 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.780473 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.780608 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.780847 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.780940 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.781032 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.781110 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.781280 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.781368 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.781518 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.781597 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.781780 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.781865 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.782043 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.782197 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.782278 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.782348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.782531 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.782616 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.782762 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.782840 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.782995 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.783072 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.783227 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.783304 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.783463 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.783542 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.783714 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.783791 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.783962 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.784039 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.784193 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.784270 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.784425 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.784501 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.784673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.784752 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.784931 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.785011 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.785172 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.785249 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.785422 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.785505 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.785657 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.785748 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.785895 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.785973 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.786128 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.786205 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.786359 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.786443 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.786592 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.786672 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.786825 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.786902 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.787058 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.787136 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.787294 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.787371 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.787536 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.787613 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.787758 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.787831 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.787995 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.788080 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.788229 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.788306 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.788464 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.788543 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.788697 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.788800 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.788961 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.789039 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.789195 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.789273 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.789434 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.789519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.789672 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.789798 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.789908 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.789988 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.790146 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.790228 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.790383 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.790459 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.790615 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.790698 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.790857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.790967 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.791082 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.791188 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.791318 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.791425 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.791559 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.791673 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.791798 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.791903 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.792039 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.792121 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.792272 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.792359 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.792511 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.792599 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.792750 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.792902 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.793015 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.793093 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.793252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.793353 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.793511 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.793608 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.793748 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.793826 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.793982 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.794063 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.794218 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.794303 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.794455 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.794533 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.794703 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.794782 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.794944 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.795030 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.795182 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.795257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.795460 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.795674 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.795756 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.795831 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.795939 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.796079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.796165 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.796320 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.796399 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.796572 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.796652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.796834 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.796929 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.797077 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.797157 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.797342 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.797474 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.797550 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.797620 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.797804 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.797935 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.798046 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.798133 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.798285 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.798363 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.798523 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.798608 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.798762 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.798840 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.799001 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.799079 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.799238 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.799316 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.799465 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.799539 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.799694 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.799773 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.799929 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.800017 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.800166 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.800255 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.800399 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.800478 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.800642 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.800720 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.800902 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.800993 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.801150 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.801228 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.801388 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.801466 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.801625 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.801711 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.801860 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.801939 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.802098 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.802176 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.802337 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.802423 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] auth.external = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.802574 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.802651 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.802810 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.802886 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.803061 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.803168 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.803303 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.803392 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] auth.password = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.803538 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] auth.token = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.803618 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.803783 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.803870 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.804022 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.804110 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.804271 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] auth.external = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.804349 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.804504 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.804582 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.804755 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.804892 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.805029 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.805108 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.805263 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.805342 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] auth.password = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.805500 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] auth.token = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.805586 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] credential.caching = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.805747 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.805827 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.805990 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.806077 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.806238 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.806329 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.806474 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.806552 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.806718 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.806797 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.806957 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.807045 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.807191 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.807276 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.807430 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] credential.caching = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.807516 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.807673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.807761 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.807924 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.808003 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.808177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.808256 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.808435 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.808525 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.808685 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.808764 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.808949 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.809030 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.809201 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.809293 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.809438 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] federation.caching = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.809516 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.809678 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.809757 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.809928 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.810015 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.810180 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.810259 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.810414 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.810493 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.810665 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.810752 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.810903 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.811513 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.811740 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.811942 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.812040 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.812115 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] federation.caching = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.812224 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.812303 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.812463 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.812542 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.812714 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.812842 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.812976 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.813056 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] identity.caching = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.813226 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.813306 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.813464 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.813540 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.813702 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.813780 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.813939 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.814019 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.814175 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.814251 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.814410 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.814490 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.814650 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.814729 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.814888 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] identity.caching = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.814968 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.815140 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.815220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.815371 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.815450 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.815605 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.815686 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.815838 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.815917 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.816085 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.816164 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.816318 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.816397 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.816558 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.816638 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.816837 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.816956 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.817087 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.817162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.817326 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.817404 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.817565 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.817644 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.817802 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.817882 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.818040 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.818118 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.818281 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.818360 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.818516 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.818595 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.818754 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.818832 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.818997 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.819075 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.819238 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.819319 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.819489 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.819568 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.819723 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.819802 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.819960 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.820039 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.820210 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.820318 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.820448 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.820558 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.820698 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.820815 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.821045 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.821125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.821282 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.821362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.821523 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.821604 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.821756 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.821836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.822001 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.822088 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.822242 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.822321 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.822479 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.822557 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.822718 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.822804 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.822957 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.823036 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.823192 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.823269 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.823434 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.823521 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.823669 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.823747 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.823903 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.823982 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.824142 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.824233 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.824387 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.824466 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.824621 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.824698 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.824884 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.824981 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.825124 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.825202 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.825359 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.user = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.825438 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.825599 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.825687 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.825835 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.825915 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.826078 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.826156 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.826327 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.826414 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.827321 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.827523 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.827600 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.827826 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.828035 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.828124 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.828287 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.828366 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.828525 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.828603 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.user = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.828767 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.828890 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.829029 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.829137 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.829275 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.829396 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.829524 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.829669 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.829773 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.829938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.830021 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.830202 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.830281 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.830453 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.830534 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.830697 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.830776 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.830938 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.831016 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.831176 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.831256 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.831415 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.831495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.831652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.831730 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.831898 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.831978 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.832152 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.832229 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.832389 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.832466 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.832644 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.832723 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.832900 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.832982 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.833151 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.833243 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.833423 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.833513 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.833625 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.833704 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.833863 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.833942 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.834105 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.834219 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.834348 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.834467 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.834599 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.834705 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.834854 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.834934 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.835097 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.835358 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.835532 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] resource.caching = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.835611 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.835798 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.835878 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.836055 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.836134 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.836294 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.836371 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.836536 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.836616 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.836811 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.836893 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.837050 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.837177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.837267 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.837341 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.837519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.837598 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.837760 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.837838 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] resource.caching = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.838001 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] role.caching = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.838081 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.838250 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.838329 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] role.driver = sql {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.838483 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.838561 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.838734 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.838815 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.838985 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.839077 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.839224 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.839364 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.839472 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.839553 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.839712 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.839792 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.839955 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.840042 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.840195 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] role.caching = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.840277 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.840443 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.840522 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] role.driver = sql {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.840675 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.840762 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.840948 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.841030 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.841198 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.841277 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.841445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.841536 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.841692 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.841770 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.841939 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.842091 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.842170 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.842460 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.842725 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.842922 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.843014 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.843185 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.843266 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.843426 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.843507 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.843680 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.843759 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.843932 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.844010 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.844184 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.844264 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.844430 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.844509 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.844666 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.844856 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.844954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.845101 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.845181 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.845356 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.845436 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.845612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.845693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.845865 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.845945 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.846102 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.846180 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.846340 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.846421 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.846573 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.846652 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.846811 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] token.caching = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.846889 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.847052 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.847132 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.847294 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.847373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.847530 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.847609 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.847766 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.847846 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.848020 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.848099 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.848255 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.848333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.848499 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.848579 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.848742 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.848834 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.849006 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.849085 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.849242 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.849330 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.849480 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.849559 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] token.caching = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.849718 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.849797 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.849964 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.850044 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.850201 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.850279 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.850459 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.850538 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.850702 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.850794 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.850942 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.851045 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.851189 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.851279 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] database.connection = **** {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.851436 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.851533 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.851686 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.851774 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.851923 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.852009 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.852161 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.852259 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.852397 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.852483 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.852638 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.852725 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.852902 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.853003 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.853142 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.853229 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.853390 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.853485 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.853630 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.853717 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.853878 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.853973 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] database.connection = **** {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.854114 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.854201 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.854363 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.854450 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.854600 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.854696 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.854843 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.854929 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.855074 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.855159 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.855310 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.855401 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.855549 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.855626 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.855718 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 15:45:05.855792 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.856017 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.856256 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.856501 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.856739 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.857014 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.857255 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.857502 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.857737 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.858363 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.858621 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:45:05.858800 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 15:45:05.885546 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:05.885778 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:05.886007 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:05.887812 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:05.888048 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:05.888274 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:05.895174 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:05.897742 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:05.923238 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:05.923473 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:05.925982 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:05.926319 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:05.978440 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:05.979530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.027843 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.028080 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.029361 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.029603 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.183937 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.184261 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.184549 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.184859 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.185144 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.185440 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.187529 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.187765 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.187994 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.188218 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.188438 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.188653 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.210384 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.210573 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.210809 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.210906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.211039 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.211213 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.211295 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.211472 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.211563 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.211690 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.211911 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.211992 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.212237 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.212514 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.223419 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.223523 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.237138 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.237280 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.237354 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.237503 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.237604 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.237747 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.237914 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.237986 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.238119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.238202 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.238356 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.238552 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.238736 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.238810 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 15:45:06.257261 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.257500 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 15:45:06.258135 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.258135 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 15:45:06.258560 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.258980 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.259526 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.259878 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.260208 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.260482 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 15:45:06.261098 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.261642 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 15:45:06.262123 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.262572 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.262899 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.263227 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.271385 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.271736 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.271954 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.272463 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.276930 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.277223 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.277494 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.277777 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.280466 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 15:45:06.283412 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 15:45:06.283704 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.283993 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.284281 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.284566 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.284862 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.285000 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 15:45:06.285140 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.285421 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.285806 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.286087 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.286359 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.287875 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 15:45:06.288160 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.288445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.288731 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.289040 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.289301 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.289569 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.289843 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.290113 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.290384 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.290649 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.309726 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.312275 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 15:45:06.312573 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.314362 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.315824 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 15:45:06.316111 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.317286 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 15:45:06.317577 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.317864 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.320628 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 15:45:06.320936 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.321220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.324221 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 15:45:06.324512 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.327688 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 15:45:06.327976 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.329136 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 15:45:06.329432 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.329721 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.330008 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.330286 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.330568 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.330845 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.331178 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.331926 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 15:45:06.332218 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.332500 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.332807 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.333084 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.335067 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.335353 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.335631 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.350737 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.351022 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.351206 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.351482 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.354908 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 15:45:06.355303 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 15:45:06.358926 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.359044 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.359229 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.359348 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.363491 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 15:45:06.363605 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 15:45:06.366600 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 15:45:06.366761 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 15:45:06.369721 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.369989 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.370074 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.370295 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.370377 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.370581 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.370672 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.370867 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.370950 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.371164 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.371335 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.371452 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.387770 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 15:45:06.388061 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.388277 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 15:45:06.388361 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.388572 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.388669 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.388870 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.389169 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.395588 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.396682 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.397266 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.398258 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.398807 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.399083 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.399795 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.400077 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.401751 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 15:45:06.402039 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.402324 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.402610 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.402736 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 15:45:06.402908 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.403025 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.403436 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.403729 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.404022 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.414254 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 15:45:06.414547 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.414830 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.415108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.415385 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.415657 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.415798 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 15:45:06.415940 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.416088 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.416477 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.416765 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.417079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.417373 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.417666 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.431824 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 15:45:06.434011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 15:45:06.434869 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 15:45:06.437583 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 15:45:06.437858 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.439303 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.440479 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.440775 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 15:45:06.441078 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.441368 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.441949 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.443571 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 15:45:06.443868 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.444156 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.447843 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.449354 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 15:45:06.450644 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.452739 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.453049 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.453130 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 15:45:06.453341 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.453613 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.456099 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.456395 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.456685 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.456990 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.461512 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 15:45:06.461805 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.462084 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.464769 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 15:45:06.465093 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.465378 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.469621 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 15:45:06.469907 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.470188 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.470467 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.470743 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.471016 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.471309 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.471589 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.471873 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.472143 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.472412 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.472672 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.472973 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.473252 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.473340 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 15:45:06.473587 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.473872 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.474148 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.474419 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.474689 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.474974 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.475259 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.475541 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.475812 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.476097 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.476363 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.476629 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.476942 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 15:45:06.507709 dv-cinder-855058-1-smb devstack@keystone.service[81420]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55646c6df9c0 pid: 81420 (default app) Aug 30 15:45:06.511129 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b311d-d168-40c7-91ec-252310ecdea4 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:06.511419 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b311d-d168-40c7-91ec-252310ecdea4 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:06.511691 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b311d-d168-40c7-91ec-252310ecdea4 None None] PATH_INFO: `/v3` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:06.511786 dv-cinder-855058-1-smb devstack@keystone.service[81419]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55646c6df9c0 pid: 81419 (default app) Aug 30 15:45:06.517228 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 791 bytes} [Tue Aug 30 15:45:06 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:13.083316 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373bac8d-fc89-4c50-b18f-724254ab1746 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:13.083816 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373bac8d-fc89-4c50-b18f-724254ab1746 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:13.083923 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373bac8d-fc89-4c50-b18f-724254ab1746 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:13.088299 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1/2] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 15:45:13.093388 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293a4c5-6da3-4f61-963b-200ce6eb34cd None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:13.093832 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293a4c5-6da3-4f61-963b-200ce6eb34cd None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:13.093968 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293a4c5-6da3-4f61-963b-200ce6eb34cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:13.164892 dv-cinder-855058-1-smb devstack@keystone.service[81420]: INFO dbcounter [None req-d293a4c5-6da3-4f61-963b-200ce6eb34cd None None] Registered counter for database keystone Aug 30 15:45:13.184356 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG oslo_db.sqlalchemy.engines [None req-d293a4c5-6da3-4f61-963b-200ce6eb34cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81420) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 15:45:13.191291 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writer thread running {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 15:45:13.368872 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG passlib.handlers.bcrypt [None req-d293a4c5-6da3-4f61-963b-200ce6eb34cd None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81420) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 30 15:45:13.369193 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG passlib.handlers.bcrypt [None req-d293a4c5-6da3-4f61-963b-200ce6eb34cd None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81420) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 30 15:45:13.426973 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-d293a4c5-6da3-4f61-963b-200ce6eb34cd None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:13.428565 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-d293a4c5-6da3-4f61-963b-200ce6eb34cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:45:13.558164 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 2/3] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 30 15:45:14.081739 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373bac8d-fc89-4c50-b18f-724254ab1746 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:14.151639 dv-cinder-855058-1-smb devstack@keystone.service[81419]: INFO dbcounter [None req-373bac8d-fc89-4c50-b18f-724254ab1746 None None] Registered counter for database keystone Aug 30 15:45:14.172432 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG oslo_db.sqlalchemy.engines [None req-373bac8d-fc89-4c50-b18f-724254ab1746 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81419) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 15:45:14.178554 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writer thread running {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 15:45:14.296634 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373bac8d-fc89-4c50-b18f-724254ab1746 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:14.300971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd2cd5-0df4-4d7d-a97f-ca996703756a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:14.301599 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd2cd5-0df4-4d7d-a97f-ca996703756a admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:14.301878 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd2cd5-0df4-4d7d-a97f-ca996703756a admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:14.302151 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd2cd5-0df4-4d7d-a97f-ca996703756a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:14.311626 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd2cd5-0df4-4d7d-a97f-ca996703756a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:14.362290 dv-cinder-855058-1-smb devstack@keystone.service[81419]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0cdd2cd5-0df4-4d7d-a97f-ca996703756a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 30 15:45:14.362570 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd2cd5-0df4-4d7d-a97f-ca996703756a admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:14.372474 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 2/4] 10.222.0.25 () {58 vars in 1324 bytes} [Tue Aug 30 15:45:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 15:45:14.378957 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293a4c5-6da3-4f61-963b-200ce6eb34cd None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:14.394125 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293a4c5-6da3-4f61-963b-200ce6eb34cd None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:14.399549 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c47b0f-8d19-42e2-9966-cf76abccf987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:14.400657 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c47b0f-8d19-42e2-9966-cf76abccf987 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:14.400984 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c47b0f-8d19-42e2-9966-cf76abccf987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:14.401265 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c47b0f-8d19-42e2-9966-cf76abccf987 admin admin] PATH_INFO: `/v3/projects/68dd5aaf111a41b0974c3035d437038b` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:14.402867 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c47b0f-8d19-42e2-9966-cf76abccf987 admin admin] RBAC: Authorizing `identity:get_project(project_id=68dd5aaf111a41b0974c3035d437038b)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:14.455494 dv-cinder-855058-1-smb devstack@keystone.service[81420]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d7c47b0f-8d19-42e2-9966-cf76abccf987 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 30 15:45:14.455844 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c47b0f-8d19-42e2-9966-cf76abccf987 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:14.460440 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 3/5] 10.222.0.25 () {56 vars in 1207 bytes} [Tue Aug 30 15:45:14 2022] GET /identity/v3/projects/68dd5aaf111a41b0974c3035d437038b => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:16.334548 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913bf29-89ac-4027-ad52-4da21d330030 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:16.335057 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913bf29-89ac-4027-ad52-4da21d330030 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:16.335057 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913bf29-89ac-4027-ad52-4da21d330030 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:16.339144 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 3/6] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:45:16.345022 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d90e6-ef0e-448d-af58-f5385bb1239c None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:16.345430 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d90e6-ef0e-448d-af58-f5385bb1239c None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:16.345573 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d90e6-ef0e-448d-af58-f5385bb1239c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:16.365953 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-028d90e6-ef0e-448d-af58-f5385bb1239c None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:16.367453 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-028d90e6-ef0e-448d-af58-f5385bb1239c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:45:16.375651 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 4/7] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 30 15:45:16.645989 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913bf29-89ac-4027-ad52-4da21d330030 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:16.658176 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913bf29-89ac-4027-ad52-4da21d330030 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:16.662379 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b99ac-e880-4ad9-9406-840392dbf29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:16.662976 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b99ac-e880-4ad9-9406-840392dbf29b admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:16.663254 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b99ac-e880-4ad9-9406-840392dbf29b admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:16.663523 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b99ac-e880-4ad9-9406-840392dbf29b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:16.671114 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b99ac-e880-4ad9-9406-840392dbf29b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:16.672912 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b99ac-e880-4ad9-9406-840392dbf29b admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:16.681462 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 4/8] 10.222.0.25 () {58 vars in 1324 bytes} [Tue Aug 30 15:45:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 15:45:16.687357 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d90e6-ef0e-448d-af58-f5385bb1239c None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:16.696266 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d90e6-ef0e-448d-af58-f5385bb1239c None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:16.700529 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0afe739-595e-43b9-8d61-238943fbe2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:16.701188 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afe739-595e-43b9-8d61-238943fbe2f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:16.701469 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afe739-595e-43b9-8d61-238943fbe2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:16.702638 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afe739-595e-43b9-8d61-238943fbe2f8 admin admin] PATH_INFO: `/v3/users/a8dbd7798b3b4a6f882f197a7c25237a` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:16.703961 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0afe739-595e-43b9-8d61-238943fbe2f8 admin admin] RBAC: Authorizing `identity:get_user(user_id=a8dbd7798b3b4a6f882f197a7c25237a)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:16.705829 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0afe739-595e-43b9-8d61-238943fbe2f8 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:16.707331 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 5/9] 10.222.0.25 () {56 vars in 1198 bytes} [Tue Aug 30 15:45:16 2022] GET /identity/v3/users/a8dbd7798b3b4a6f882f197a7c25237a => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:18.657480 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74114810-06d6-4938-92bc-8454fef38b03 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:18.658033 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74114810-06d6-4938-92bc-8454fef38b03 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:18.658033 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74114810-06d6-4938-92bc-8454fef38b03 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:18.659331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 5/10] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 15:45:18.664409 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ba85a-2f7c-4f48-9437-403213b9b9d9 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:18.664819 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ba85a-2f7c-4f48-9437-403213b9b9d9 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:18.665114 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ba85a-2f7c-4f48-9437-403213b9b9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:18.683966 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-4f8ba85a-2f7c-4f48-9437-403213b9b9d9 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:18.685186 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-4f8ba85a-2f7c-4f48-9437-403213b9b9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:45:18.692161 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5159a-c0ad-44bd-b5d2-06c50b74f80b None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:18.692454 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5159a-c0ad-44bd-b5d2-06c50b74f80b None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:18.692731 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5159a-c0ad-44bd-b5d2-06c50b74f80b None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:18.694057 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 6/11] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 15:45:18.699015 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fa712-a014-4b10-9037-998f10c344d1 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:18.699298 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fa712-a014-4b10-9037-998f10c344d1 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:18.699573 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fa712-a014-4b10-9037-998f10c344d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:18.742043 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG passlib.handlers.bcrypt [None req-678fa712-a014-4b10-9037-998f10c344d1 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81419) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 30 15:45:18.742447 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG passlib.handlers.bcrypt [None req-678fa712-a014-4b10-9037-998f10c344d1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81419) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 30 15:45:18.765901 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 6/12] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:45:18.791553 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-678fa712-a014-4b10-9037-998f10c344d1 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:18.793171 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-678fa712-a014-4b10-9037-998f10c344d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:45:18.893453 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 7/13] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 15:45:19.031109 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ba85a-2f7c-4f48-9437-403213b9b9d9 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:19.054268 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:19.134406 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ba85a-2f7c-4f48-9437-403213b9b9d9 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:19.167649 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434976d7-52a3-4a1b-9b5d-b0f5e3e94bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:19.168305 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434976d7-52a3-4a1b-9b5d-b0f5e3e94bfa None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:19.168570 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434976d7-52a3-4a1b-9b5d-b0f5e3e94bfa None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:19.168879 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434976d7-52a3-4a1b-9b5d-b0f5e3e94bfa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:19.173775 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fa712-a014-4b10-9037-998f10c344d1 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:19.180563 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434976d7-52a3-4a1b-9b5d-b0f5e3e94bfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:45:19.189728 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-434976d7-52a3-4a1b-9b5d-b0f5e3e94bfa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:45:19.189728 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:45:19.189728 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:45:19.189728 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:45:19.189728 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:45:19.189728 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:45:19.189728 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:45:19.189728 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:45:19.189728 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:45:19.189728 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:45:19.189728 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:45:19.189728 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:45:19.189728 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:45:19.189728 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:45:19.189728 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:45:19.189728 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:45:19.190804 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:45:19.190804 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:45:19.190804 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:45:19.190804 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:45:19.190804 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:45:19.190804 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:45:19.190804 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:45:19.190804 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:45:19.190804 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:45:19.190804 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:45:19.190804 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:45:19.190804 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:45:19.190804 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:45:19.190804 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:45:19.190804 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:45:19.190804 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:45:19.191639 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:45:19.191639 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:45:19.191639 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:45:19.191639 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:45:19.191639 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:45:19.191639 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:45:19.191639 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:45:19.191639 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:45:19.191639 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:45:19.191639 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:45:19.191639 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:45:19.191639 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:45:19.191639 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 7/14] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 30 15:45:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:45:19.198026 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434976d7-52a3-4a1b-9b5d-b0f5e3e94bfa None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:19.276386 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fa712-a014-4b10-9037-998f10c344d1 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:19.278689 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:19.279658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:19.300890 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434976d7-52a3-4a1b-9b5d-b0f5e3e94bfa None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:19.314548 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78625386-5bed-4abe-8a2c-2653dbd55cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:19.315422 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78625386-5bed-4abe-8a2c-2653dbd55cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:19.315706 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78625386-5bed-4abe-8a2c-2653dbd55cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:19.315980 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78625386-5bed-4abe-8a2c-2653dbd55cf4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:19.336617 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a13e5-26cd-465e-82a2-be03dd233b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:19.337250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a13e5-26cd-465e-82a2-be03dd233b31 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:19.337539 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a13e5-26cd-465e-82a2-be03dd233b31 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:19.337812 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a13e5-26cd-465e-82a2-be03dd233b31 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:19.338489 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1a13e5-26cd-465e-82a2-be03dd233b31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:19.338791 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1a13e5-26cd-465e-82a2-be03dd233b31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:19.340202 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1a13e5-26cd-465e-82a2-be03dd233b31 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:19.351887 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 8/15] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:45:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:45:19.357484 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a13e5-26cd-465e-82a2-be03dd233b31 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:19.382874 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78625386-5bed-4abe-8a2c-2653dbd55cf4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:19.384388 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78625386-5bed-4abe-8a2c-2653dbd55cf4 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:19.456474 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a13e5-26cd-465e-82a2-be03dd233b31 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:19.484137 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 8/16] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:45:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 15:45:19.489378 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78625386-5bed-4abe-8a2c-2653dbd55cf4 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:19.490351 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9b487-adf1-4884-84df-56e5982e18d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:19.490985 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9b487-adf1-4884-84df-56e5982e18d5 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:19.491265 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9b487-adf1-4884-84df-56e5982e18d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:19.491534 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9b487-adf1-4884-84df-56e5982e18d5 None admin] PATH_INFO: `/v3/users/a8dbd7798b3b4a6f882f197a7c25237a` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:19.492102 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:19.492840 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9b487-adf1-4884-84df-56e5982e18d5 None admin] RBAC: Authorizing `identity:get_user(user_id=a8dbd7798b3b4a6f882f197a7c25237a)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:19.494363 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9b487-adf1-4884-84df-56e5982e18d5 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:19.496053 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 9/17] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:45:19 2022] GET /identity/v3/users/a8dbd7798b3b4a6f882f197a7c25237a => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:45:19.502199 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9b487-adf1-4884-84df-56e5982e18d5 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:19.516709 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:19.587872 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78625386-5bed-4abe-8a2c-2653dbd55cf4 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:19.605518 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9b487-adf1-4884-84df-56e5982e18d5 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:19.621974 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c714fb-18c1-471d-9a87-b1b33e418e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:19.622834 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c714fb-18c1-471d-9a87-b1b33e418e12 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:19.623112 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c714fb-18c1-471d-9a87-b1b33e418e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:19.623379 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c714fb-18c1-471d-9a87-b1b33e418e12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:19.641752 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c714fb-18c1-471d-9a87-b1b33e418e12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:19.642239 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa4bb6-2a86-455e-9c20-518af17312b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:19.643150 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa4bb6-2a86-455e-9c20-518af17312b6 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:19.643434 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa4bb6-2a86-455e-9c20-518af17312b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:19.643526 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c714fb-18c1-471d-9a87-b1b33e418e12 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:19.643709 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa4bb6-2a86-455e-9c20-518af17312b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:19.644844 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa4bb6-2a86-455e-9c20-518af17312b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:19.646329 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa4bb6-2a86-455e-9c20-518af17312b6 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:19.648013 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 10/18] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:45:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:45:19.653766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa4bb6-2a86-455e-9c20-518af17312b6 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:19.662307 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-e3c714fb-18c1-471d-9a87-b1b33e418e12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:45:19.662307 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:45:19.662307 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:45:19.662307 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:45:19.662307 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:45:19.662307 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:45:19.662307 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:45:19.662307 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:45:19.662307 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:45:19.662307 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:45:19.662307 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:45:19.662307 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:45:19.662307 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:45:19.662307 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:45:19.662307 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:45:19.662307 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:45:19.663614 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:45:19.663614 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:45:19.663614 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:45:19.663614 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:45:19.663614 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:45:19.663614 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:45:19.663614 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:45:19.663614 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:45:19.663614 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:45:19.663614 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:45:19.663614 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:45:19.663614 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:45:19.663614 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:45:19.663614 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:45:19.663614 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:45:19.663614 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:45:19.663614 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:45:19.664387 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:45:19.664387 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:45:19.664387 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:45:19.664387 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 9/19] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:45:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 15:45:19.669152 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c714fb-18c1-471d-9a87-b1b33e418e12 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:19.727600 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:19.745108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:19.764969 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa4bb6-2a86-455e-9c20-518af17312b6 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:19.773912 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c714fb-18c1-471d-9a87-b1b33e418e12 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:19.798768 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdcb4d0-f3df-4571-9c89-a6e92dfb31aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:19.799379 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdcb4d0-f3df-4571-9c89-a6e92dfb31aa None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:19.799687 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdcb4d0-f3df-4571-9c89-a6e92dfb31aa None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:19.799918 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdcb4d0-f3df-4571-9c89-a6e92dfb31aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:19.800671 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdcb4d0-f3df-4571-9c89-a6e92dfb31aa None admin] RBAC: Adding query filter params (role.id=676938e69210499ca11ee75dd572d0dc, scope.domain.id=default, user.id=a8dbd7798b3b4a6f882f197a7c25237a) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:19.801001 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdcb4d0-f3df-4571-9c89-a6e92dfb31aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:19.802434 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdcb4d0-f3df-4571-9c89-a6e92dfb31aa None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:19.807528 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee05d3-8017-4972-807a-164779d9b247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:19.808136 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee05d3-8017-4972-807a-164779d9b247 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:19.808420 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee05d3-8017-4972-807a-164779d9b247 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:19.808696 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee05d3-8017-4972-807a-164779d9b247 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:19.808877 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 11/20] 10.222.0.25 () {56 vars in 1322 bytes} [Tue Aug 30 15:45:19 2022] GET /identity/v3/role_assignments?user.id=a8dbd7798b3b4a6f882f197a7c25237a&scope.domain.id=default&role.id=676938e69210499ca11ee75dd572d0dc => generated 233 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:45:19.809377 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee05d3-8017-4972-807a-164779d9b247 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:19.809681 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee05d3-8017-4972-807a-164779d9b247 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:19.811104 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee05d3-8017-4972-807a-164779d9b247 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:19.831074 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 10/21] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:45:22.037365 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d239c-4f47-4e52-8974-206f9fb3997b None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:22.038335 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d239c-4f47-4e52-8974-206f9fb3997b None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:22.038834 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d239c-4f47-4e52-8974-206f9fb3997b None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:22.040377 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 12/22] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:45:22.046492 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1233a54-adde-4885-afa1-476d2823dcb1 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:22.046952 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1233a54-adde-4885-afa1-476d2823dcb1 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:22.047036 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1233a54-adde-4885-afa1-476d2823dcb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:22.071770 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-b1233a54-adde-4885-afa1-476d2823dcb1 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:22.073008 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-b1233a54-adde-4885-afa1-476d2823dcb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:45:22.160082 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 11/23] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:45:22.233493 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6c087-7218-40fd-ba41-f556624aef45 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:22.234205 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6c087-7218-40fd-ba41-f556624aef45 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:22.234680 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6c087-7218-40fd-ba41-f556624aef45 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:22.236237 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:45:22.241774 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316d67d-c48e-4214-aae9-a7ca2d338432 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:22.242311 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316d67d-c48e-4214-aae9-a7ca2d338432 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:22.242798 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316d67d-c48e-4214-aae9-a7ca2d338432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:22.261999 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-b316d67d-c48e-4214-aae9-a7ca2d338432 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:22.263568 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-b316d67d-c48e-4214-aae9-a7ca2d338432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:45:22.307071 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:22.332982 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 12/25] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:45:22.465531 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce5410-7889-48dc-8737-c1fed60e820d None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:22.465918 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce5410-7889-48dc-8737-c1fed60e820d None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:22.466102 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce5410-7889-48dc-8737-c1fed60e820d None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:22.468116 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 14/26] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:45:22.473630 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974edea-9117-42c0-9655-76f9c69185ab None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:22.473950 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974edea-9117-42c0-9655-76f9c69185ab None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:22.474297 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974edea-9117-42c0-9655-76f9c69185ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:22.497961 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-e974edea-9117-42c0-9655-76f9c69185ab None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:22.499265 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-e974edea-9117-42c0-9655-76f9c69185ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:45:22.586562 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 13/27] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:45:22.601703 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ae659-7613-4115-aae6-5a535695db56 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:22.602289 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ae659-7613-4115-aae6-5a535695db56 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:22.602758 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ae659-7613-4115-aae6-5a535695db56 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:22.604290 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 15/28] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:45:22.610266 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed82db-6cae-4f7d-80c5-e43d9b0601d3 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:22.610801 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed82db-6cae-4f7d-80c5-e43d9b0601d3 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:22.611277 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed82db-6cae-4f7d-80c5-e43d9b0601d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:22.629777 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-f4ed82db-6cae-4f7d-80c5-e43d9b0601d3 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:22.631237 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-f4ed82db-6cae-4f7d-80c5-e43d9b0601d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:45:22.679533 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ae659-7613-4115-aae6-5a535695db56 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:22.741101 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 14/29] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:45:22.741932 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed82db-6cae-4f7d-80c5-e43d9b0601d3 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:22.801319 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:22.916078 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ae659-7613-4115-aae6-5a535695db56 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:22.956763 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed82db-6cae-4f7d-80c5-e43d9b0601d3 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:22.989305 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25167ff-2e92-465e-9f71-54456fbfd47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:22.990316 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25167ff-2e92-465e-9f71-54456fbfd47e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:22.990737 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25167ff-2e92-465e-9f71-54456fbfd47e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:22.991149 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25167ff-2e92-465e-9f71-54456fbfd47e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:23.021540 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25167ff-2e92-465e-9f71-54456fbfd47e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:45:23.027402 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-d25167ff-2e92-465e-9f71-54456fbfd47e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:45:23.027402 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:45:23.027402 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:45:23.027402 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:45:23.027402 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:45:23.027402 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:45:23.027402 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:45:23.027402 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:45:23.027402 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:45:23.027402 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:45:23.027402 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:45:23.027402 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:45:23.027402 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:45:23.027402 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:45:23.027402 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:45:23.027402 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:45:23.028403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:45:23.028403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:45:23.028403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:45:23.028403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:45:23.028403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:45:23.028403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:45:23.028403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:45:23.028403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:45:23.028403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:45:23.028403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:45:23.028403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:45:23.028403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:45:23.028403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:45:23.028403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:45:23.028403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:45:23.028403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:45:23.029383 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:45:23.029383 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:45:23.029383 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:45:23.029383 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:45:23.029383 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:45:23.029383 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:45:23.029383 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:45:23.029383 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:45:23.029383 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:45:23.029383 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:45:23.029383 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:45:23.029383 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:45:23.036817 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f016cc-9cee-4975-a0a1-e459e29b9644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:23.036817 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f016cc-9cee-4975-a0a1-e459e29b9644 None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:23.036817 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f016cc-9cee-4975-a0a1-e459e29b9644 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:23.036817 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f016cc-9cee-4975-a0a1-e459e29b9644 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:23.037152 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f016cc-9cee-4975-a0a1-e459e29b9644 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:23.037152 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f016cc-9cee-4975-a0a1-e459e29b9644 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:23.039525 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 16/30] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 30 15:45:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 15:45:23.047216 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25167ff-2e92-465e-9f71-54456fbfd47e None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:23.055913 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:23.191436 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25167ff-2e92-465e-9f71-54456fbfd47e None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:23.216650 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 15/31] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Aug 30 15:45:22 2022] POST /identity/v3/roles => generated 219 bytes in 475 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:45:23.218486 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f016cc-9cee-4975-a0a1-e459e29b9644 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:23.228824 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a204f-0581-41ec-8f1e-76db02e66a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:23.229793 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a204f-0581-41ec-8f1e-76db02e66a1b None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:23.230252 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a204f-0581-41ec-8f1e-76db02e66a1b None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:23.230690 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a204f-0581-41ec-8f1e-76db02e66a1b None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:23.231651 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a204f-0581-41ec-8f1e-76db02e66a1b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:23.232122 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a204f-0581-41ec-8f1e-76db02e66a1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:23.234189 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a204f-0581-41ec-8f1e-76db02e66a1b None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:23.244362 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 17/32] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:45:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:23.245584 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a204f-0581-41ec-8f1e-76db02e66a1b None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:23.322827 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:23.363117 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a204f-0581-41ec-8f1e-76db02e66a1b None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:23.394085 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:23.401765 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f016cc-9cee-4975-a0a1-e459e29b9644 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:23.402878 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a712e-5266-4b0f-bed3-ec0322d1b85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:23.404230 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a712e-5266-4b0f-bed3-ec0322d1b85f None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:23.404736 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a712e-5266-4b0f-bed3-ec0322d1b85f None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:23.405249 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a712e-5266-4b0f-bed3-ec0322d1b85f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:23.416532 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a712e-5266-4b0f-bed3-ec0322d1b85f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:23.418246 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a712e-5266-4b0f-bed3-ec0322d1b85f None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:23.437998 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-1b7a712e-5266-4b0f-bed3-ec0322d1b85f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:45:23.437998 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:45:23.437998 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:45:23.437998 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:45:23.437998 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:45:23.437998 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:45:23.437998 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:45:23.437998 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:45:23.437998 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:45:23.437998 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:45:23.437998 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:45:23.437998 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:45:23.437998 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:45:23.437998 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:45:23.437998 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:45:23.437998 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:45:23.438878 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:45:23.438878 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:45:23.438878 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:45:23.438878 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:45:23.438878 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:45:23.438878 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:45:23.438878 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:45:23.438878 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:45:23.438878 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:45:23.438878 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:45:23.438878 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:45:23.438878 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:45:23.438878 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:45:23.438878 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:45:23.438878 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:45:23.438878 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:45:23.438878 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:45:23.439648 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:45:23.439648 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:45:23.439648 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:45:23.441869 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 18/33] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:45:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:45:23.442844 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a712e-5266-4b0f-bed3-ec0322d1b85f None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:23.445132 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f0637-12b7-46ef-94bf-e79d000514a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:23.445940 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f0637-12b7-46ef-94bf-e79d000514a0 None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:23.446377 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f0637-12b7-46ef-94bf-e79d000514a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:23.446780 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f0637-12b7-46ef-94bf-e79d000514a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:23.447578 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412f0637-12b7-46ef-94bf-e79d000514a0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:23.449573 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412f0637-12b7-46ef-94bf-e79d000514a0 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:23.470101 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 16/34] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Aug 30 15:45:23 2022] POST /identity/v3/roles => generated 225 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:45:23.471512 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f0637-12b7-46ef-94bf-e79d000514a0 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:23.620053 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f0637-12b7-46ef-94bf-e79d000514a0 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:23.635239 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a712e-5266-4b0f-bed3-ec0322d1b85f None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:23.670115 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:23.671325 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9188e6-b65a-4f62-9b82-d2d69d08abf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:23.672269 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9188e6-b65a-4f62-9b82-d2d69d08abf0 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:23.672621 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9188e6-b65a-4f62-9b82-d2d69d08abf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:23.673159 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9188e6-b65a-4f62-9b82-d2d69d08abf0 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:23.673905 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9188e6-b65a-4f62-9b82-d2d69d08abf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:23.674208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9188e6-b65a-4f62-9b82-d2d69d08abf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:23.676172 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9188e6-b65a-4f62-9b82-d2d69d08abf0 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:23.692218 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 17/35] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:23.692874 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8839a-d884-4a96-bb1a-e5469b7a19a4 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:23.693163 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8839a-d884-4a96-bb1a-e5469b7a19a4 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:23.693447 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8839a-d884-4a96-bb1a-e5469b7a19a4 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:23.694624 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 18/36] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:45:23.695093 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19343b95-028a-4681-93d5-6fdcbbbc2190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:23.695745 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19343b95-028a-4681-93d5-6fdcbbbc2190 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:23.696214 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19343b95-028a-4681-93d5-6fdcbbbc2190 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:23.696642 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8839a-d884-4a96-bb1a-e5469b7a19a4 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:23.696933 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19343b95-028a-4681-93d5-6fdcbbbc2190 None admin] PATH_INFO: `/v3/users/a8dbd7798b3b4a6f882f197a7c25237a` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:23.698290 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19343b95-028a-4681-93d5-6fdcbbbc2190 None admin] RBAC: Authorizing `identity:get_user(user_id=a8dbd7798b3b4a6f882f197a7c25237a)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:23.699994 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19343b95-028a-4681-93d5-6fdcbbbc2190 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:23.702377 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 19/37] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:45:23 2022] GET /identity/v3/users/a8dbd7798b3b4a6f882f197a7c25237a => generated 247 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:23.708046 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf35f7-98c4-44f0-a315-106fa4f652a0 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:23.708046 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf35f7-98c4-44f0-a315-106fa4f652a0 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:23.708046 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf35f7-98c4-44f0-a315-106fa4f652a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:23.724830 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:23.735430 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-19bf35f7-98c4-44f0-a315-106fa4f652a0 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:23.737485 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-19bf35f7-98c4-44f0-a315-106fa4f652a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:45:23.815677 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 20/38] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:45:23.816523 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf35f7-98c4-44f0-a315-106fa4f652a0 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:23.837562 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8839a-d884-4a96-bb1a-e5469b7a19a4 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:23.876929 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58281954-7c22-4f51-98d1-4253ac4df447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:23.877991 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58281954-7c22-4f51-98d1-4253ac4df447 None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:23.878488 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58281954-7c22-4f51-98d1-4253ac4df447 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:23.878953 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58281954-7c22-4f51-98d1-4253ac4df447 None admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:23.880139 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58281954-7c22-4f51-98d1-4253ac4df447 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:23.881898 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58281954-7c22-4f51-98d1-4253ac4df447 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:23.921313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 19/39] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Aug 30 15:45:23 2022] POST /identity/v3/projects => generated 301 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:45:23.928490 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf35f7-98c4-44f0-a315-106fa4f652a0 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:23.950008 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:23.957910 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9cf43-aaee-42cc-b017-38071b54aab2 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:23.958247 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9cf43-aaee-42cc-b017-38071b54aab2 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:23.958757 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9cf43-aaee-42cc-b017-38071b54aab2 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:23.960436 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 20/40] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:45:23.965745 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867313b-fa31-4b15-a77a-2e9542810242 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:23.966032 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867313b-fa31-4b15-a77a-2e9542810242 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:23.966304 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867313b-fa31-4b15-a77a-2e9542810242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:23.984368 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c68987-6cc7-49fc-b1eb-8b0e525992ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:23.985412 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c68987-6cc7-49fc-b1eb-8b0e525992ee None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:23.986246 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c68987-6cc7-49fc-b1eb-8b0e525992ee None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:23.986929 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c68987-6cc7-49fc-b1eb-8b0e525992ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:23.988917 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c68987-6cc7-49fc-b1eb-8b0e525992ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:23.989387 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-7867313b-fa31-4b15-a77a-2e9542810242 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:23.990969 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7867313b-fa31-4b15-a77a-2e9542810242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:45:23.991379 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c68987-6cc7-49fc-b1eb-8b0e525992ee None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:23.993654 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 21/41] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:45:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:24.005865 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c68987-6cc7-49fc-b1eb-8b0e525992ee None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:24.080233 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:24.089039 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 21/42] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 15:45:24.103894 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867313b-fa31-4b15-a77a-2e9542810242 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:24.147976 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c68987-6cc7-49fc-b1eb-8b0e525992ee None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:24.190473 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5abb59a-bb98-40c6-895e-16df5d146e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:24.191147 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abb59a-bb98-40c6-895e-16df5d146e43 None admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:24.191428 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abb59a-bb98-40c6-895e-16df5d146e43 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:24.191759 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abb59a-bb98-40c6-895e-16df5d146e43 None admin] PATH_INFO: `/v3/domains/default/users/a8dbd7798b3b4a6f882f197a7c25237a/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:24.193752 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5abb59a-bb98-40c6-895e-16df5d146e43 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a8dbd7798b3b4a6f882f197a7c25237a, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:24.195240 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5abb59a-bb98-40c6-895e-16df5d146e43 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:24.225522 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867313b-fa31-4b15-a77a-2e9542810242 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:24.261609 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83362739-ba6d-46a2-bcbc-fc8a661c0797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:24.262227 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83362739-ba6d-46a2-bcbc-fc8a661c0797 None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:24.262510 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83362739-ba6d-46a2-bcbc-fc8a661c0797 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:24.262781 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83362739-ba6d-46a2-bcbc-fc8a661c0797 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:24.263445 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83362739-ba6d-46a2-bcbc-fc8a661c0797 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:24.264990 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83362739-ba6d-46a2-bcbc-fc8a661c0797 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:24.280519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 22/43] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Aug 30 15:45:24 2022] POST /identity/v3/roles => generated 223 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:45:24.316770 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 22/44] 10.222.0.25 () {58 vars in 1361 bytes} [Tue Aug 30 15:45:24 2022] PUT /identity/v3/domains/default/users/a8dbd7798b3b4a6f882f197a7c25237a/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:45:24.367532 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83362739-ba6d-46a2-bcbc-fc8a661c0797 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:24.439979 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:24.491519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83362739-ba6d-46a2-bcbc-fc8a661c0797 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:24.526130 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d0c55-889e-429a-af3a-1e5b4b6a8482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:24.526776 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d0c55-889e-429a-af3a-1e5b4b6a8482 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:24.527062 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d0c55-889e-429a-af3a-1e5b4b6a8482 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:24.527341 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d0c55-889e-429a-af3a-1e5b4b6a8482 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:24.528474 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d0c55-889e-429a-af3a-1e5b4b6a8482 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:24.530222 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d0c55-889e-429a-af3a-1e5b4b6a8482 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:24.531809 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 23/45] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:45:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:24.537981 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5abb59a-bb98-40c6-895e-16df5d146e43 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:24.584077 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:24.640288 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5abb59a-bb98-40c6-895e-16df5d146e43 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:24.674128 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95ccc6-e03c-402d-96fc-529b9c52ad16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:24.674744 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95ccc6-e03c-402d-96fc-529b9c52ad16 None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:24.675025 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95ccc6-e03c-402d-96fc-529b9c52ad16 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:24.675301 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95ccc6-e03c-402d-96fc-529b9c52ad16 None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:24.675962 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95ccc6-e03c-402d-96fc-529b9c52ad16 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:24.677647 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95ccc6-e03c-402d-96fc-529b9c52ad16 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:24.816059 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 23/46] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Aug 30 15:45:24 2022] POST /identity/v3/projects => generated 312 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:45:26.236266 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd91fb-e4c9-473d-b8be-a5ddb521ad64 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:26.236805 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd91fb-e4c9-473d-b8be-a5ddb521ad64 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:26.236997 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd91fb-e4c9-473d-b8be-a5ddb521ad64 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:26.238214 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 24/47] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:45:26.243602 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfebeb-3d3a-464e-882f-e7fe07572289 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:26.244011 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfebeb-3d3a-464e-882f-e7fe07572289 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:26.244240 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfebeb-3d3a-464e-882f-e7fe07572289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:26.263089 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-21bfebeb-3d3a-464e-882f-e7fe07572289 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:26.265415 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-21bfebeb-3d3a-464e-882f-e7fe07572289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:45:26.331203 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 24/48] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:45:26.601309 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd91fb-e4c9-473d-b8be-a5ddb521ad64 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:26.701697 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd91fb-e4c9-473d-b8be-a5ddb521ad64 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:26.731727 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:26.741586 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24a423-eb30-4722-a57e-56ea6b8fe58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:26.742241 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24a423-eb30-4722-a57e-56ea6b8fe58e None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:26.742528 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24a423-eb30-4722-a57e-56ea6b8fe58e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:26.742806 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24a423-eb30-4722-a57e-56ea6b8fe58e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:26.754029 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060bd526-b428-474c-9a98-5b9e5ff2434b None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:26.754328 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060bd526-b428-474c-9a98-5b9e5ff2434b None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:26.754606 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060bd526-b428-474c-9a98-5b9e5ff2434b None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:26.755075 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e24a423-eb30-4722-a57e-56ea6b8fe58e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:45:26.755962 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 25/49] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 15:45:26.760831 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d952a6f-6f77-468e-9924-b9c5d0745126 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:26.761121 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d952a6f-6f77-468e-9924-b9c5d0745126 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:26.761289 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-1e24a423-eb30-4722-a57e-56ea6b8fe58e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:45:26.761289 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:45:26.761289 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:45:26.761289 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:45:26.761289 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:45:26.761289 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:45:26.761289 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:45:26.761289 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:45:26.761289 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:45:26.761289 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:45:26.761289 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:45:26.761289 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:45:26.761289 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:45:26.761289 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:45:26.761289 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:45:26.761289 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:45:26.762094 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:45:26.762094 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:45:26.762094 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:45:26.762094 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:45:26.762094 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:45:26.762094 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:45:26.762094 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:45:26.762094 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:45:26.762094 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:45:26.762094 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:45:26.762094 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:45:26.762094 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:45:26.762094 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:45:26.762094 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:45:26.762094 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:45:26.762094 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:45:26.762812 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:45:26.762812 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:45:26.762812 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:45:26.762812 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:45:26.762812 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:45:26.762812 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:45:26.762812 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:45:26.762812 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:45:26.762812 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:45:26.762812 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:45:26.762812 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:45:26.762812 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:45:26.763495 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d952a6f-6f77-468e-9924-b9c5d0745126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:26.763567 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 25/50] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 30 15:45:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:45:26.768435 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24a423-eb30-4722-a57e-56ea6b8fe58e None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:26.780488 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-3d952a6f-6f77-468e-9924-b9c5d0745126 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:26.781685 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-3d952a6f-6f77-468e-9924-b9c5d0745126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:45:26.801874 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:26.851226 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 26/51] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 15:45:26.869449 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24a423-eb30-4722-a57e-56ea6b8fe58e None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:26.901391 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530cc1c8-b07a-4125-b322-c70b85d8fb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:26.901992 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cc1c8-b07a-4125-b322-c70b85d8fb91 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:26.902279 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cc1c8-b07a-4125-b322-c70b85d8fb91 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:26.902549 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cc1c8-b07a-4125-b322-c70b85d8fb91 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:26.903210 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530cc1c8-b07a-4125-b322-c70b85d8fb91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:26.903511 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530cc1c8-b07a-4125-b322-c70b85d8fb91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:26.905612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530cc1c8-b07a-4125-b322-c70b85d8fb91 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:27.021163 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 26/52] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:45:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:45:27.026681 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d952a6f-6f77-468e-9924-b9c5d0745126 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:27.127504 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530cc1c8-b07a-4125-b322-c70b85d8fb91 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:27.130962 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d952a6f-6f77-468e-9924-b9c5d0745126 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:27.165002 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971ae3d-636a-43c9-908e-63681c13c867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:27.165640 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971ae3d-636a-43c9-908e-63681c13c867 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:27.165923 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971ae3d-636a-43c9-908e-63681c13c867 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:27.166199 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971ae3d-636a-43c9-908e-63681c13c867 None admin] PATH_INFO: `/v3/users/a8dbd7798b3b4a6f882f197a7c25237a` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:27.167321 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971ae3d-636a-43c9-908e-63681c13c867 None admin] RBAC: Authorizing `identity:get_user(user_id=a8dbd7798b3b4a6f882f197a7c25237a)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:27.168829 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971ae3d-636a-43c9-908e-63681c13c867 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:27.171040 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 27/53] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:45:27 2022] GET /identity/v3/users/a8dbd7798b3b4a6f882f197a7c25237a => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:27.176477 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971ae3d-636a-43c9-908e-63681c13c867 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:27.178183 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:27.200264 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:27.229429 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530cc1c8-b07a-4125-b322-c70b85d8fb91 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:27.262914 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04568a-2b51-466c-87e4-ef5d5300a888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:27.263538 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04568a-2b51-466c-87e4-ef5d5300a888 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:27.263873 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04568a-2b51-466c-87e4-ef5d5300a888 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:27.265071 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04568a-2b51-466c-87e4-ef5d5300a888 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:27.266218 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04568a-2b51-466c-87e4-ef5d5300a888 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:27.267915 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04568a-2b51-466c-87e4-ef5d5300a888 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:27.269695 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 27/54] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:45:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:45:27.274607 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971ae3d-636a-43c9-908e-63681c13c867 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:27.275016 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04568a-2b51-466c-87e4-ef5d5300a888 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:27.309061 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71feda02-19cc-479b-9130-06419b243bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:27.309686 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71feda02-19cc-479b-9130-06419b243bf9 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:27.309963 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71feda02-19cc-479b-9130-06419b243bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:27.310237 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71feda02-19cc-479b-9130-06419b243bf9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:27.311389 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71feda02-19cc-479b-9130-06419b243bf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:27.312871 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71feda02-19cc-479b-9130-06419b243bf9 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:27.314424 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 28/55] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:45:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:45:27.320030 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71feda02-19cc-479b-9130-06419b243bf9 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:27.374995 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04568a-2b51-466c-87e4-ef5d5300a888 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:27.391678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:27.409884 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0a558-9bed-437a-883a-68967ffe682c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:27.410563 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0a558-9bed-437a-883a-68967ffe682c None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:27.410754 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:27.410877 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0a558-9bed-437a-883a-68967ffe682c None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:27.411116 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0a558-9bed-437a-883a-68967ffe682c None admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:27.411776 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f0a558-9bed-437a-883a-68967ffe682c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:27.413346 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f0a558-9bed-437a-883a-68967ffe682c None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:27.419971 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71feda02-19cc-479b-9130-06419b243bf9 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:27.439541 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 28/56] 10.222.0.25 () {60 vars in 1140 bytes} [Tue Aug 30 15:45:27 2022] POST /identity/v3/projects => generated 298 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:45:27.457171 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd211a97-9ba2-4381-9a41-094a6699bf27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:27.457813 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd211a97-9ba2-4381-9a41-094a6699bf27 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:27.458095 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd211a97-9ba2-4381-9a41-094a6699bf27 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:27.458369 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd211a97-9ba2-4381-9a41-094a6699bf27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:27.459130 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd211a97-9ba2-4381-9a41-094a6699bf27 None admin] RBAC: Adding query filter params (role.id=676938e69210499ca11ee75dd572d0dc, scope.domain.id=default, user.id=a8dbd7798b3b4a6f882f197a7c25237a) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:27.459443 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd211a97-9ba2-4381-9a41-094a6699bf27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:27.461010 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd211a97-9ba2-4381-9a41-094a6699bf27 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:27.467975 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 29/57] 10.222.0.25 () {56 vars in 1322 bytes} [Tue Aug 30 15:45:27 2022] GET /identity/v3/role_assignments?user.id=a8dbd7798b3b4a6f882f197a7c25237a&scope.domain.id=default&role.id=676938e69210499ca11ee75dd572d0dc => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:45:29.344159 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391649a-d5ed-4a81-8838-1163530182b7 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:29.344670 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391649a-d5ed-4a81-8838-1163530182b7 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:29.344754 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391649a-d5ed-4a81-8838-1163530182b7 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:29.346091 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 29/58] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:45:29.351243 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33090ad7-c87c-4ec8-a932-b88366c1490b None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:29.351671 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33090ad7-c87c-4ec8-a932-b88366c1490b None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:29.351802 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33090ad7-c87c-4ec8-a932-b88366c1490b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:29.370073 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-33090ad7-c87c-4ec8-a932-b88366c1490b None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:29.371248 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-33090ad7-c87c-4ec8-a932-b88366c1490b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:45:29.437523 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 30/59] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:45:29.702315 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391649a-d5ed-4a81-8838-1163530182b7 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:29.819570 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391649a-d5ed-4a81-8838-1163530182b7 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:29.851331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07eab7e-e0e9-4d31-a730-aff4e6cf8043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:29.851949 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07eab7e-e0e9-4d31-a730-aff4e6cf8043 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:29.852228 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07eab7e-e0e9-4d31-a730-aff4e6cf8043 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:29.852499 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07eab7e-e0e9-4d31-a730-aff4e6cf8043 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:29.853629 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07eab7e-e0e9-4d31-a730-aff4e6cf8043 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:29.855064 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07eab7e-e0e9-4d31-a730-aff4e6cf8043 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:29.856597 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 30/60] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:45:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:29.863221 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33090ad7-c87c-4ec8-a932-b88366c1490b None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:29.945226 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:29.960104 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33090ad7-c87c-4ec8-a932-b88366c1490b None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:29.993987 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfaef7d-9b24-4fa4-b654-718f850d2273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:29.994600 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfaef7d-9b24-4fa4-b654-718f850d2273 None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:29.994881 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfaef7d-9b24-4fa4-b654-718f850d2273 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:29.995152 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfaef7d-9b24-4fa4-b654-718f850d2273 None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:29.995797 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfaef7d-9b24-4fa4-b654-718f850d2273 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:29.997297 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfaef7d-9b24-4fa4-b654-718f850d2273 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:30.023049 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 31/61] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Aug 30 15:45:29 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:45:32.953319 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c7901-ee80-45ff-9567-e5359b1d20b7 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:32.953841 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c7901-ee80-45ff-9567-e5359b1d20b7 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:32.953915 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c7901-ee80-45ff-9567-e5359b1d20b7 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:32.955220 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 31/62] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:45:32.960382 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888e0fc-bc7a-444e-9b02-7fb5a46664e5 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:32.960763 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888e0fc-bc7a-444e-9b02-7fb5a46664e5 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:32.960988 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888e0fc-bc7a-444e-9b02-7fb5a46664e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:32.985211 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-c888e0fc-bc7a-444e-9b02-7fb5a46664e5 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:32.986358 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-c888e0fc-bc7a-444e-9b02-7fb5a46664e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:45:33.078364 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 32/63] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:45:33.188906 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dd0ff-5d19-456d-92bd-4e09b4861c5f None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:33.189212 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dd0ff-5d19-456d-92bd-4e09b4861c5f None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:33.189473 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dd0ff-5d19-456d-92bd-4e09b4861c5f None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:33.190822 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 32/64] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:45:33.206703 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426b02f-7b28-4c35-9679-51f297a06173 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:33.206998 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426b02f-7b28-4c35-9679-51f297a06173 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:33.207279 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426b02f-7b28-4c35-9679-51f297a06173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:33.234226 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-1426b02f-7b28-4c35-9679-51f297a06173 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:33.235516 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-1426b02f-7b28-4c35-9679-51f297a06173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:45:33.246533 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aeb53b-da83-4ec7-af13-b515e281e543 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:33.247113 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aeb53b-da83-4ec7-af13-b515e281e543 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:33.247581 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aeb53b-da83-4ec7-af13-b515e281e543 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:33.249887 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 33/65] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:45:33.255172 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089131c3-8fd3-4adf-aab6-07321172caf1 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:33.255728 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089131c3-8fd3-4adf-aab6-07321172caf1 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:33.256228 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089131c3-8fd3-4adf-aab6-07321172caf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:33.274396 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-089131c3-8fd3-4adf-aab6-07321172caf1 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:33.275875 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-089131c3-8fd3-4adf-aab6-07321172caf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:45:33.324552 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:33.368602 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 34/66] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 15:45:33.378297 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 33/67] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:45:33.503899 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089131c3-8fd3-4adf-aab6-07321172caf1 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:33.565104 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5151a-4d1e-4bb7-a732-e033b178b636 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:33.565729 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5151a-4d1e-4bb7-a732-e033b178b636 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:33.566210 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5151a-4d1e-4bb7-a732-e033b178b636 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:33.567799 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 34/68] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:45:33.573843 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2111ae-a6e3-4074-9dd6-e9c6b6e18e98 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:33.575572 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2111ae-a6e3-4074-9dd6-e9c6b6e18e98 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:33.576289 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2111ae-a6e3-4074-9dd6-e9c6b6e18e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:33.589265 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:33.613898 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-3d2111ae-a6e3-4074-9dd6-e9c6b6e18e98 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:33.615443 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-3d2111ae-a6e3-4074-9dd6-e9c6b6e18e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:45:33.626947 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089131c3-8fd3-4adf-aab6-07321172caf1 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:33.671630 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf80c6d-46a9-4b5e-a28f-1a8a7abfd966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:33.674539 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf80c6d-46a9-4b5e-a28f-1a8a7abfd966 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:33.674992 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf80c6d-46a9-4b5e-a28f-1a8a7abfd966 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:33.675406 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf80c6d-46a9-4b5e-a28f-1a8a7abfd966 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:33.692729 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf80c6d-46a9-4b5e-a28f-1a8a7abfd966 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:45:33.699848 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-1cf80c6d-46a9-4b5e-a28f-1a8a7abfd966 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 15:45:33.699848 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:45:33.699848 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:45:33.699848 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:45:33.699848 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:45:33.699848 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:45:33.699848 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:45:33.699848 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:45:33.699848 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:45:33.699848 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:45:33.699848 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:45:33.699848 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:45:33.699848 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:45:33.699848 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:45:33.699848 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:45:33.699848 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:45:33.700881 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:45:33.700881 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:45:33.700881 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:45:33.700881 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:45:33.700881 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:45:33.700881 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:45:33.700881 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:45:33.700881 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:45:33.700881 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:45:33.700881 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:45:33.700881 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:45:33.700881 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:45:33.700881 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:45:33.700881 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:45:33.700881 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:45:33.700881 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:45:33.702218 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:45:33.702218 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:45:33.702218 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:45:33.702218 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:45:33.702218 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:45:33.702218 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:45:33.702218 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:45:33.702218 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:45:33.702218 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:45:33.702218 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:45:33.702218 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 15:45:33.702218 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:45:33.703104 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 35/69] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:45:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:45:33.703718 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf80c6d-46a9-4b5e-a28f-1a8a7abfd966 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:33.718274 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 35/70] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:45:33.719501 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2111ae-a6e3-4074-9dd6-e9c6b6e18e98 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:33.749538 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:33.836607 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2111ae-a6e3-4074-9dd6-e9c6b6e18e98 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:33.853663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf80c6d-46a9-4b5e-a28f-1a8a7abfd966 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:33.875076 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:33.881421 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f050cdb-82b3-4a72-ac4e-470458aac6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:33.882172 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f050cdb-82b3-4a72-ac4e-470458aac6ed None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:33.882650 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f050cdb-82b3-4a72-ac4e-470458aac6ed None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:33.883103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f050cdb-82b3-4a72-ac4e-470458aac6ed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:33.891388 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf50f7-94b6-41ab-ad7e-9c00cd3adfa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:33.892030 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf50f7-94b6-41ab-ad7e-9c00cd3adfa8 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:33.892307 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf50f7-94b6-41ab-ad7e-9c00cd3adfa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:33.892850 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf50f7-94b6-41ab-ad7e-9c00cd3adfa8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:33.895519 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f050cdb-82b3-4a72-ac4e-470458aac6ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:45:33.900453 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-6f050cdb-82b3-4a72-ac4e-470458aac6ed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 15:45:33.900453 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:45:33.900453 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:45:33.900453 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:45:33.900453 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:45:33.900453 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:45:33.900453 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:45:33.900453 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:45:33.900453 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:45:33.900453 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:45:33.900453 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:45:33.900453 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:45:33.900453 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:45:33.900453 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:45:33.900453 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:45:33.900453 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:45:33.901496 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:45:33.901496 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:45:33.901496 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:45:33.901496 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:45:33.901496 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:45:33.901496 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:45:33.901496 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:45:33.901496 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:45:33.901496 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:45:33.901496 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:45:33.901496 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:45:33.901496 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:45:33.901496 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:45:33.901496 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:45:33.901496 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:45:33.901496 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:45:33.902432 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:45:33.902432 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:45:33.902432 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:45:33.902432 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:45:33.902432 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:45:33.902432 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:45:33.902432 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:45:33.902432 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:45:33.902432 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:45:33.902432 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:45:33.902432 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 15:45:33.902432 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:45:33.903554 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cf50f7-94b6-41ab-ad7e-9c00cd3adfa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:45:33.904429 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 36/71] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Aug 30 15:45:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:45:33.905430 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f050cdb-82b3-4a72-ac4e-470458aac6ed None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:33.909092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-37cf50f7-94b6-41ab-ad7e-9c00cd3adfa8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:45:33.909092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:45:33.909092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:45:33.909092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:45:33.909092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:45:33.909092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:45:33.909092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:45:33.909092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:45:33.909092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:45:33.909092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:45:33.909092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:45:33.909092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:45:33.909092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:45:33.909092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:45:33.909092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:45:33.909092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:45:33.916200 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:45:33.916200 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:45:33.916200 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:45:33.916200 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:45:33.916200 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:45:33.916200 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:45:33.916200 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:45:33.916200 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:45:33.916200 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:45:33.916200 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:45:33.916200 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:45:33.916200 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:45:33.916200 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:45:33.916200 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:45:33.916200 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:45:33.916200 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:45:33.917027 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:45:33.917027 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:45:33.917027 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:45:33.917027 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:45:33.917027 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:45:33.917027 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:45:33.917027 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:45:33.917027 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:45:33.917027 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:45:33.917027 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:45:33.917027 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:45:33.917027 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:45:33.917027 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 36/72] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 30 15:45:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:45:33.917027 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4bdf7-c9fe-49aa-80e8-c9f0a83c8224 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:33.917693 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4bdf7-c9fe-49aa-80e8-c9f0a83c8224 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:33.917693 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4bdf7-c9fe-49aa-80e8-c9f0a83c8224 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:33.917693 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 37/73] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:45:33.917693 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4bdf7-c9fe-49aa-80e8-c9f0a83c8224 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:34.005267 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:34.019289 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f050cdb-82b3-4a72-ac4e-470458aac6ed None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:34.021436 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4bdf7-c9fe-49aa-80e8-c9f0a83c8224 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:34.053400 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a4d7d-12cc-4003-ae1f-82812b32cf36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:34.054018 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a4d7d-12cc-4003-ae1f-82812b32cf36 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:34.054304 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a4d7d-12cc-4003-ae1f-82812b32cf36 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:34.054414 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd1598-78bd-4a67-a235-cd45c2b91a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:34.054582 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a4d7d-12cc-4003-ae1f-82812b32cf36 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:34.054930 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd1598-78bd-4a67-a235-cd45c2b91a33 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:34.055207 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd1598-78bd-4a67-a235-cd45c2b91a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:34.055297 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a4d7d-12cc-4003-ae1f-82812b32cf36 None admin] RBAC: Adding query filter params (name=member) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:34.055475 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd1598-78bd-4a67-a235-cd45c2b91a33 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:34.055567 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a4d7d-12cc-4003-ae1f-82812b32cf36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:34.056137 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd1598-78bd-4a67-a235-cd45c2b91a33 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:34.056436 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd1598-78bd-4a67-a235-cd45c2b91a33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:34.056978 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a4d7d-12cc-4003-ae1f-82812b32cf36 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:34.057830 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd1598-78bd-4a67-a235-cd45c2b91a33 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:34.065803 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 37/74] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 30 15:45:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:34.066604 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a4d7d-12cc-4003-ae1f-82812b32cf36 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:34.067439 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 38/75] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:45:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:34.068731 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b7aa9-968e-4572-bc5d-238a3c2174b7 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:34.069054 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b7aa9-968e-4572-bc5d-238a3c2174b7 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:34.069330 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b7aa9-968e-4572-bc5d-238a3c2174b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:34.087247 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-451b7aa9-968e-4572-bc5d-238a3c2174b7 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:34.088386 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-451b7aa9-968e-4572-bc5d-238a3c2174b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:45:34.125857 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:34.156985 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 39/76] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:45:34.157888 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b7aa9-968e-4572-bc5d-238a3c2174b7 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:34.175188 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a4d7d-12cc-4003-ae1f-82812b32cf36 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:34.211120 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aee7a3-8d41-46cb-af44-f7d62440d208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:34.211943 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aee7a3-8d41-46cb-af44-f7d62440d208 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:34.212223 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aee7a3-8d41-46cb-af44-f7d62440d208 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:34.212570 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aee7a3-8d41-46cb-af44-f7d62440d208 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:34.213267 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aee7a3-8d41-46cb-af44-f7d62440d208 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:34.213568 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aee7a3-8d41-46cb-af44-f7d62440d208 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:34.214969 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aee7a3-8d41-46cb-af44-f7d62440d208 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:34.223197 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 38/77] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:45:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:34.224166 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aee7a3-8d41-46cb-af44-f7d62440d208 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:34.242516 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:34.272641 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b7aa9-968e-4572-bc5d-238a3c2174b7 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:34.309651 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de5b9d-f7ce-498a-bdf6-4935bab0b398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:34.310560 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de5b9d-f7ce-498a-bdf6-4935bab0b398 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:34.311671 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de5b9d-f7ce-498a-bdf6-4935bab0b398 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:34.312215 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de5b9d-f7ce-498a-bdf6-4935bab0b398 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:34.322697 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5de5b9d-f7ce-498a-bdf6-4935bab0b398 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:45:34.326584 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aee7a3-8d41-46cb-af44-f7d62440d208 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:34.328054 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-c5de5b9d-f7ce-498a-bdf6-4935bab0b398 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 15:45:34.328054 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:45:34.328054 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:45:34.328054 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:45:34.328054 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:45:34.328054 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:45:34.328054 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:45:34.328054 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:45:34.328054 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:45:34.328054 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:45:34.328054 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:45:34.328054 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:45:34.328054 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:45:34.328054 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:45:34.328054 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:45:34.328054 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:45:34.328890 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:45:34.328890 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:45:34.328890 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:45:34.328890 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:45:34.328890 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:45:34.328890 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:45:34.328890 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:45:34.328890 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:45:34.328890 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:45:34.328890 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:45:34.328890 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:45:34.328890 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:45:34.328890 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:45:34.328890 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:45:34.328890 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:45:34.328890 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:45:34.329645 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:45:34.329645 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:45:34.329645 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:45:34.329645 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:45:34.329645 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:45:34.329645 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:45:34.329645 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:45:34.329645 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:45:34.329645 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:45:34.329645 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:45:34.329645 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 15:45:34.329645 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:45:34.329645 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 40/78] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:45:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:45:34.330261 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de5b9d-f7ce-498a-bdf6-4935bab0b398 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:34.346064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:34.366593 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf290298-0b8d-4c3b-a014-ddc9200924af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:34.367357 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf290298-0b8d-4c3b-a014-ddc9200924af None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:34.367904 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf290298-0b8d-4c3b-a014-ddc9200924af None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:34.368019 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf290298-0b8d-4c3b-a014-ddc9200924af None admin] PATH_INFO: `/v3/users/a3d5c3129b0d4c998a2a04444d03e300` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:34.382228 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf290298-0b8d-4c3b-a014-ddc9200924af None admin] RBAC: Authorizing `identity:get_user(user_id=a3d5c3129b0d4c998a2a04444d03e300)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:34.383771 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf290298-0b8d-4c3b-a014-ddc9200924af None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:34.385586 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 39/79] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:45:34 2022] GET /identity/v3/users/a3d5c3129b0d4c998a2a04444d03e300 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:34.391110 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf290298-0b8d-4c3b-a014-ddc9200924af None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:34.445484 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de5b9d-f7ce-498a-bdf6-4935bab0b398 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:34.480591 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339f67b-37c4-4d58-8421-5cae56cc24cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:34.481275 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339f67b-37c4-4d58-8421-5cae56cc24cf None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:34.481549 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339f67b-37c4-4d58-8421-5cae56cc24cf None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:34.481817 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339f67b-37c4-4d58-8421-5cae56cc24cf None admin] PATH_INFO: `/v3/users/a3d5c3129b0d4c998a2a04444d03e300` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:34.483776 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339f67b-37c4-4d58-8421-5cae56cc24cf None admin] RBAC: Authorizing `identity:get_user(user_id=a3d5c3129b0d4c998a2a04444d03e300)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:34.485269 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339f67b-37c4-4d58-8421-5cae56cc24cf None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:34.487000 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 41/80] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:45:34 2022] GET /identity/v3/users/a3d5c3129b0d4c998a2a04444d03e300 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:34.487585 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339f67b-37c4-4d58-8421-5cae56cc24cf None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:34.495537 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf290298-0b8d-4c3b-a014-ddc9200924af None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:34.495792 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:34.530572 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21bc55-87f0-4802-9ced-88c68ed3dcc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:34.531205 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21bc55-87f0-4802-9ced-88c68ed3dcc7 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:34.531490 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21bc55-87f0-4802-9ced-88c68ed3dcc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:34.531769 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21bc55-87f0-4802-9ced-88c68ed3dcc7 None admin] PATH_INFO: `/v3/users/a8dbd7798b3b4a6f882f197a7c25237a` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:34.532948 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f21bc55-87f0-4802-9ced-88c68ed3dcc7 None admin] RBAC: Authorizing `identity:get_user(user_id=a8dbd7798b3b4a6f882f197a7c25237a)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:34.534418 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f21bc55-87f0-4802-9ced-88c68ed3dcc7 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:34.536185 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 40/81] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:45:34 2022] GET /identity/v3/users/a8dbd7798b3b4a6f882f197a7c25237a => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:34.536750 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21bc55-87f0-4802-9ced-88c68ed3dcc7 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:34.580139 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:34.592763 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339f67b-37c4-4d58-8421-5cae56cc24cf None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:34.626104 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a489a-5ed6-48cc-86e8-d3d225135af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:34.626655 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a489a-5ed6-48cc-86e8-d3d225135af2 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:34.626943 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a489a-5ed6-48cc-86e8-d3d225135af2 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:34.627223 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a489a-5ed6-48cc-86e8-d3d225135af2 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:34.627894 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a489a-5ed6-48cc-86e8-d3d225135af2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:34.628199 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a489a-5ed6-48cc-86e8-d3d225135af2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:34.629597 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a489a-5ed6-48cc-86e8-d3d225135af2 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:34.635783 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21bc55-87f0-4802-9ced-88c68ed3dcc7 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:34.637367 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 42/82] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 30 15:45:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:34.638158 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a489a-5ed6-48cc-86e8-d3d225135af2 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:34.670059 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6680d54-6652-43c9-82e6-cb41218c3528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:34.671325 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6680d54-6652-43c9-82e6-cb41218c3528 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:34.671604 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6680d54-6652-43c9-82e6-cb41218c3528 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:34.671885 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6680d54-6652-43c9-82e6-cb41218c3528 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:34.703753 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:34.741411 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6680d54-6652-43c9-82e6-cb41218c3528 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:34.741791 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a489a-5ed6-48cc-86e8-d3d225135af2 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:34.742930 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6680d54-6652-43c9-82e6-cb41218c3528 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:34.775326 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44672905-70ab-427c-8a4a-759bc686a7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:34.776163 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44672905-70ab-427c-8a4a-759bc686a7ba None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:34.776444 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44672905-70ab-427c-8a4a-759bc686a7ba None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:34.776720 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44672905-70ab-427c-8a4a-759bc686a7ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:34.777877 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44672905-70ab-427c-8a4a-759bc686a7ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:34.779300 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44672905-70ab-427c-8a4a-759bc686a7ba None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:34.781687 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 43/83] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:45:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:34.782292 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44672905-70ab-427c-8a4a-759bc686a7ba None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:34.787308 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:34.845004 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 41/84] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:45:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 15:45:34.845853 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6680d54-6652-43c9-82e6-cb41218c3528 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:34.883582 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44672905-70ab-427c-8a4a-759bc686a7ba None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:34.917601 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea0ac0-28f4-4e38-96e9-341693d20b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:34.918209 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea0ac0-28f4-4e38-96e9-341693d20b5e None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:34.918491 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea0ac0-28f4-4e38-96e9-341693d20b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:34.918769 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea0ac0-28f4-4e38-96e9-341693d20b5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:34.922460 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:34.942264 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6680d54-6652-43c9-82e6-cb41218c3528 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:34.976974 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecaf8bb-3108-4ffb-85ce-e7d1f9b473dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:34.977581 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecaf8bb-3108-4ffb-85ce-e7d1f9b473dc None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:34.977860 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecaf8bb-3108-4ffb-85ce-e7d1f9b473dc None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:34.978134 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecaf8bb-3108-4ffb-85ce-e7d1f9b473dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:34.986768 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea0ac0-28f4-4e38-96e9-341693d20b5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:34.988254 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea0ac0-28f4-4e38-96e9-341693d20b5e None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:34.989638 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:35.044730 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecaf8bb-3108-4ffb-85ce-e7d1f9b473dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:35.046752 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecaf8bb-3108-4ffb-85ce-e7d1f9b473dc None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:35.085339 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 44/85] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:45:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 15:45:35.086184 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea0ac0-28f4-4e38-96e9-341693d20b5e None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:35.121292 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:35.145683 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 42/86] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:45:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 15:45:35.146443 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecaf8bb-3108-4ffb-85ce-e7d1f9b473dc None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:35.186242 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea0ac0-28f4-4e38-96e9-341693d20b5e None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:35.188605 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:35.219842 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886a6e9-2aaa-4033-9e76-5fe6d6e669ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:35.220482 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886a6e9-2aaa-4033-9e76-5fe6d6e669ba None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:35.220765 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886a6e9-2aaa-4033-9e76-5fe6d6e669ba None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:35.221072 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886a6e9-2aaa-4033-9e76-5fe6d6e669ba None admin] PATH_INFO: `/v3/users/a3d5c3129b0d4c998a2a04444d03e300` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:35.222217 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9886a6e9-2aaa-4033-9e76-5fe6d6e669ba None admin] RBAC: Authorizing `identity:get_user(user_id=a3d5c3129b0d4c998a2a04444d03e300)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:35.223683 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9886a6e9-2aaa-4033-9e76-5fe6d6e669ba None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:35.225300 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 45/87] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:45:35 2022] GET /identity/v3/users/a3d5c3129b0d4c998a2a04444d03e300 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:35.230658 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886a6e9-2aaa-4033-9e76-5fe6d6e669ba None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:35.245138 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecaf8bb-3108-4ffb-85ce-e7d1f9b473dc None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:35.278177 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef2306-9ab1-485b-a751-2dc0b460e8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:35.278800 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef2306-9ab1-485b-a751-2dc0b460e8c9 None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:35.279086 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef2306-9ab1-485b-a751-2dc0b460e8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:35.279361 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef2306-9ab1-485b-a751-2dc0b460e8c9 None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:35.280547 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef2306-9ab1-485b-a751-2dc0b460e8c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:35.282041 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef2306-9ab1-485b-a751-2dc0b460e8c9 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:35.305286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 43/88] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Aug 30 15:45:35 2022] POST /identity/v3/users => generated 289 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:45:35.306428 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef2306-9ab1-485b-a751-2dc0b460e8c9 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:35.335685 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886a6e9-2aaa-4033-9e76-5fe6d6e669ba None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:35.339865 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:35.380619 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f16e09-9584-48d0-a06a-f687d0eb744e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:35.381587 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f16e09-9584-48d0-a06a-f687d0eb744e None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:35.382051 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f16e09-9584-48d0-a06a-f687d0eb744e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:35.382325 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f16e09-9584-48d0-a06a-f687d0eb744e None admin] PATH_INFO: `/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:35.383576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f16e09-9584-48d0-a06a-f687d0eb744e None admin] RBAC: Authorizing `identity:get_project(project_id=ecc1689f0ba04f14ac9c0d53a2a4a32d)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:35.385082 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f16e09-9584-48d0-a06a-f687d0eb744e None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:35.387156 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 46/89] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:45:35 2022] GET /identity/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:35.388027 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f16e09-9584-48d0-a06a-f687d0eb744e None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:35.433626 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:35.439909 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef2306-9ab1-485b-a751-2dc0b460e8c9 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:35.480568 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c2e29-134f-480e-b6a5-07364dc8b109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:35.481317 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c2e29-134f-480e-b6a5-07364dc8b109 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:35.481595 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c2e29-134f-480e-b6a5-07364dc8b109 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:35.481865 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c2e29-134f-480e-b6a5-07364dc8b109 None admin] PATH_INFO: `/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:35.483137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60c2e29-134f-480e-b6a5-07364dc8b109 None admin] RBAC: Authorizing `identity:get_project(project_id=ecc1689f0ba04f14ac9c0d53a2a4a32d)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:35.484616 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60c2e29-134f-480e-b6a5-07364dc8b109 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:35.486297 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 44/90] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:45:35 2022] GET /identity/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:35.487063 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c2e29-134f-480e-b6a5-07364dc8b109 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:35.509329 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f16e09-9584-48d0-a06a-f687d0eb744e None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:35.551154 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10bbf8d-6fc2-4497-bf45-3b5f63fb8fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:35.551346 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bbf8d-6fc2-4497-bf45-3b5f63fb8fa8 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:35.551613 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bbf8d-6fc2-4497-bf45-3b5f63fb8fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:35.551891 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bbf8d-6fc2-4497-bf45-3b5f63fb8fa8 None admin] PATH_INFO: `/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:35.553760 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10bbf8d-6fc2-4497-bf45-3b5f63fb8fa8 None admin] RBAC: Authorizing `identity:get_project(project_id=ecc1689f0ba04f14ac9c0d53a2a4a32d)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:35.555816 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10bbf8d-6fc2-4497-bf45-3b5f63fb8fa8 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:35.556851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 47/91] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:45:35 2022] GET /identity/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:35.557769 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10bbf8d-6fc2-4497-bf45-3b5f63fb8fa8 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:35.606938 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c2e29-134f-480e-b6a5-07364dc8b109 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:35.608613 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:35.651921 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cfa23d-97d3-4eee-85f5-ee11552610ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:35.652538 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cfa23d-97d3-4eee-85f5-ee11552610ba None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:35.652872 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cfa23d-97d3-4eee-85f5-ee11552610ba None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:35.653633 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cfa23d-97d3-4eee-85f5-ee11552610ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:35.681470 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10bbf8d-6fc2-4497-bf45-3b5f63fb8fa8 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:35.692155 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:35.734551 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275bd8a-a642-4544-9679-649769d7bff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:35.735715 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275bd8a-a642-4544-9679-649769d7bff6 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:35.736887 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275bd8a-a642-4544-9679-649769d7bff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:35.737368 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275bd8a-a642-4544-9679-649769d7bff6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:35.738556 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cfa23d-97d3-4eee-85f5-ee11552610ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:35.738819 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f275bd8a-a642-4544-9679-649769d7bff6 None admin] RBAC: Adding query filter params (role.id=a82e6f447c1b4b56b530dacfae06dee1, scope.project.id=ecc1689f0ba04f14ac9c0d53a2a4a32d, user.id=a3d5c3129b0d4c998a2a04444d03e300) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:35.739335 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f275bd8a-a642-4544-9679-649769d7bff6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:35.740259 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cfa23d-97d3-4eee-85f5-ee11552610ba None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:35.741608 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f275bd8a-a642-4544-9679-649769d7bff6 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:35.755687 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 48/92] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:45:35 2022] GET /identity/v3/role_assignments?user.id=a3d5c3129b0d4c998a2a04444d03e300&scope.project.id=ecc1689f0ba04f14ac9c0d53a2a4a32d&role.id=a82e6f447c1b4b56b530dacfae06dee1 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:35.756915 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275bd8a-a642-4544-9679-649769d7bff6 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:35.922864 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275bd8a-a642-4544-9679-649769d7bff6 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:35.925910 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:35.943868 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 45/93] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:45:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 15:45:35.946674 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cfa23d-97d3-4eee-85f5-ee11552610ba None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:35.968456 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8583c2-f518-451e-be84-d08c8090a711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:35.969127 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8583c2-f518-451e-be84-d08c8090a711 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:35.969409 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8583c2-f518-451e-be84-d08c8090a711 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:35.969683 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8583c2-f518-451e-be84-d08c8090a711 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:35.970429 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8583c2-f518-451e-be84-d08c8090a711 None admin] RBAC: Adding query filter params (role.id=3e70c1b76757442a9bddbeab151c6fc6, scope.project.id=ecc1689f0ba04f14ac9c0d53a2a4a32d, user.id=a3d5c3129b0d4c998a2a04444d03e300) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:35.976833 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8583c2-f518-451e-be84-d08c8090a711 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:35.976833 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8583c2-f518-451e-be84-d08c8090a711 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:35.978157 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 49/94] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:45:35 2022] GET /identity/v3/role_assignments?user.id=a3d5c3129b0d4c998a2a04444d03e300&scope.project.id=ecc1689f0ba04f14ac9c0d53a2a4a32d&role.id=3e70c1b76757442a9bddbeab151c6fc6 => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:35.978771 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8583c2-f518-451e-be84-d08c8090a711 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:36.069449 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:36.151203 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cfa23d-97d3-4eee-85f5-ee11552610ba None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:36.224996 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833baf1e-4ccf-4132-bdbc-d223fecec4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:36.226604 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833baf1e-4ccf-4132-bdbc-d223fecec4f2 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:36.226883 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833baf1e-4ccf-4132-bdbc-d223fecec4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:36.227152 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833baf1e-4ccf-4132-bdbc-d223fecec4f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:36.228484 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833baf1e-4ccf-4132-bdbc-d223fecec4f2 None admin] RBAC: Adding query filter params (role.id=676938e69210499ca11ee75dd572d0dc, scope.project.id=ecc1689f0ba04f14ac9c0d53a2a4a32d, user.id=a8dbd7798b3b4a6f882f197a7c25237a) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:36.228807 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833baf1e-4ccf-4132-bdbc-d223fecec4f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:36.230484 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833baf1e-4ccf-4132-bdbc-d223fecec4f2 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:36.234420 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8583c2-f518-451e-be84-d08c8090a711 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:36.244771 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 46/95] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:45:35 2022] GET /identity/v3/role_assignments?user.id=a8dbd7798b3b4a6f882f197a7c25237a&scope.project.id=ecc1689f0ba04f14ac9c0d53a2a4a32d&role.id=676938e69210499ca11ee75dd572d0dc => generated 259 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:36.275399 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d147e2-fd25-4cf7-923a-4cfb46939f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:36.276057 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d147e2-fd25-4cf7-923a-4cfb46939f14 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:36.276339 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d147e2-fd25-4cf7-923a-4cfb46939f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:36.276612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d147e2-fd25-4cf7-923a-4cfb46939f14 None admin] PATH_INFO: `/v3/projects/825ed9fd00bd44688313bc6a65096bce` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:36.277849 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d147e2-fd25-4cf7-923a-4cfb46939f14 None admin] RBAC: Authorizing `identity:get_project(project_id=825ed9fd00bd44688313bc6a65096bce)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:36.279306 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d147e2-fd25-4cf7-923a-4cfb46939f14 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:36.281585 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 50/96] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:45:35 2022] GET /identity/v3/projects/825ed9fd00bd44688313bc6a65096bce => generated 312 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:36.287354 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833baf1e-4ccf-4132-bdbc-d223fecec4f2 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:36.423986 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833baf1e-4ccf-4132-bdbc-d223fecec4f2 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:36.454349 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:36.461681 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a866b-2662-4fc7-a4e3-4bffe0da22c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:36.462320 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a866b-2662-4fc7-a4e3-4bffe0da22c2 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:36.462601 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a866b-2662-4fc7-a4e3-4bffe0da22c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:36.462879 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a866b-2662-4fc7-a4e3-4bffe0da22c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:36.463623 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a866b-2662-4fc7-a4e3-4bffe0da22c2 None admin] RBAC: Adding query filter params (role.id=a82e6f447c1b4b56b530dacfae06dee1, scope.project.id=825ed9fd00bd44688313bc6a65096bce, user.id=a3d5c3129b0d4c998a2a04444d03e300) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:36.463932 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a866b-2662-4fc7-a4e3-4bffe0da22c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:36.465468 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a866b-2662-4fc7-a4e3-4bffe0da22c2 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:36.473124 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 47/97] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:45:36 2022] GET /identity/v3/role_assignments?user.id=a3d5c3129b0d4c998a2a04444d03e300&scope.project.id=825ed9fd00bd44688313bc6a65096bce&role.id=a82e6f447c1b4b56b530dacfae06dee1 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:37.977884 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb073d-43ac-434e-9657-c67d8f3402b0 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:37.978359 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb073d-43ac-434e-9657-c67d8f3402b0 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:37.978359 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb073d-43ac-434e-9657-c67d8f3402b0 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:37.979896 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 51/98] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:45:37.990255 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a811c-5ca5-4d95-ad26-b4f5d67b1205 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:37.990687 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a811c-5ca5-4d95-ad26-b4f5d67b1205 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:37.990863 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a811c-5ca5-4d95-ad26-b4f5d67b1205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:38.016229 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-9b2a811c-5ca5-4d95-ad26-b4f5d67b1205 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:38.017477 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-9b2a811c-5ca5-4d95-ad26-b4f5d67b1205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:45:38.057953 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913bae1-488f-49d1-b863-5f098870838f None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:38.058249 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913bae1-488f-49d1-b863-5f098870838f None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:38.060552 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913bae1-488f-49d1-b863-5f098870838f None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:38.062689 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 52/99] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 15:45:38.067798 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1373a-446e-4d9a-a8b6-26ffb65f2dbd None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:38.068100 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1373a-446e-4d9a-a8b6-26ffb65f2dbd None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:38.068352 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1373a-446e-4d9a-a8b6-26ffb65f2dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:38.108246 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-36e1373a-446e-4d9a-a8b6-26ffb65f2dbd None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:38.109495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-36e1373a-446e-4d9a-a8b6-26ffb65f2dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:45:38.173490 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 48/100] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:45:38.177524 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:38.222105 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 53/101] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 15:45:38.620826 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a811c-5ca5-4d95-ad26-b4f5d67b1205 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:38.758858 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a811c-5ca5-4d95-ad26-b4f5d67b1205 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:38.784038 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:38.795819 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2990c121-4b75-43aa-b7e3-18fa5da390fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:38.797049 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990c121-4b75-43aa-b7e3-18fa5da390fe None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:38.797329 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990c121-4b75-43aa-b7e3-18fa5da390fe None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:38.797611 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990c121-4b75-43aa-b7e3-18fa5da390fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:38.798756 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2990c121-4b75-43aa-b7e3-18fa5da390fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:38.800617 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2990c121-4b75-43aa-b7e3-18fa5da390fe None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:38.802428 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 49/102] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:45:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:38.807930 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1373a-446e-4d9a-a8b6-26ffb65f2dbd None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:38.833553 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2990c121-4b75-43aa-b7e3-18fa5da390fe None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:38.957849 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2990c121-4b75-43aa-b7e3-18fa5da390fe None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:38.994460 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e3f4b-9bbf-4563-afa4-b730e33576ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:38.995215 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e3f4b-9bbf-4563-afa4-b730e33576ec None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:38.995395 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e3f4b-9bbf-4563-afa4-b730e33576ec None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:38.995649 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e3f4b-9bbf-4563-afa4-b730e33576ec None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:39.006867 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e3f4b-9bbf-4563-afa4-b730e33576ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:45:39.012303 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-5b0e3f4b-9bbf-4563-afa4-b730e33576ec None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 15:45:39.012303 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:45:39.012303 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:45:39.012303 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:45:39.012303 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:45:39.012303 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:45:39.012303 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:45:39.012303 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:45:39.012303 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:45:39.012303 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:45:39.012303 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:45:39.012303 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:45:39.012303 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:45:39.012303 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:45:39.012303 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:45:39.012303 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:45:39.013176 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:45:39.013176 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:45:39.013176 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:45:39.013176 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:45:39.013176 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:45:39.013176 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:45:39.013176 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:45:39.013176 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:45:39.013176 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:45:39.013176 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:45:39.013176 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:45:39.013176 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:45:39.013176 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:45:39.013176 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:45:39.013176 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:45:39.013176 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:45:39.014228 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:45:39.014228 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:45:39.014228 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:45:39.014228 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:45:39.014228 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:45:39.014228 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:45:39.014228 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:45:39.014228 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:45:39.014228 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:45:39.014228 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:45:39.014228 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 15:45:39.014228 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:45:39.014228 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 50/103] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:45:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 15:45:39.016814 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34eddb-74dc-426c-b72c-f775039bc565 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:39.016814 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34eddb-74dc-426c-b72c-f775039bc565 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:39.016814 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34eddb-74dc-426c-b72c-f775039bc565 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:39.018357 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 51/104] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:45:39.021153 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34eddb-74dc-426c-b72c-f775039bc565 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:39.058854 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1373a-446e-4d9a-a8b6-26ffb65f2dbd None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:39.089178 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:39.097374 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c2b71-e05c-492e-bdf5-873ae1fd092b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:39.098004 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c2b71-e05c-492e-bdf5-873ae1fd092b None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:39.098386 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c2b71-e05c-492e-bdf5-873ae1fd092b None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:39.098668 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c2b71-e05c-492e-bdf5-873ae1fd092b None admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:39.099343 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588c2b71-e05c-492e-bdf5-873ae1fd092b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:39.101033 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588c2b71-e05c-492e-bdf5-873ae1fd092b None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:39.136242 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 54/105] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Aug 30 15:45:38 2022] POST /identity/v3/projects => generated 302 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:45:39.139278 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e8534-9072-4c73-9ada-79ee78c39dd6 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:39.139667 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e8534-9072-4c73-9ada-79ee78c39dd6 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:39.140263 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e8534-9072-4c73-9ada-79ee78c39dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:39.158652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34eddb-74dc-426c-b72c-f775039bc565 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:39.161965 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-e88e8534-9072-4c73-9ada-79ee78c39dd6 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:39.163196 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-e88e8534-9072-4c73-9ada-79ee78c39dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:45:39.185235 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:39.239931 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99bcf1-2449-4f9b-bdd4-9e1c310abc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:39.241039 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99bcf1-2449-4f9b-bdd4-9e1c310abc6b None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:39.241757 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99bcf1-2449-4f9b-bdd4-9e1c310abc6b None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:39.242042 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99bcf1-2449-4f9b-bdd4-9e1c310abc6b None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:39.244390 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99bcf1-2449-4f9b-bdd4-9e1c310abc6b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:39.244727 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99bcf1-2449-4f9b-bdd4-9e1c310abc6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:39.247128 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99bcf1-2449-4f9b-bdd4-9e1c310abc6b None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:39.267650 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 52/106] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 30 15:45:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:45:39.270590 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522791dc-43a9-496a-95f8-8dc94f9cfb06 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:39.270879 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522791dc-43a9-496a-95f8-8dc94f9cfb06 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:39.272244 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522791dc-43a9-496a-95f8-8dc94f9cfb06 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:39.273815 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 53/107] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:45:39.275927 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522791dc-43a9-496a-95f8-8dc94f9cfb06 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:39.295771 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 55/108] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:45:39.302109 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa625734-e6f0-430d-97e0-7650e4f09c31 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:39.302387 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa625734-e6f0-430d-97e0-7650e4f09c31 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:39.302654 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa625734-e6f0-430d-97e0-7650e4f09c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:39.342770 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-fa625734-e6f0-430d-97e0-7650e4f09c31 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:39.344105 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-fa625734-e6f0-430d-97e0-7650e4f09c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:45:39.400372 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522791dc-43a9-496a-95f8-8dc94f9cfb06 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:39.417402 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:39.439663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 56/109] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:45:39.441240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7dc9c-2b4a-4f26-bed4-df9726a151d0 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:39.441546 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7dc9c-2b4a-4f26-bed4-df9726a151d0 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:39.441814 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a436f-00e6-410c-9d47-d65a0b4725f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:39.442004 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7dc9c-2b4a-4f26-bed4-df9726a151d0 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:39.442458 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a436f-00e6-410c-9d47-d65a0b4725f5 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:39.442742 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a436f-00e6-410c-9d47-d65a0b4725f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:39.443020 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a436f-00e6-410c-9d47-d65a0b4725f5 None admin] PATH_INFO: `/v3/users/5612016f58c348f19c007373e8ea5f5e` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:39.443421 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 57/110] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:45:39.450315 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32116d4-da8a-4721-aeb3-2d63c987c1ec None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:39.450607 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32116d4-da8a-4721-aeb3-2d63c987c1ec None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:39.450895 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32116d4-da8a-4721-aeb3-2d63c987c1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:39.466296 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a436f-00e6-410c-9d47-d65a0b4725f5 None admin] RBAC: Authorizing `identity:get_user(user_id=5612016f58c348f19c007373e8ea5f5e)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:39.468917 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a436f-00e6-410c-9d47-d65a0b4725f5 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:39.470901 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 54/111] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:45:39 2022] GET /identity/v3/users/5612016f58c348f19c007373e8ea5f5e => generated 289 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:39.475574 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-c32116d4-da8a-4721-aeb3-2d63c987c1ec None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:39.476768 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c32116d4-da8a-4721-aeb3-2d63c987c1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:45:39.478578 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a436f-00e6-410c-9d47-d65a0b4725f5 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:39.575494 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 58/112] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:45:39.577366 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ab436-f18f-4ab7-8bcb-3aed37387ecb None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:39.577689 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ab436-f18f-4ab7-8bcb-3aed37387ecb None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:39.577963 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ab436-f18f-4ab7-8bcb-3aed37387ecb None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:39.580029 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 59/113] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:45:39.585629 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c7b59-0dd3-4429-ab47-4f00d7e7a166 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:39.585938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c7b59-0dd3-4429-ab47-4f00d7e7a166 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:39.586223 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c7b59-0dd3-4429-ab47-4f00d7e7a166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:39.608059 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-4d2c7b59-0dd3-4429-ab47-4f00d7e7a166 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:39.609523 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-4d2c7b59-0dd3-4429-ab47-4f00d7e7a166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:45:39.611711 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:39.625497 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a436f-00e6-410c-9d47-d65a0b4725f5 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:39.662731 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7a568-9a65-49f3-9b32-b7e973f39d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:39.663706 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7a568-9a65-49f3-9b32-b7e973f39d5f None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:39.664192 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7a568-9a65-49f3-9b32-b7e973f39d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:39.664666 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7a568-9a65-49f3-9b32-b7e973f39d5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:39.689936 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 60/114] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 15:45:39.690905 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c7b59-0dd3-4429-ab47-4f00d7e7a166 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:39.709026 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:39.738477 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e7a568-9a65-49f3-9b32-b7e973f39d5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:39.740107 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e7a568-9a65-49f3-9b32-b7e973f39d5f None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:39.847321 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 55/115] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:45:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 15:45:39.852852 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7a568-9a65-49f3-9b32-b7e973f39d5f None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:39.946783 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:39.958813 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c7b59-0dd3-4429-ab47-4f00d7e7a166 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:39.965355 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7a568-9a65-49f3-9b32-b7e973f39d5f None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:39.995249 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6b2ea-56af-4757-90e7-bf2e880714db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:39.996129 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6b2ea-56af-4757-90e7-bf2e880714db None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:39.996581 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6b2ea-56af-4757-90e7-bf2e880714db None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:39.997026 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6b2ea-56af-4757-90e7-bf2e880714db None admin] PATH_INFO: `/v3/roles/member` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:40.005551 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280c6b8-2573-47b8-85aa-260b9c71dd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:40.006049 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:40.006193 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280c6b8-2573-47b8-85aa-260b9c71dd9c None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:40.006718 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280c6b8-2573-47b8-85aa-260b9c71dd9c None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:40.006953 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280c6b8-2573-47b8-85aa-260b9c71dd9c None admin] PATH_INFO: `/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:40.008292 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280c6b8-2573-47b8-85aa-260b9c71dd9c None admin] RBAC: Authorizing `identity:get_project(project_id=ecc1689f0ba04f14ac9c0d53a2a4a32d)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:40.009790 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280c6b8-2573-47b8-85aa-260b9c71dd9c None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:40.010179 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6b2ea-56af-4757-90e7-bf2e880714db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:45:40.011442 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 56/116] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:45:39 2022] GET /identity/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:45:40.012207 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280c6b8-2573-47b8-85aa-260b9c71dd9c None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:40.015648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-d5f6b2ea-56af-4757-90e7-bf2e880714db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 15:45:40.015648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:45:40.015648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:45:40.015648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:45:40.015648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:45:40.015648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:45:40.015648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:45:40.015648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:45:40.015648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:45:40.015648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:45:40.015648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:45:40.015648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:45:40.015648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:45:40.015648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:45:40.015648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:45:40.015648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:45:40.016467 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:45:40.016467 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:45:40.016467 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:45:40.016467 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:45:40.016467 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:45:40.016467 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:45:40.016467 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:45:40.016467 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:45:40.016467 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:45:40.016467 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:45:40.016467 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:45:40.016467 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:45:40.016467 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:45:40.016467 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:45:40.016467 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:45:40.016467 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:45:40.017248 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:45:40.017248 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:45:40.017248 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:45:40.017248 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:45:40.017248 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:45:40.017248 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:45:40.017248 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:45:40.017248 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:45:40.017248 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:45:40.017248 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:45:40.017248 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 15:45:40.017248 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:45:40.017248 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 61/117] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:45:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:45:40.019470 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6b2ea-56af-4757-90e7-bf2e880714db None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:40.128848 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6b2ea-56af-4757-90e7-bf2e880714db None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:40.133966 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280c6b8-2573-47b8-85aa-260b9c71dd9c None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:40.165010 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcccf551-f13c-4320-8e8a-f4784d5781b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:40.165653 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccf551-f13c-4320-8e8a-f4784d5781b6 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:40.165940 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccf551-f13c-4320-8e8a-f4784d5781b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:40.166217 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccf551-f13c-4320-8e8a-f4784d5781b6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:40.169818 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31eff9-3b06-46d9-a9c7-2040110cf2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:40.170975 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31eff9-3b06-46d9-a9c7-2040110cf2df None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:40.171345 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31eff9-3b06-46d9-a9c7-2040110cf2df None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:40.171629 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31eff9-3b06-46d9-a9c7-2040110cf2df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:40.177271 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcccf551-f13c-4320-8e8a-f4784d5781b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:45:40.179485 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:40.183018 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-bcccf551-f13c-4320-8e8a-f4784d5781b6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 15:45:40.183018 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:45:40.183018 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:45:40.183018 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:45:40.183018 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:45:40.183018 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:45:40.183018 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:45:40.183018 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:45:40.183018 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:45:40.183018 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:45:40.183018 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:45:40.183018 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:45:40.183018 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:45:40.183018 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:45:40.183018 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:45:40.183018 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:45:40.183829 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:45:40.183829 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:45:40.183829 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:45:40.183829 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:45:40.183829 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:45:40.183829 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:45:40.183829 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:45:40.183829 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:45:40.183829 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:45:40.183829 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:45:40.183829 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:45:40.183829 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:45:40.183829 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:45:40.183829 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:45:40.183829 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:45:40.183829 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:45:40.184545 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:45:40.184545 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:45:40.184545 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:45:40.184545 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:45:40.184545 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:45:40.184545 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:45:40.184545 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:45:40.184545 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:45:40.184545 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:45:40.184545 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:45:40.184545 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 15:45:40.184545 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:45:40.185199 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31eff9-3b06-46d9-a9c7-2040110cf2df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:45:40.185275 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 62/118] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Aug 30 15:45:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:45:40.185275 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcccf551-f13c-4320-8e8a-f4784d5781b6 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:40.194232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-2c31eff9-3b06-46d9-a9c7-2040110cf2df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:45:40.194232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:45:40.194232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:45:40.194232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:45:40.194232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:45:40.194232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:45:40.194232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:45:40.194232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:45:40.194232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:45:40.194232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:45:40.194232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:45:40.194232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:45:40.194232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:45:40.194232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:45:40.194232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:45:40.194232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:45:40.195107 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:45:40.195107 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:45:40.195107 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:45:40.195107 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:45:40.195107 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:45:40.195107 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:45:40.195107 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:45:40.195107 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:45:40.195107 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:45:40.195107 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:45:40.195107 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:45:40.195107 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:45:40.195107 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:45:40.195107 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:45:40.195107 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:45:40.195107 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:45:40.195835 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:45:40.195835 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:45:40.195835 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:45:40.195835 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:45:40.195835 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:45:40.195835 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:45:40.195835 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:45:40.195835 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:45:40.195835 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:45:40.195835 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:45:40.195835 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:45:40.195835 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:45:40.195835 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 57/119] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 30 15:45:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:45:40.196433 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31eff9-3b06-46d9-a9c7-2040110cf2df None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:40.254451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:40.299619 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31eff9-3b06-46d9-a9c7-2040110cf2df None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:40.301545 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcccf551-f13c-4320-8e8a-f4784d5781b6 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:40.334916 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594624ca-a1a0-4c03-973f-f54f71bb9da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:40.335528 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594624ca-a1a0-4c03-973f-f54f71bb9da6 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:40.335808 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594624ca-a1a0-4c03-973f-f54f71bb9da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:40.336079 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594624ca-a1a0-4c03-973f-f54f71bb9da6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:40.336827 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594624ca-a1a0-4c03-973f-f54f71bb9da6 None admin] RBAC: Adding query filter params (role.id=1e3d7a32e093474f86d5673fedf09dc5, scope.project.id=ecc1689f0ba04f14ac9c0d53a2a4a32d, user.id=5612016f58c348f19c007373e8ea5f5e) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:40.337139 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594624ca-a1a0-4c03-973f-f54f71bb9da6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:40.337678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d146c8b-ae33-4afc-858d-5f30bd8ffc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:40.338317 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d146c8b-ae33-4afc-858d-5f30bd8ffc5f None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:40.338586 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594624ca-a1a0-4c03-973f-f54f71bb9da6 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:40.338676 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d146c8b-ae33-4afc-858d-5f30bd8ffc5f None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:40.338861 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d146c8b-ae33-4afc-858d-5f30bd8ffc5f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:40.344459 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 58/120] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:45:40 2022] GET /identity/v3/role_assignments?user.id=5612016f58c348f19c007373e8ea5f5e&scope.project.id=ecc1689f0ba04f14ac9c0d53a2a4a32d&role.id=1e3d7a32e093474f86d5673fedf09dc5 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:40.345362 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594624ca-a1a0-4c03-973f-f54f71bb9da6 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:40.351214 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d146c8b-ae33-4afc-858d-5f30bd8ffc5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:45:40.356857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-1d146c8b-ae33-4afc-858d-5f30bd8ffc5f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 15:45:40.356857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:45:40.356857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:45:40.356857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:45:40.356857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:45:40.356857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:45:40.356857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:45:40.356857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:45:40.356857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:45:40.356857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:45:40.356857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:45:40.356857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:45:40.356857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:45:40.356857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:45:40.356857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:45:40.356857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:45:40.358371 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:45:40.358371 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:45:40.358371 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:45:40.358371 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:45:40.358371 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:45:40.358371 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:45:40.358371 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:45:40.358371 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:45:40.358371 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:45:40.358371 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:45:40.358371 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:45:40.358371 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:45:40.358371 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:45:40.358371 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:45:40.358371 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:45:40.358371 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:45:40.359132 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:45:40.359132 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:45:40.359132 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:45:40.359132 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:45:40.359132 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:45:40.359132 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:45:40.359132 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:45:40.359132 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:45:40.359132 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:45:40.359132 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:45:40.359132 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 15:45:40.359132 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:45:40.361768 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 63/121] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:45:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:45:40.363012 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d146c8b-ae33-4afc-858d-5f30bd8ffc5f None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:40.436329 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:40.492275 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d146c8b-ae33-4afc-858d-5f30bd8ffc5f None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:40.496402 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594624ca-a1a0-4c03-973f-f54f71bb9da6 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:40.512247 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:40.534830 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a981d9-0c02-4370-8b57-375eef07bd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:40.536042 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a981d9-0c02-4370-8b57-375eef07bd9d None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:40.536639 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a981d9-0c02-4370-8b57-375eef07bd9d None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:40.537154 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a981d9-0c02-4370-8b57-375eef07bd9d None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:40.538173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a981d9-0c02-4370-8b57-375eef07bd9d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:40.538275 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb0003-a5fe-45e0-a9de-f95eb3fd5f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:40.538787 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a981d9-0c02-4370-8b57-375eef07bd9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:40.538900 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb0003-a5fe-45e0-a9de-f95eb3fd5f88 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:40.539155 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb0003-a5fe-45e0-a9de-f95eb3fd5f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:40.539428 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb0003-a5fe-45e0-a9de-f95eb3fd5f88 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:40.540104 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb0003-a5fe-45e0-a9de-f95eb3fd5f88 None admin] RBAC: Adding query filter params (name=member) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:40.540408 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb0003-a5fe-45e0-a9de-f95eb3fd5f88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:40.541423 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a981d9-0c02-4370-8b57-375eef07bd9d None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:40.541857 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb0003-a5fe-45e0-a9de-f95eb3fd5f88 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:40.551775 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 64/122] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:45:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:40.553062 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a981d9-0c02-4370-8b57-375eef07bd9d None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:40.556964 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 59/123] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 30 15:45:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:40.558727 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb0003-a5fe-45e0-a9de-f95eb3fd5f88 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:40.679939 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a981d9-0c02-4370-8b57-375eef07bd9d None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:40.684156 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb0003-a5fe-45e0-a9de-f95eb3fd5f88 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:40.715779 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35f6ff-2152-4edd-b870-b3b212428c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:40.716316 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35f6ff-2152-4edd-b870-b3b212428c35 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:40.716641 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35f6ff-2152-4edd-b870-b3b212428c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:40.717569 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35f6ff-2152-4edd-b870-b3b212428c35 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:40.718312 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a35f6ff-2152-4edd-b870-b3b212428c35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:40.718518 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a35f6ff-2152-4edd-b870-b3b212428c35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:40.719916 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a35f6ff-2152-4edd-b870-b3b212428c35 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:40.721417 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:40.730477 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 65/124] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:45:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:40.733576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35f6ff-2152-4edd-b870-b3b212428c35 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:40.739730 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c0463-be20-49ac-b8e0-78c5da99c3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:40.740366 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c0463-be20-49ac-b8e0-78c5da99c3be None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:40.740651 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c0463-be20-49ac-b8e0-78c5da99c3be None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:40.740962 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c0463-be20-49ac-b8e0-78c5da99c3be None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:40.741651 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c0463-be20-49ac-b8e0-78c5da99c3be None admin] RBAC: Adding query filter params (name=member) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:40.741959 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c0463-be20-49ac-b8e0-78c5da99c3be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:40.743377 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c0463-be20-49ac-b8e0-78c5da99c3be None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:40.756869 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 60/125] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 30 15:45:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:40.758232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c0463-be20-49ac-b8e0-78c5da99c3be None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:40.794663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:40.858835 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35f6ff-2152-4edd-b870-b3b212428c35 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:40.870600 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c0463-be20-49ac-b8e0-78c5da99c3be None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:40.896708 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582de8a4-fb84-444f-bcfc-09b92377cb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:40.897836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582de8a4-fb84-444f-bcfc-09b92377cb2f None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:40.898317 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582de8a4-fb84-444f-bcfc-09b92377cb2f None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:40.898787 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582de8a4-fb84-444f-bcfc-09b92377cb2f None admin] PATH_INFO: `/v3/users/a3d5c3129b0d4c998a2a04444d03e300` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:40.900125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582de8a4-fb84-444f-bcfc-09b92377cb2f None admin] RBAC: Authorizing `identity:get_user(user_id=a3d5c3129b0d4c998a2a04444d03e300)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:40.901845 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582de8a4-fb84-444f-bcfc-09b92377cb2f None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:40.903611 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 66/126] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:45:40 2022] GET /identity/v3/users/a3d5c3129b0d4c998a2a04444d03e300 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:40.909317 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582de8a4-fb84-444f-bcfc-09b92377cb2f None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:40.916156 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a705c-0f27-4c5c-bb7d-410394deb92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:40.916827 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a705c-0f27-4c5c-bb7d-410394deb92d None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:40.917249 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a705c-0f27-4c5c-bb7d-410394deb92d None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:40.917968 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a705c-0f27-4c5c-bb7d-410394deb92d None admin] PATH_INFO: `/v3/users/a3d5c3129b0d4c998a2a04444d03e300` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:40.919723 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a705c-0f27-4c5c-bb7d-410394deb92d None admin] RBAC: Authorizing `identity:get_user(user_id=a3d5c3129b0d4c998a2a04444d03e300)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:40.921791 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a705c-0f27-4c5c-bb7d-410394deb92d None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:40.923643 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 61/127] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:45:40 2022] GET /identity/v3/users/a3d5c3129b0d4c998a2a04444d03e300 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:40.924762 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a705c-0f27-4c5c-bb7d-410394deb92d None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:40.997265 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:41.021011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582de8a4-fb84-444f-bcfc-09b92377cb2f None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:41.032601 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:41.051366 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a705c-0f27-4c5c-bb7d-410394deb92d None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:41.067671 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3262fb9-18f2-43ce-90da-39aadc17fc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:41.068576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3262fb9-18f2-43ce-90da-39aadc17fc59 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:41.068897 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3262fb9-18f2-43ce-90da-39aadc17fc59 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:41.069647 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3262fb9-18f2-43ce-90da-39aadc17fc59 None admin] PATH_INFO: `/v3/users/a8dbd7798b3b4a6f882f197a7c25237a` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:41.071005 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3262fb9-18f2-43ce-90da-39aadc17fc59 None admin] RBAC: Authorizing `identity:get_user(user_id=a8dbd7798b3b4a6f882f197a7c25237a)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:41.073156 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3262fb9-18f2-43ce-90da-39aadc17fc59 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:41.074901 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 67/128] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:45:40 2022] GET /identity/v3/users/a8dbd7798b3b4a6f882f197a7c25237a => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:41.076046 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3262fb9-18f2-43ce-90da-39aadc17fc59 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:41.093802 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834fc766-3d58-44e6-9411-5350b73b3c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:41.094458 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fc766-3d58-44e6-9411-5350b73b3c1e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:41.094915 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fc766-3d58-44e6-9411-5350b73b3c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:41.095201 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fc766-3d58-44e6-9411-5350b73b3c1e None admin] PATH_INFO: `/v3/users/a3d5c3129b0d4c998a2a04444d03e300` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:41.097036 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834fc766-3d58-44e6-9411-5350b73b3c1e None admin] RBAC: Authorizing `identity:get_user(user_id=a3d5c3129b0d4c998a2a04444d03e300)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:41.098985 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834fc766-3d58-44e6-9411-5350b73b3c1e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:41.100589 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 62/129] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:45:40 2022] GET /identity/v3/users/a3d5c3129b0d4c998a2a04444d03e300 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:41.105480 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834fc766-3d58-44e6-9411-5350b73b3c1e None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:41.202711 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3262fb9-18f2-43ce-90da-39aadc17fc59 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:41.239448 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47d7e7-f264-4315-ab4e-7a0c6461f9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:41.240207 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47d7e7-f264-4315-ab4e-7a0c6461f9c6 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:41.240490 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47d7e7-f264-4315-ab4e-7a0c6461f9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:41.240768 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47d7e7-f264-4315-ab4e-7a0c6461f9c6 None admin] PATH_INFO: `/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:41.241956 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b47d7e7-f264-4315-ab4e-7a0c6461f9c6 None admin] RBAC: Authorizing `identity:get_project(project_id=ecc1689f0ba04f14ac9c0d53a2a4a32d)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:41.243718 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b47d7e7-f264-4315-ab4e-7a0c6461f9c6 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:41.245388 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 68/130] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:45:41 2022] GET /identity/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:41.246153 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47d7e7-f264-4315-ab4e-7a0c6461f9c6 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:41.246275 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834fc766-3d58-44e6-9411-5350b73b3c1e None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:41.277400 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:41.291395 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc2fe8-4434-4c13-9548-0a3da5c123a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:41.292041 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc2fe8-4434-4c13-9548-0a3da5c123a7 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:41.292322 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc2fe8-4434-4c13-9548-0a3da5c123a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:41.292596 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc2fe8-4434-4c13-9548-0a3da5c123a7 None admin] PATH_INFO: `/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:41.294281 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cc2fe8-4434-4c13-9548-0a3da5c123a7 None admin] RBAC: Authorizing `identity:get_project(project_id=ecc1689f0ba04f14ac9c0d53a2a4a32d)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:41.296360 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cc2fe8-4434-4c13-9548-0a3da5c123a7 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:41.298490 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 63/131] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:45:41 2022] GET /identity/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:41.299541 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc2fe8-4434-4c13-9548-0a3da5c123a7 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:41.308860 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:41.371496 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47d7e7-f264-4315-ab4e-7a0c6461f9c6 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:41.414217 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011828a1-5ad5-4c2e-baf1-b6cf39b51f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:41.415319 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011828a1-5ad5-4c2e-baf1-b6cf39b51f81 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:41.415608 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011828a1-5ad5-4c2e-baf1-b6cf39b51f81 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:41.416154 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011828a1-5ad5-4c2e-baf1-b6cf39b51f81 None admin] PATH_INFO: `/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:41.417477 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011828a1-5ad5-4c2e-baf1-b6cf39b51f81 None admin] RBAC: Authorizing `identity:get_project(project_id=ecc1689f0ba04f14ac9c0d53a2a4a32d)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:41.419503 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011828a1-5ad5-4c2e-baf1-b6cf39b51f81 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:41.421953 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 69/132] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:45:41 2022] GET /identity/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:41.423471 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011828a1-5ad5-4c2e-baf1-b6cf39b51f81 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:41.429490 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc2fe8-4434-4c13-9548-0a3da5c123a7 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:41.478088 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a6993-4e0f-47eb-96ab-c480b41f4401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:41.479362 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a6993-4e0f-47eb-96ab-c480b41f4401 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:41.479650 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a6993-4e0f-47eb-96ab-c480b41f4401 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:41.479929 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a6993-4e0f-47eb-96ab-c480b41f4401 None admin] PATH_INFO: `/v3/projects/825ed9fd00bd44688313bc6a65096bce` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:41.481562 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a6993-4e0f-47eb-96ab-c480b41f4401 None admin] RBAC: Authorizing `identity:get_project(project_id=825ed9fd00bd44688313bc6a65096bce)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:41.483650 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a6993-4e0f-47eb-96ab-c480b41f4401 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:41.488854 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 64/133] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:45:41 2022] GET /identity/v3/projects/825ed9fd00bd44688313bc6a65096bce => generated 312 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:41.489755 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a6993-4e0f-47eb-96ab-c480b41f4401 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:41.558360 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011828a1-5ad5-4c2e-baf1-b6cf39b51f81 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:41.566770 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:41.576073 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:41.607798 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1115d1-ceef-4d76-93cf-329a3a92f2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:41.608918 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1115d1-ceef-4d76-93cf-329a3a92f2c4 None admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:41.609203 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1115d1-ceef-4d76-93cf-329a3a92f2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:41.609479 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1115d1-ceef-4d76-93cf-329a3a92f2c4 None admin] PATH_INFO: `/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d/users/a3d5c3129b0d4c998a2a04444d03e300/roles/3e70c1b76757442a9bddbeab151c6fc6` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:41.612289 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1115d1-ceef-4d76-93cf-329a3a92f2c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=ecc1689f0ba04f14ac9c0d53a2a4a32d, user_id=a3d5c3129b0d4c998a2a04444d03e300, role_id=3e70c1b76757442a9bddbeab151c6fc6)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:41.613786 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1115d1-ceef-4d76-93cf-329a3a92f2c4 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:41.619338 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a6993-4e0f-47eb-96ab-c480b41f4401 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:41.629292 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 70/134] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 30 15:45:41 2022] PUT /identity/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d/users/a3d5c3129b0d4c998a2a04444d03e300/roles/3e70c1b76757442a9bddbeab151c6fc6 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:45:41.630062 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1115d1-ceef-4d76-93cf-329a3a92f2c4 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:41.686855 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1482c-3b69-4055-b6ff-683094fe5bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:41.687541 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1482c-3b69-4055-b6ff-683094fe5bf6 None admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:41.687828 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1482c-3b69-4055-b6ff-683094fe5bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:41.688100 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1482c-3b69-4055-b6ff-683094fe5bf6 None admin] PATH_INFO: `/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d/users/a3d5c3129b0d4c998a2a04444d03e300/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:41.690879 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1482c-3b69-4055-b6ff-683094fe5bf6 None admin] RBAC: Authorizing `identity:create_grant(project_id=ecc1689f0ba04f14ac9c0d53a2a4a32d, user_id=a3d5c3129b0d4c998a2a04444d03e300, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:41.692687 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1482c-3b69-4055-b6ff-683094fe5bf6 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:41.724997 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 65/135] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 30 15:45:41 2022] PUT /identity/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d/users/a3d5c3129b0d4c998a2a04444d03e300/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:45:41.724997 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1482c-3b69-4055-b6ff-683094fe5bf6 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:41.819248 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1115d1-ceef-4d76-93cf-329a3a92f2c4 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:41.886870 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479eb39-f6b0-424a-b3bf-af3210af0356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:41.887923 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479eb39-f6b0-424a-b3bf-af3210af0356 None admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:41.888391 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479eb39-f6b0-424a-b3bf-af3210af0356 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:41.889438 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479eb39-f6b0-424a-b3bf-af3210af0356 None admin] PATH_INFO: `/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d/users/a8dbd7798b3b4a6f882f197a7c25237a/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:41.891744 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f479eb39-f6b0-424a-b3bf-af3210af0356 None admin] RBAC: Authorizing `identity:create_grant(project_id=ecc1689f0ba04f14ac9c0d53a2a4a32d, user_id=a8dbd7798b3b4a6f882f197a7c25237a, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:41.899893 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1482c-3b69-4055-b6ff-683094fe5bf6 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:41.901268 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f479eb39-f6b0-424a-b3bf-af3210af0356 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:41.916841 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:41.933882 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759965e-9aad-4fe7-b452-d33cdb918975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:41.934929 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759965e-9aad-4fe7-b452-d33cdb918975 None admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:41.935256 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759965e-9aad-4fe7-b452-d33cdb918975 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:41.935539 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759965e-9aad-4fe7-b452-d33cdb918975 None admin] PATH_INFO: `/v3/projects/825ed9fd00bd44688313bc6a65096bce/users/a3d5c3129b0d4c998a2a04444d03e300/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:41.936712 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 71/136] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 30 15:45:41 2022] PUT /identity/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d/users/a8dbd7798b3b4a6f882f197a7c25237a/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:45:41.937989 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402142b-4c29-49a3-843f-c11d3a7439ae None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:41.938281 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402142b-4c29-49a3-843f-c11d3a7439ae None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:41.938562 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402142b-4c29-49a3-843f-c11d3a7439ae None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:41.938655 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759965e-9aad-4fe7-b452-d33cdb918975 None admin] RBAC: Authorizing `identity:create_grant(project_id=825ed9fd00bd44688313bc6a65096bce, user_id=a3d5c3129b0d4c998a2a04444d03e300, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:41.939969 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 72/137] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:45:41.940223 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759965e-9aad-4fe7-b452-d33cdb918975 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:41.946319 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0bcfc-fa5c-4d3c-b954-5740d6337380 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:41.946803 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0bcfc-fa5c-4d3c-b954-5740d6337380 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:41.946914 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0bcfc-fa5c-4d3c-b954-5740d6337380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:41.960814 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 66/138] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 30 15:45:41 2022] PUT /identity/v3/projects/825ed9fd00bd44688313bc6a65096bce/users/a3d5c3129b0d4c998a2a04444d03e300/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:45:41.980575 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-1db0bcfc-fa5c-4d3c-b954-5740d6337380 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:41.982427 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-1db0bcfc-fa5c-4d3c-b954-5740d6337380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:45:42.042382 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:42.106997 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 73/139] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:45:42.403322 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d64a5-9e51-4ede-945d-3ecfc2d7d857 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:42.403793 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d64a5-9e51-4ede-945d-3ecfc2d7d857 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:42.403793 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d64a5-9e51-4ede-945d-3ecfc2d7d857 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:42.405557 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 67/140] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:45:42.410672 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bbacc-e82e-4d55-aa7d-67877b871e6c None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:42.411090 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bbacc-e82e-4d55-aa7d-67877b871e6c None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:42.411261 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bbacc-e82e-4d55-aa7d-67877b871e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:42.430851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-f96bbacc-e82e-4d55-aa7d-67877b871e6c None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:42.432049 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-f96bbacc-e82e-4d55-aa7d-67877b871e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:45:42.502771 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 74/141] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:45:42.628861 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d64a5-9e51-4ede-945d-3ecfc2d7d857 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:42.755097 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d64a5-9e51-4ede-945d-3ecfc2d7d857 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:42.802577 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959f03d-9d73-44c7-96be-43965ad044d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:42.803227 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959f03d-9d73-44c7-96be-43965ad044d2 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:42.803513 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959f03d-9d73-44c7-96be-43965ad044d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:42.803796 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959f03d-9d73-44c7-96be-43965ad044d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:42.809448 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0959f03d-9d73-44c7-96be-43965ad044d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:42.811445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0959f03d-9d73-44c7-96be-43965ad044d2 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:42.813498 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 68/142] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:45:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:42.819773 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96bbacc-e82e-4d55-aa7d-67877b871e6c None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:42.887263 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959f03d-9d73-44c7-96be-43965ad044d2 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:42.934373 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:42.942954 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96bbacc-e82e-4d55-aa7d-67877b871e6c None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:42.980513 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4b94f-548b-48f3-a675-c9fff358751b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:42.981153 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4b94f-548b-48f3-a675-c9fff358751b None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:42.981431 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4b94f-548b-48f3-a675-c9fff358751b None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:42.981755 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4b94f-548b-48f3-a675-c9fff358751b None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:42.982366 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a4b94f-548b-48f3-a675-c9fff358751b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:42.984842 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a4b94f-548b-48f3-a675-c9fff358751b None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:43.019986 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 75/143] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Aug 30 15:45:42 2022] POST /identity/v3/users => generated 283 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:45:43.020407 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:43.100557 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959f03d-9d73-44c7-96be-43965ad044d2 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:43.155699 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a44875-1eae-4a4b-8410-eee96d0608cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:43.156695 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a44875-1eae-4a4b-8410-eee96d0608cf None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:43.157173 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a44875-1eae-4a4b-8410-eee96d0608cf None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:43.157612 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a44875-1eae-4a4b-8410-eee96d0608cf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:43.178487 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a44875-1eae-4a4b-8410-eee96d0608cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:45:43.184105 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-10a44875-1eae-4a4b-8410-eee96d0608cf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 15:45:43.184105 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:45:43.184105 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:45:43.184105 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:45:43.184105 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:45:43.184105 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:45:43.184105 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:45:43.184105 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:45:43.184105 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:45:43.184105 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:45:43.184105 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:45:43.184105 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:45:43.184105 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:45:43.184105 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:45:43.184105 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:45:43.184105 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:45:43.184949 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:45:43.184949 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:45:43.184949 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:45:43.184949 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:45:43.184949 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:45:43.184949 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:45:43.184949 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:45:43.184949 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:45:43.184949 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:45:43.184949 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:45:43.184949 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:45:43.184949 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:45:43.184949 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:45:43.184949 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:45:43.184949 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:45:43.184949 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:45:43.186394 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:45:43.186394 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:45:43.186394 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:45:43.186394 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:45:43.186394 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:45:43.186394 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:45:43.186394 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:45:43.186394 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:45:43.186394 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:45:43.186394 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:45:43.186394 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 15:45:43.186394 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:45:43.188652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 69/144] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:45:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:45:43.197555 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4b94f-548b-48f3-a675-c9fff358751b None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:43.306589 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4b94f-548b-48f3-a675-c9fff358751b None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:43.346718 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd979c-9cb7-4369-9167-ccd2de042764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:43.347601 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd979c-9cb7-4369-9167-ccd2de042764 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:43.348020 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd979c-9cb7-4369-9167-ccd2de042764 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:43.348429 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd979c-9cb7-4369-9167-ccd2de042764 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:43.349273 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd979c-9cb7-4369-9167-ccd2de042764 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:43.349709 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd979c-9cb7-4369-9167-ccd2de042764 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:43.351241 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd979c-9cb7-4369-9167-ccd2de042764 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:43.362361 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 76/145] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 30 15:45:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:43.366648 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a44875-1eae-4a4b-8410-eee96d0608cf None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:43.486845 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a44875-1eae-4a4b-8410-eee96d0608cf None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:43.496883 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:43.527023 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63261079-3aee-49ea-a741-9961cc4500c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:43.527668 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63261079-3aee-49ea-a741-9961cc4500c3 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:43.527947 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63261079-3aee-49ea-a741-9961cc4500c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:43.528222 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63261079-3aee-49ea-a741-9961cc4500c3 None admin] PATH_INFO: `/v3/users/5612016f58c348f19c007373e8ea5f5e` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:43.529934 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63261079-3aee-49ea-a741-9961cc4500c3 None admin] RBAC: Authorizing `identity:get_user(user_id=5612016f58c348f19c007373e8ea5f5e)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:43.531464 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63261079-3aee-49ea-a741-9961cc4500c3 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:43.533077 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 70/146] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:45:43 2022] GET /identity/v3/users/5612016f58c348f19c007373e8ea5f5e => generated 289 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:45:43.538755 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd979c-9cb7-4369-9167-ccd2de042764 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:43.555434 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:43.646581 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd979c-9cb7-4369-9167-ccd2de042764 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:43.683578 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757179c3-bb92-42fb-9264-41e36b7029d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:43.684221 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757179c3-bb92-42fb-9264-41e36b7029d5 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:43.684500 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757179c3-bb92-42fb-9264-41e36b7029d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:43.684771 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757179c3-bb92-42fb-9264-41e36b7029d5 None admin] PATH_INFO: `/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:43.685983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757179c3-bb92-42fb-9264-41e36b7029d5 None admin] RBAC: Authorizing `identity:get_project(project_id=ecc1689f0ba04f14ac9c0d53a2a4a32d)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:43.687464 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757179c3-bb92-42fb-9264-41e36b7029d5 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:43.689196 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 77/147] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:45:43 2022] GET /identity/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:43.695048 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63261079-3aee-49ea-a741-9961cc4500c3 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:43.800084 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63261079-3aee-49ea-a741-9961cc4500c3 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:43.841050 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6fdc23-fcc2-425e-9823-96e793e07db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:43.841718 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6fdc23-fcc2-425e-9823-96e793e07db9 None admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:43.842674 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6fdc23-fcc2-425e-9823-96e793e07db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:43.842947 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6fdc23-fcc2-425e-9823-96e793e07db9 None admin] PATH_INFO: `/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d/users/5612016f58c348f19c007373e8ea5f5e/roles/1e3d7a32e093474f86d5673fedf09dc5` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:43.845094 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6fdc23-fcc2-425e-9823-96e793e07db9 None admin] RBAC: Authorizing `identity:create_grant(project_id=ecc1689f0ba04f14ac9c0d53a2a4a32d, user_id=5612016f58c348f19c007373e8ea5f5e, role_id=1e3d7a32e093474f86d5673fedf09dc5)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:43.846548 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6fdc23-fcc2-425e-9823-96e793e07db9 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:43.866048 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 71/148] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 30 15:45:43 2022] PUT /identity/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d/users/5612016f58c348f19c007373e8ea5f5e/roles/1e3d7a32e093474f86d5673fedf09dc5 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:45:44.393381 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e3ce5-6765-43af-9a65-29b0baf2c970 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:44.393742 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e3ce5-6765-43af-9a65-29b0baf2c970 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:44.393939 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e3ce5-6765-43af-9a65-29b0baf2c970 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:44.395431 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 78/149] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:45:44.400865 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580d16f-b66c-4747-8a5f-e8c52245a266 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:44.401161 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580d16f-b66c-4747-8a5f-e8c52245a266 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:44.401442 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580d16f-b66c-4747-8a5f-e8c52245a266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:44.428174 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-8580d16f-b66c-4747-8a5f-e8c52245a266 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:44.429514 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-8580d16f-b66c-4747-8a5f-e8c52245a266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:45:44.472096 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:44.525526 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 72/150] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:45:44.629126 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86d248-e222-4480-bbd5-ef38d681b735 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:44.629617 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86d248-e222-4480-bbd5-ef38d681b735 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:44.629689 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86d248-e222-4480-bbd5-ef38d681b735 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:44.631011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 79/151] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:45:44.638261 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677a93e-17d2-4242-8df9-b7cf331e8ca1 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:44.638550 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677a93e-17d2-4242-8df9-b7cf331e8ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:44.638863 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677a93e-17d2-4242-8df9-b7cf331e8ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:44.661898 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-1677a93e-17d2-4242-8df9-b7cf331e8ca1 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:44.663024 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-1677a93e-17d2-4242-8df9-b7cf331e8ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:45:44.743997 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 73/152] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:45:45.138024 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df86d248-e222-4480-bbd5-ef38d681b735 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:45.249757 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:45.282525 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df86d248-e222-4480-bbd5-ef38d681b735 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:45.304940 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677a93e-17d2-4242-8df9-b7cf331e8ca1 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:45.344969 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70f757-489e-4c66-9aa9-a61c4d772765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:45.345621 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70f757-489e-4c66-9aa9-a61c4d772765 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:45.345897 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70f757-489e-4c66-9aa9-a61c4d772765 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:45.346164 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70f757-489e-4c66-9aa9-a61c4d772765 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:45.360056 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d70f757-489e-4c66-9aa9-a61c4d772765 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:45:45.365426 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-6d70f757-489e-4c66-9aa9-a61c4d772765 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 15:45:45.365426 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:45:45.365426 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:45:45.365426 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:45:45.365426 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:45:45.365426 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:45:45.365426 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:45:45.365426 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:45:45.365426 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:45:45.365426 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:45:45.365426 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:45:45.365426 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:45:45.365426 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:45:45.365426 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:45:45.365426 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:45:45.365426 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:45:45.366257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:45:45.366257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:45:45.366257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:45:45.366257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:45:45.366257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:45:45.366257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:45:45.366257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:45:45.366257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:45:45.366257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:45:45.366257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:45:45.366257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:45:45.366257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:45:45.366257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:45:45.366257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:45:45.366257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:45:45.366257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:45:45.366999 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:45:45.366999 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:45:45.366999 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:45:45.366999 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:45:45.366999 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:45:45.366999 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:45:45.366999 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:45:45.366999 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:45:45.366999 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:45:45.366999 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:45:45.366999 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 15:45:45.366999 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:45:45.366999 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 80/153] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:45:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:45:45.368089 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f4e83-a85c-4cb4-9b17-f4ef8b60c403 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:45.368089 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f4e83-a85c-4cb4-9b17-f4ef8b60c403 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:45.368328 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f4e83-a85c-4cb4-9b17-f4ef8b60c403 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:45.370125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 81/154] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:45:45.379716 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586efe2e-1a6c-43c5-b6d3-ac7ebf1bc0f3 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:45.380131 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586efe2e-1a6c-43c5-b6d3-ac7ebf1bc0f3 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:45.380504 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586efe2e-1a6c-43c5-b6d3-ac7ebf1bc0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:45.400870 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-586efe2e-1a6c-43c5-b6d3-ac7ebf1bc0f3 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:45.402212 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-586efe2e-1a6c-43c5-b6d3-ac7ebf1bc0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:45:45.476848 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 82/155] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:45:45.477913 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586efe2e-1a6c-43c5-b6d3-ac7ebf1bc0f3 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:45.553143 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:45.573143 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:45.586538 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586efe2e-1a6c-43c5-b6d3-ac7ebf1bc0f3 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:45.598736 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677a93e-17d2-4242-8df9-b7cf331e8ca1 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:45.623976 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb05e5-752a-45e5-8028-cfa0a1911523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:45.624773 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb05e5-752a-45e5-8028-cfa0a1911523 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:45.625177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb05e5-752a-45e5-8028-cfa0a1911523 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:45.625554 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb05e5-752a-45e5-8028-cfa0a1911523 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:45.626668 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb05e5-752a-45e5-8028-cfa0a1911523 None admin] RBAC: Adding query filter params (name=member) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:45.627085 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb05e5-752a-45e5-8028-cfa0a1911523 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:45.628559 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb05e5-752a-45e5-8028-cfa0a1911523 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:45.637607 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 83/156] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 30 15:45:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:45.640413 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdd132-428d-4906-9cf7-fc223219a453 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:45.640766 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdd132-428d-4906-9cf7-fc223219a453 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:45.641142 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdd132-428d-4906-9cf7-fc223219a453 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:45.643269 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 84/157] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:45:45.645496 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcdd132-428d-4906-9cf7-fc223219a453 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:45.713655 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa73ee-ccd7-4c7f-8444-44d1e601f03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:45.714239 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa73ee-ccd7-4c7f-8444-44d1e601f03e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:45.714522 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa73ee-ccd7-4c7f-8444-44d1e601f03e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:45.714796 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa73ee-ccd7-4c7f-8444-44d1e601f03e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:45.777963 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa73ee-ccd7-4c7f-8444-44d1e601f03e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:45:45.778938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcdd132-428d-4906-9cf7-fc223219a453 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:45.783034 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-72fa73ee-ccd7-4c7f-8444-44d1e601f03e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:45:45.783034 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:45:45.783034 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:45:45.783034 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:45:45.783034 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:45:45.783034 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:45:45.783034 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:45:45.783034 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:45:45.783034 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:45:45.783034 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:45:45.783034 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:45:45.783034 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:45:45.783034 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:45:45.783034 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:45:45.783034 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:45:45.783034 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:45:45.784064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:45:45.784064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:45:45.784064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:45:45.784064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:45:45.784064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:45:45.784064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:45:45.784064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:45:45.784064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:45:45.784064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:45:45.784064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:45:45.784064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:45:45.784064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:45:45.784064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:45:45.784064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:45:45.784064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:45:45.784064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:45:45.784940 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:45:45.784940 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:45:45.784940 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:45:45.784940 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:45:45.784940 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:45:45.784940 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:45:45.784940 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:45:45.784940 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:45:45.784940 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:45:45.784940 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:45:45.784940 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:45:45.784940 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:45:45.792860 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 74/158] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 30 15:45:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 480 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:45:45.794201 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bb866-1403-4fd8-9275-1f14cd67e56a None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:45.794485 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bb866-1403-4fd8-9275-1f14cd67e56a None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:45.794759 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bb866-1403-4fd8-9275-1f14cd67e56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:45.817151 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:45.827742 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def30b14-8b58-440f-a4b6-3042f269d3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:45.828449 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def30b14-8b58-440f-a4b6-3042f269d3bb None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:45.828731 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def30b14-8b58-440f-a4b6-3042f269d3bb None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:45.829073 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def30b14-8b58-440f-a4b6-3042f269d3bb None admin] PATH_INFO: `/v3/users/a3d5c3129b0d4c998a2a04444d03e300` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:45.830184 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-668bb866-1403-4fd8-9275-1f14cd67e56a None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:45.831415 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-668bb866-1403-4fd8-9275-1f14cd67e56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:45:45.831524 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def30b14-8b58-440f-a4b6-3042f269d3bb None admin] RBAC: Authorizing `identity:get_user(user_id=a3d5c3129b0d4c998a2a04444d03e300)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:45.832990 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def30b14-8b58-440f-a4b6-3042f269d3bb None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:45.835681 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 85/159] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:45:45 2022] GET /identity/v3/users/a3d5c3129b0d4c998a2a04444d03e300 => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:45.836467 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def30b14-8b58-440f-a4b6-3042f269d3bb None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:45.959298 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 75/160] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:45:45.960307 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668bb866-1403-4fd8-9275-1f14cd67e56a None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:46.041042 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def30b14-8b58-440f-a4b6-3042f269d3bb None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:46.076799 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:46.096634 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668bb866-1403-4fd8-9275-1f14cd67e56a None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:46.120979 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573fcb46-dda6-464a-9bfc-20825163e326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:46.121974 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fcb46-dda6-464a-9bfc-20825163e326 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:46.122628 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fcb46-dda6-464a-9bfc-20825163e326 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:46.123227 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fcb46-dda6-464a-9bfc-20825163e326 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:46.124314 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573fcb46-dda6-464a-9bfc-20825163e326 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:46.124986 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573fcb46-dda6-464a-9bfc-20825163e326 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:46.126579 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573fcb46-dda6-464a-9bfc-20825163e326 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:46.142628 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 86/161] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:45:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:46.143973 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573fcb46-dda6-464a-9bfc-20825163e326 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:46.146824 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067a34c-7cb6-4fab-9265-3b074ffae104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:46.147767 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067a34c-7cb6-4fab-9265-3b074ffae104 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:46.147873 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067a34c-7cb6-4fab-9265-3b074ffae104 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:46.148134 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067a34c-7cb6-4fab-9265-3b074ffae104 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:46.216872 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4067a34c-7cb6-4fab-9265-3b074ffae104 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:46.218517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4067a34c-7cb6-4fab-9265-3b074ffae104 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:46.247296 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:46.304926 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:46.322019 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 76/162] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:45:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 15:45:46.323086 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067a34c-7cb6-4fab-9265-3b074ffae104 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:46.323605 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573fcb46-dda6-464a-9bfc-20825163e326 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:46.409466 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de229b1-1f74-45cb-86ac-990a462f7468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:46.410486 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de229b1-1f74-45cb-86ac-990a462f7468 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:46.410965 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de229b1-1f74-45cb-86ac-990a462f7468 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:46.411452 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de229b1-1f74-45cb-86ac-990a462f7468 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:46.425390 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067a34c-7cb6-4fab-9265-3b074ffae104 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:46.426144 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de229b1-1f74-45cb-86ac-990a462f7468 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:45:46.436676 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-3de229b1-1f74-45cb-86ac-990a462f7468 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 15:45:46.436676 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:45:46.436676 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:45:46.436676 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:45:46.436676 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:45:46.436676 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:45:46.436676 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:45:46.436676 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:45:46.436676 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:45:46.436676 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:45:46.436676 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:45:46.436676 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:45:46.436676 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:45:46.436676 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:45:46.436676 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:45:46.436676 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:45:46.437568 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:45:46.437568 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:45:46.437568 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:45:46.437568 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:45:46.437568 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:45:46.437568 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:45:46.437568 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:45:46.437568 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:45:46.437568 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:45:46.437568 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:45:46.437568 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:45:46.437568 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:45:46.437568 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:45:46.437568 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:45:46.437568 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:45:46.437568 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:45:46.438331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:45:46.438331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:45:46.438331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:45:46.438331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:45:46.438331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:45:46.438331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:45:46.438331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:45:46.438331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:45:46.438331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:45:46.438331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:45:46.438331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 15:45:46.438331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:45:46.440555 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 87/163] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Aug 30 15:45:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:45:46.441552 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de229b1-1f74-45cb-86ac-990a462f7468 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:46.470731 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e64aa7-16f5-4973-a1d8-11abcb2e9662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:46.471675 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e64aa7-16f5-4973-a1d8-11abcb2e9662 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:46.471963 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e64aa7-16f5-4973-a1d8-11abcb2e9662 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:46.472236 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e64aa7-16f5-4973-a1d8-11abcb2e9662 None admin] PATH_INFO: `/v3/users/a8dbd7798b3b4a6f882f197a7c25237a` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:46.474394 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e64aa7-16f5-4973-a1d8-11abcb2e9662 None admin] RBAC: Authorizing `identity:get_user(user_id=a8dbd7798b3b4a6f882f197a7c25237a)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:46.476262 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e64aa7-16f5-4973-a1d8-11abcb2e9662 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:46.478212 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 77/164] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:45:46 2022] GET /identity/v3/users/a8dbd7798b3b4a6f882f197a7c25237a => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:46.480063 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e64aa7-16f5-4973-a1d8-11abcb2e9662 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:46.557222 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:46.626031 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de229b1-1f74-45cb-86ac-990a462f7468 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:46.643305 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e64aa7-16f5-4973-a1d8-11abcb2e9662 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:46.653809 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:46.668881 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e61040-e3cb-499e-a499-3a98ebe46173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:46.669626 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e61040-e3cb-499e-a499-3a98ebe46173 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:46.670230 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e61040-e3cb-499e-a499-3a98ebe46173 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:46.670887 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e61040-e3cb-499e-a499-3a98ebe46173 None admin] PATH_INFO: `/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:46.672022 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e61040-e3cb-499e-a499-3a98ebe46173 None admin] RBAC: Authorizing `identity:get_project(project_id=ecc1689f0ba04f14ac9c0d53a2a4a32d)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:46.673798 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e61040-e3cb-499e-a499-3a98ebe46173 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:46.675988 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 88/165] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:45:46 2022] GET /identity/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:46.677172 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e61040-e3cb-499e-a499-3a98ebe46173 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:46.737554 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c4ab4-f2f2-479c-827f-025501702835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:46.738495 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c4ab4-f2f2-479c-827f-025501702835 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:46.738947 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c4ab4-f2f2-479c-827f-025501702835 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:46.739396 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c4ab4-f2f2-479c-827f-025501702835 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:46.740254 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c4ab4-f2f2-479c-827f-025501702835 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:46.740743 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c4ab4-f2f2-479c-827f-025501702835 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:46.742333 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c4ab4-f2f2-479c-827f-025501702835 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:46.759887 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 78/166] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:45:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:46.761016 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c4ab4-f2f2-479c-827f-025501702835 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:46.798051 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e61040-e3cb-499e-a499-3a98ebe46173 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:46.843034 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764308a-6920-4127-966f-2ccde789f679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:46.843646 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764308a-6920-4127-966f-2ccde789f679 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:46.843919 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764308a-6920-4127-966f-2ccde789f679 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:46.844186 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764308a-6920-4127-966f-2ccde789f679 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:46.913822 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:46.927634 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5764308a-6920-4127-966f-2ccde789f679 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:46.929116 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5764308a-6920-4127-966f-2ccde789f679 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:46.991975 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c4ab4-f2f2-479c-827f-025501702835 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:47.009653 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:47.052744 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 89/167] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:45:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 15:45:47.053496 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f1b50-6b3e-455e-ac77-1df8dc526869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:47.053718 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764308a-6920-4127-966f-2ccde789f679 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:47.054157 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f1b50-6b3e-455e-ac77-1df8dc526869 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:47.054443 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f1b50-6b3e-455e-ac77-1df8dc526869 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:47.054719 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f1b50-6b3e-455e-ac77-1df8dc526869 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:47.081282 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85f1b50-6b3e-455e-ac77-1df8dc526869 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:45:47.086837 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-a85f1b50-6b3e-455e-ac77-1df8dc526869 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 15:45:47.086837 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:45:47.086837 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:45:47.086837 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:45:47.086837 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:45:47.086837 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:45:47.086837 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:45:47.086837 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:45:47.086837 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:45:47.086837 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:45:47.086837 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:45:47.086837 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:45:47.086837 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:45:47.086837 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:45:47.086837 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:45:47.086837 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:45:47.087734 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:45:47.087734 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:45:47.087734 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:45:47.087734 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:45:47.087734 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:45:47.087734 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:45:47.087734 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:45:47.087734 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:45:47.087734 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:45:47.087734 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:45:47.087734 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:45:47.087734 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:45:47.087734 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:45:47.087734 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:45:47.087734 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:45:47.087734 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:45:47.088509 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:45:47.088509 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:45:47.088509 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:45:47.088509 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:45:47.088509 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:45:47.088509 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:45:47.088509 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:45:47.088509 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:45:47.088509 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:45:47.088509 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:45:47.088509 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 15:45:47.088509 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:45:47.088509 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 79/168] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:45:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:45:47.090079 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f1b50-6b3e-455e-ac77-1df8dc526869 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:47.158784 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:47.171071 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764308a-6920-4127-966f-2ccde789f679 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:47.210459 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046127a7-fc95-4c60-b03d-c268afa4dcfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:47.211070 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046127a7-fc95-4c60-b03d-c268afa4dcfc None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:47.211346 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046127a7-fc95-4c60-b03d-c268afa4dcfc None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:47.211616 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046127a7-fc95-4c60-b03d-c268afa4dcfc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:47.212351 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046127a7-fc95-4c60-b03d-c268afa4dcfc None admin] RBAC: Adding query filter params (role.id=a82e6f447c1b4b56b530dacfae06dee1, scope.project.id=ecc1689f0ba04f14ac9c0d53a2a4a32d, user.id=a3d5c3129b0d4c998a2a04444d03e300) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:47.212654 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046127a7-fc95-4c60-b03d-c268afa4dcfc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:47.214433 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046127a7-fc95-4c60-b03d-c268afa4dcfc None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:47.223160 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 90/169] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:45:47 2022] GET /identity/v3/role_assignments?user.id=a3d5c3129b0d4c998a2a04444d03e300&scope.project.id=ecc1689f0ba04f14ac9c0d53a2a4a32d&role.id=a82e6f447c1b4b56b530dacfae06dee1 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:47.223978 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046127a7-fc95-4c60-b03d-c268afa4dcfc None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:47.327543 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f1b50-6b3e-455e-ac77-1df8dc526869 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:47.345360 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046127a7-fc95-4c60-b03d-c268afa4dcfc None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:47.385952 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf550c3-f2bf-455f-8ab2-54b2e2ef5f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:47.386603 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf550c3-f2bf-455f-8ab2-54b2e2ef5f57 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:47.386880 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf550c3-f2bf-455f-8ab2-54b2e2ef5f57 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:47.387147 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf550c3-f2bf-455f-8ab2-54b2e2ef5f57 None admin] PATH_INFO: `/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:47.388335 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf550c3-f2bf-455f-8ab2-54b2e2ef5f57 None admin] RBAC: Authorizing `identity:get_project(project_id=ecc1689f0ba04f14ac9c0d53a2a4a32d)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:47.390327 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf550c3-f2bf-455f-8ab2-54b2e2ef5f57 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:47.392219 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 91/170] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:45:47 2022] GET /identity/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:47.393209 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf550c3-f2bf-455f-8ab2-54b2e2ef5f57 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:47.425353 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:47.443679 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa074bd-c290-4d2a-8e57-4912c128c73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:47.444657 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa074bd-c290-4d2a-8e57-4912c128c73b None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:47.445165 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa074bd-c290-4d2a-8e57-4912c128c73b None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:47.445599 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa074bd-c290-4d2a-8e57-4912c128c73b None admin] PATH_INFO: `/v3/users/a3d5c3129b0d4c998a2a04444d03e300` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:47.449349 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa074bd-c290-4d2a-8e57-4912c128c73b None admin] RBAC: Authorizing `identity:get_user(user_id=a3d5c3129b0d4c998a2a04444d03e300)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:47.451095 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa074bd-c290-4d2a-8e57-4912c128c73b None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:47.453617 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 80/171] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:45:47 2022] GET /identity/v3/users/a3d5c3129b0d4c998a2a04444d03e300 => generated 275 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:47.454626 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa074bd-c290-4d2a-8e57-4912c128c73b None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:47.512597 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf550c3-f2bf-455f-8ab2-54b2e2ef5f57 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:47.514572 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:47.561728 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e1109-81e8-4d1e-8cc3-50521364deda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:47.562506 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e1109-81e8-4d1e-8cc3-50521364deda None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:47.562787 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e1109-81e8-4d1e-8cc3-50521364deda None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:47.563054 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e1109-81e8-4d1e-8cc3-50521364deda None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:47.564765 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0e1109-81e8-4d1e-8cc3-50521364deda None admin] RBAC: Adding query filter params (name=member) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:47.564765 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0e1109-81e8-4d1e-8cc3-50521364deda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:47.565816 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0e1109-81e8-4d1e-8cc3-50521364deda None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:47.577117 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 92/172] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 30 15:45:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:47.578543 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e1109-81e8-4d1e-8cc3-50521364deda None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:47.583704 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa074bd-c290-4d2a-8e57-4912c128c73b None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:47.650275 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40131da0-07ef-4331-a664-760a034ea7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:47.650905 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40131da0-07ef-4331-a664-760a034ea7ce None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:47.651170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40131da0-07ef-4331-a664-760a034ea7ce None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:47.651447 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40131da0-07ef-4331-a664-760a034ea7ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:47.652194 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40131da0-07ef-4331-a664-760a034ea7ce None admin] RBAC: Adding query filter params (role.id=676938e69210499ca11ee75dd572d0dc, scope.project.id=ecc1689f0ba04f14ac9c0d53a2a4a32d, user.id=a8dbd7798b3b4a6f882f197a7c25237a) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:47.652504 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40131da0-07ef-4331-a664-760a034ea7ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:47.654016 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40131da0-07ef-4331-a664-760a034ea7ce None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:47.661931 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 81/173] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:45:47 2022] GET /identity/v3/role_assignments?user.id=a8dbd7798b3b4a6f882f197a7c25237a&scope.project.id=ecc1689f0ba04f14ac9c0d53a2a4a32d&role.id=676938e69210499ca11ee75dd572d0dc => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:47.666221 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0313b0-7f11-45f3-84f3-dc2533bf9bcc None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:47.666770 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0313b0-7f11-45f3-84f3-dc2533bf9bcc None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:47.667239 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0313b0-7f11-45f3-84f3-dc2533bf9bcc None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:47.668906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 82/174] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:45:47.671735 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d09989-69b3-454e-9332-2968989d98e0 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:47.673232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d09989-69b3-454e-9332-2968989d98e0 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:47.673928 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d09989-69b3-454e-9332-2968989d98e0 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:47.678043 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 83/175] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:45:47.682372 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d09989-69b3-454e-9332-2968989d98e0 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:47.709983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:47.755442 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e1109-81e8-4d1e-8cc3-50521364deda None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:47.826870 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84690fba-5be7-4b04-890e-f7f848dbf224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:47.827515 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84690fba-5be7-4b04-890e-f7f848dbf224 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:47.827794 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84690fba-5be7-4b04-890e-f7f848dbf224 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:47.828064 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84690fba-5be7-4b04-890e-f7f848dbf224 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:47.853806 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d09989-69b3-454e-9332-2968989d98e0 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:47.877430 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:47.910032 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4053a57-2985-4fe2-9548-878303e98c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:47.910946 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4053a57-2985-4fe2-9548-878303e98c11 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:47.911226 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4053a57-2985-4fe2-9548-878303e98c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:47.911500 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4053a57-2985-4fe2-9548-878303e98c11 None admin] PATH_INFO: `/v3/users/a3d5c3129b0d4c998a2a04444d03e300` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:47.913354 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4053a57-2985-4fe2-9548-878303e98c11 None admin] RBAC: Authorizing `identity:get_user(user_id=a3d5c3129b0d4c998a2a04444d03e300)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:47.915352 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4053a57-2985-4fe2-9548-878303e98c11 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:47.917931 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 84/176] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:45:47 2022] GET /identity/v3/users/a3d5c3129b0d4c998a2a04444d03e300 => generated 275 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:47.919084 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfd450-6885-49ca-a6e8-70d2c5aa6706 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:47.919611 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfd450-6885-49ca-a6e8-70d2c5aa6706 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:47.919914 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfd450-6885-49ca-a6e8-70d2c5aa6706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:47.929622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84690fba-5be7-4b04-890e-f7f848dbf224 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:47.931037 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84690fba-5be7-4b04-890e-f7f848dbf224 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:47.944027 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-e3cfd450-6885-49ca-a6e8-70d2c5aa6706 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:47.945511 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-e3cfd450-6885-49ca-a6e8-70d2c5aa6706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:45:48.035219 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 85/177] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:45:48.035973 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:48.037679 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67536d-22e9-4e74-a804-006c6f982f11 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:48.037963 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67536d-22e9-4e74-a804-006c6f982f11 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:48.038233 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67536d-22e9-4e74-a804-006c6f982f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:48.054932 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 93/178] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:45:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 15:45:48.055794 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84690fba-5be7-4b04-890e-f7f848dbf224 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:48.066835 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-1a67536d-22e9-4e74-a804-006c6f982f11 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:48.068205 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-1a67536d-22e9-4e74-a804-006c6f982f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:45:48.145556 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 86/179] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:45:48.146933 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4388e-ffe7-4a54-bb0e-2457e16191e1 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:48.147220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4388e-ffe7-4a54-bb0e-2457e16191e1 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:48.147494 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4388e-ffe7-4a54-bb0e-2457e16191e1 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:48.149722 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 87/180] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:45:48.150441 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a4388e-ffe7-4a54-bb0e-2457e16191e1 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:48.165424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84690fba-5be7-4b04-890e-f7f848dbf224 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:48.202830 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52c0df-d2e6-4e79-b39d-a2c354fac9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:48.203363 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52c0df-d2e6-4e79-b39d-a2c354fac9cf None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:48.203506 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:48.203670 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52c0df-d2e6-4e79-b39d-a2c354fac9cf None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:48.204285 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52c0df-d2e6-4e79-b39d-a2c354fac9cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:48.260114 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:48.277817 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd52c0df-d2e6-4e79-b39d-a2c354fac9cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:48.279386 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd52c0df-d2e6-4e79-b39d-a2c354fac9cf None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:48.294170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a4388e-ffe7-4a54-bb0e-2457e16191e1 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:48.350574 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc841a-f38f-4458-9255-b3cb2038595d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:48.351831 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc841a-f38f-4458-9255-b3cb2038595d None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:48.352814 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc841a-f38f-4458-9255-b3cb2038595d None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:48.353548 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc841a-f38f-4458-9255-b3cb2038595d None admin] PATH_INFO: `/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:48.354960 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc841a-f38f-4458-9255-b3cb2038595d None admin] RBAC: Authorizing `identity:get_project(project_id=ecc1689f0ba04f14ac9c0d53a2a4a32d)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:48.358197 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc841a-f38f-4458-9255-b3cb2038595d None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:48.360680 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 88/181] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:45:48 2022] GET /identity/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:48.362086 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb6dc6-0f40-4b5c-913f-acd1da10fe91 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:48.362564 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb6dc6-0f40-4b5c-913f-acd1da10fe91 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:48.363035 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb6dc6-0f40-4b5c-913f-acd1da10fe91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:48.381839 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-dbbb6dc6-0f40-4b5c-913f-acd1da10fe91 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:48.383020 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-dbbb6dc6-0f40-4b5c-913f-acd1da10fe91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:45:48.398744 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 94/182] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:45:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 15:45:48.400046 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6aa8a6-ee15-40e7-818b-8214c5d4b21b None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:48.400334 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6aa8a6-ee15-40e7-818b-8214c5d4b21b None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:48.400609 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6aa8a6-ee15-40e7-818b-8214c5d4b21b None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:48.402052 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 95/183] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:45:48.402583 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6aa8a6-ee15-40e7-818b-8214c5d4b21b None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:48.462240 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 89/184] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:45:48.462994 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb6dc6-0f40-4b5c-913f-acd1da10fe91 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:48.496325 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:48.502339 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:48.520874 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6aa8a6-ee15-40e7-818b-8214c5d4b21b None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:48.558658 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e0151-e310-46f5-9888-5d0f8c090e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:48.559373 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e0151-e310-46f5-9888-5d0f8c090e7e None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:48.559857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e0151-e310-46f5-9888-5d0f8c090e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:48.559962 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e0151-e310-46f5-9888-5d0f8c090e7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:48.569125 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb6dc6-0f40-4b5c-913f-acd1da10fe91 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:48.571193 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e0151-e310-46f5-9888-5d0f8c090e7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:45:48.575971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-290e0151-e310-46f5-9888-5d0f8c090e7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:45:48.575971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:45:48.575971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:45:48.575971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:45:48.575971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:45:48.575971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:45:48.575971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:45:48.575971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:45:48.575971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:45:48.575971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:45:48.575971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:45:48.575971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:45:48.575971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:45:48.575971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:45:48.575971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:45:48.575971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:45:48.577481 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:45:48.577481 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:45:48.577481 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:45:48.577481 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:45:48.577481 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:45:48.577481 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:45:48.577481 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:45:48.577481 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:45:48.577481 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:45:48.577481 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:45:48.577481 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:45:48.577481 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:45:48.577481 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:45:48.577481 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:45:48.577481 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:45:48.577481 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:45:48.582016 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:45:48.582016 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:45:48.582016 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:45:48.582016 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:45:48.582016 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:45:48.582016 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:45:48.582016 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:45:48.582016 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:45:48.582016 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:45:48.582016 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:45:48.582016 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:45:48.582016 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:45:48.582016 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 96/185] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 30 15:45:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:45:48.582016 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e0151-e310-46f5-9888-5d0f8c090e7e None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:48.609047 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff02fa1-f838-498b-93af-62d5824049dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:48.609751 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff02fa1-f838-498b-93af-62d5824049dc None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:48.610094 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff02fa1-f838-498b-93af-62d5824049dc None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:48.610585 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff02fa1-f838-498b-93af-62d5824049dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:48.611154 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff02fa1-f838-498b-93af-62d5824049dc None admin] RBAC: Adding query filter params (role.id=3e70c1b76757442a9bddbeab151c6fc6, scope.project.id=ecc1689f0ba04f14ac9c0d53a2a4a32d, user.id=a3d5c3129b0d4c998a2a04444d03e300) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:48.611544 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff02fa1-f838-498b-93af-62d5824049dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:48.612924 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff02fa1-f838-498b-93af-62d5824049dc None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:48.618905 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 90/186] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:45:48 2022] GET /identity/v3/role_assignments?user.id=a3d5c3129b0d4c998a2a04444d03e300&scope.project.id=ecc1689f0ba04f14ac9c0d53a2a4a32d&role.id=3e70c1b76757442a9bddbeab151c6fc6 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:48.619839 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434151b5-89c3-4764-b910-1d78192b3e2f None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:48.620123 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434151b5-89c3-4764-b910-1d78192b3e2f None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:48.620395 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434151b5-89c3-4764-b910-1d78192b3e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:48.647543 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-434151b5-89c3-4764-b910-1d78192b3e2f None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:48.648764 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-434151b5-89c3-4764-b910-1d78192b3e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:45:48.713691 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e0151-e310-46f5-9888-5d0f8c090e7e None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:48.731611 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 91/187] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:45:48.733550 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434151b5-89c3-4764-b910-1d78192b3e2f None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:48.769194 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:48.770268 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2df6c-42bb-47f4-85c9-9fdb19d5ee77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:48.770927 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2df6c-42bb-47f4-85c9-9fdb19d5ee77 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:48.771206 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2df6c-42bb-47f4-85c9-9fdb19d5ee77 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:48.771489 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2df6c-42bb-47f4-85c9-9fdb19d5ee77 None admin] PATH_INFO: `/v3/projects/825ed9fd00bd44688313bc6a65096bce` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:48.773796 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf2df6c-42bb-47f4-85c9-9fdb19d5ee77 None admin] RBAC: Authorizing `identity:get_project(project_id=825ed9fd00bd44688313bc6a65096bce)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:48.776308 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf2df6c-42bb-47f4-85c9-9fdb19d5ee77 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:48.779962 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 97/188] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:45:48 2022] GET /identity/v3/projects/825ed9fd00bd44688313bc6a65096bce => generated 312 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:48.781319 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2df6c-42bb-47f4-85c9-9fdb19d5ee77 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:48.802631 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:48.867959 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434151b5-89c3-4764-b910-1d78192b3e2f None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:48.911983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2df6c-42bb-47f4-85c9-9fdb19d5ee77 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:48.912945 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8207830-a05f-4ec6-af85-4a3296fdf381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:48.913663 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8207830-a05f-4ec6-af85-4a3296fdf381 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:48.914018 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8207830-a05f-4ec6-af85-4a3296fdf381 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:48.914366 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8207830-a05f-4ec6-af85-4a3296fdf381 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:48.924807 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8207830-a05f-4ec6-af85-4a3296fdf381 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:45:48.929648 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-e8207830-a05f-4ec6-af85-4a3296fdf381 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 15:45:48.929648 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:45:48.929648 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:45:48.929648 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:45:48.929648 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:45:48.929648 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:45:48.929648 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:45:48.929648 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:45:48.929648 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:45:48.929648 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:45:48.929648 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:45:48.929648 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:45:48.929648 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:45:48.929648 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:45:48.929648 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:45:48.929648 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:45:48.930530 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:45:48.930530 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:45:48.930530 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:45:48.930530 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:45:48.930530 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:45:48.930530 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:45:48.930530 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:45:48.930530 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:45:48.930530 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:45:48.930530 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:45:48.930530 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:45:48.930530 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:45:48.930530 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:45:48.930530 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:45:48.930530 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:45:48.930530 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:45:48.931310 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:45:48.931310 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:45:48.931310 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:45:48.931310 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:45:48.931310 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:45:48.931310 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:45:48.931310 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:45:48.931310 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:45:48.931310 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:45:48.931310 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:45:48.931310 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 15:45:48.931310 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:45:48.931310 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 92/189] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:45:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:45:48.932396 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8207830-a05f-4ec6-af85-4a3296fdf381 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:48.951815 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28ffac-9879-4380-97a6-7fef6c5b7259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:48.952729 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28ffac-9879-4380-97a6-7fef6c5b7259 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:48.953306 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28ffac-9879-4380-97a6-7fef6c5b7259 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:48.953717 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28ffac-9879-4380-97a6-7fef6c5b7259 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:48.954642 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28ffac-9879-4380-97a6-7fef6c5b7259 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:48.955090 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28ffac-9879-4380-97a6-7fef6c5b7259 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:48.956590 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28ffac-9879-4380-97a6-7fef6c5b7259 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:48.965329 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 98/190] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:45:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:48.966034 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28ffac-9879-4380-97a6-7fef6c5b7259 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:49.030980 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:49.043384 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8207830-a05f-4ec6-af85-4a3296fdf381 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:49.043548 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:49.069652 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28ffac-9879-4380-97a6-7fef6c5b7259 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:49.079812 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb9b2f-83ce-45d1-98ca-0cfa9680a855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:49.080448 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb9b2f-83ce-45d1-98ca-0cfa9680a855 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:49.080729 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb9b2f-83ce-45d1-98ca-0cfa9680a855 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:49.081028 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb9b2f-83ce-45d1-98ca-0cfa9680a855 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:49.090899 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb9b2f-83ce-45d1-98ca-0cfa9680a855 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:45:49.095832 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-fbeb9b2f-83ce-45d1-98ca-0cfa9680a855 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 15:45:49.095832 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:45:49.095832 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:45:49.095832 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:45:49.095832 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:45:49.095832 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:45:49.095832 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:45:49.095832 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:45:49.095832 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:45:49.095832 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:45:49.095832 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:45:49.095832 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:45:49.095832 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:45:49.095832 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:45:49.095832 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:45:49.095832 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:45:49.096815 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:45:49.096815 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:45:49.096815 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:45:49.096815 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:45:49.096815 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:45:49.096815 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:45:49.096815 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:45:49.096815 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:45:49.096815 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:45:49.096815 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:45:49.096815 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:45:49.096815 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:45:49.096815 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:45:49.096815 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:45:49.096815 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:45:49.096815 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:45:49.097864 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:45:49.097864 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:45:49.097864 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:45:49.097864 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:45:49.097864 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:45:49.097864 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:45:49.097864 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:45:49.097864 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:45:49.097864 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:45:49.097864 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:45:49.097864 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 15:45:49.097864 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:45:49.097864 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 93/191] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Aug 30 15:45:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:45:49.097864 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb9b2f-83ce-45d1-98ca-0cfa9680a855 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:49.104441 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8f764-3329-471d-9d39-93a04c3b0cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:49.105155 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8f764-3329-471d-9d39-93a04c3b0cac None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:49.105433 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8f764-3329-471d-9d39-93a04c3b0cac None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:49.105702 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8f764-3329-471d-9d39-93a04c3b0cac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:49.106427 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a8f764-3329-471d-9d39-93a04c3b0cac None admin] RBAC: Adding query filter params (role.id=a82e6f447c1b4b56b530dacfae06dee1, scope.project.id=825ed9fd00bd44688313bc6a65096bce, user.id=a3d5c3129b0d4c998a2a04444d03e300) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:49.106732 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a8f764-3329-471d-9d39-93a04c3b0cac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:49.108940 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a8f764-3329-471d-9d39-93a04c3b0cac None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:49.114837 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 99/192] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:45:48 2022] GET /identity/v3/role_assignments?user.id=a3d5c3129b0d4c998a2a04444d03e300&scope.project.id=825ed9fd00bd44688313bc6a65096bce&role.id=a82e6f447c1b4b56b530dacfae06dee1 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:49.115596 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8f764-3329-471d-9d39-93a04c3b0cac None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:49.207217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb9b2f-83ce-45d1-98ca-0cfa9680a855 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:49.245935 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011c287-5186-4bcd-ac35-7c3d1da48b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:49.246947 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011c287-5186-4bcd-ac35-7c3d1da48b99 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:49.247387 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8f764-3329-471d-9d39-93a04c3b0cac None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:49.247637 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011c287-5186-4bcd-ac35-7c3d1da48b99 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:49.248183 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011c287-5186-4bcd-ac35-7c3d1da48b99 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:49.249830 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011c287-5186-4bcd-ac35-7c3d1da48b99 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:49.250353 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011c287-5186-4bcd-ac35-7c3d1da48b99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:49.251919 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011c287-5186-4bcd-ac35-7c3d1da48b99 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:49.261315 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 94/193] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 30 15:45:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:49.262424 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011c287-5186-4bcd-ac35-7c3d1da48b99 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:49.276165 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:49.294184 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5208f-87f6-43c0-8847-11ec0f74139a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:49.294823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5208f-87f6-43c0-8847-11ec0f74139a None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:49.295677 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5208f-87f6-43c0-8847-11ec0f74139a None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:49.295946 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5208f-87f6-43c0-8847-11ec0f74139a None admin] PATH_INFO: `/v3/users/d6ec61573023416283703a9ad154c7ec` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:49.304152 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:49.314250 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5208f-87f6-43c0-8847-11ec0f74139a None admin] RBAC: Authorizing `identity:get_user(user_id=d6ec61573023416283703a9ad154c7ec)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:49.315701 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5208f-87f6-43c0-8847-11ec0f74139a None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:49.317744 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 100/194] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:45:49 2022] GET /identity/v3/users/d6ec61573023416283703a9ad154c7ec => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:49.319464 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5208f-87f6-43c0-8847-11ec0f74139a None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:49.379075 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011c287-5186-4bcd-ac35-7c3d1da48b99 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:49.412204 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f284c5e-0f8b-4b57-81dc-752aad4ea6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:49.412862 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f284c5e-0f8b-4b57-81dc-752aad4ea6f3 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:49.413147 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f284c5e-0f8b-4b57-81dc-752aad4ea6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:49.413427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f284c5e-0f8b-4b57-81dc-752aad4ea6f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:49.414539 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f284c5e-0f8b-4b57-81dc-752aad4ea6f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:49.415988 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f284c5e-0f8b-4b57-81dc-752aad4ea6f3 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:49.417588 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 95/195] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:45:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:49.418417 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f284c5e-0f8b-4b57-81dc-752aad4ea6f3 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:49.429928 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5208f-87f6-43c0-8847-11ec0f74139a None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:49.463722 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30828ba-52a0-46f7-8dac-c8eb6c382ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:49.464331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30828ba-52a0-46f7-8dac-c8eb6c382ca1 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:49.464618 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30828ba-52a0-46f7-8dac-c8eb6c382ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:49.464928 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30828ba-52a0-46f7-8dac-c8eb6c382ca1 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:49.465603 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30828ba-52a0-46f7-8dac-c8eb6c382ca1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:49.465903 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30828ba-52a0-46f7-8dac-c8eb6c382ca1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:49.467903 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30828ba-52a0-46f7-8dac-c8eb6c382ca1 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:49.475713 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 101/196] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:45:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:49.476498 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30828ba-52a0-46f7-8dac-c8eb6c382ca1 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:49.500046 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:49.523280 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f284c5e-0f8b-4b57-81dc-752aad4ea6f3 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:49.539298 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:49.558181 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6dac58-de37-4be7-a537-6742a80c0362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:49.558959 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6dac58-de37-4be7-a537-6742a80c0362 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:49.559241 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6dac58-de37-4be7-a537-6742a80c0362 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:49.559512 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6dac58-de37-4be7-a537-6742a80c0362 None admin] PATH_INFO: `/v3/users/5612016f58c348f19c007373e8ea5f5e` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:49.560728 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6dac58-de37-4be7-a537-6742a80c0362 None admin] RBAC: Authorizing `identity:get_user(user_id=5612016f58c348f19c007373e8ea5f5e)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:49.562220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6dac58-de37-4be7-a537-6742a80c0362 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:49.563827 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 96/197] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:45:49 2022] GET /identity/v3/users/5612016f58c348f19c007373e8ea5f5e => generated 289 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:49.568542 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6dac58-de37-4be7-a537-6742a80c0362 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:49.583686 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30828ba-52a0-46f7-8dac-c8eb6c382ca1 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:49.617167 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde6c54-45ce-4768-b35c-4f790b6ad788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:49.617772 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde6c54-45ce-4768-b35c-4f790b6ad788 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:49.618048 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde6c54-45ce-4768-b35c-4f790b6ad788 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:49.618314 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde6c54-45ce-4768-b35c-4f790b6ad788 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:49.664177 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6dac58-de37-4be7-a537-6742a80c0362 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:49.683644 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdde6c54-45ce-4768-b35c-4f790b6ad788 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:49.685133 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdde6c54-45ce-4768-b35c-4f790b6ad788 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:49.696674 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d52275d-39f9-491f-b223-60d641d5bd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:49.697311 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52275d-39f9-491f-b223-60d641d5bd94 None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:49.697589 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52275d-39f9-491f-b223-60d641d5bd94 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:49.697861 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52275d-39f9-491f-b223-60d641d5bd94 None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:49.698502 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d52275d-39f9-491f-b223-60d641d5bd94 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:49.699961 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d52275d-39f9-491f-b223-60d641d5bd94 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:49.722534 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 97/198] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Aug 30 15:45:49 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:45:49.734402 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d52275d-39f9-491f-b223-60d641d5bd94 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:49.740372 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:49.753955 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:49.805875 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 102/199] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:45:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 15:45:49.805875 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde6c54-45ce-4768-b35c-4f790b6ad788 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:49.867707 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d52275d-39f9-491f-b223-60d641d5bd94 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:49.907540 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c1ce8-8eb5-408c-b78c-ff5c1ed1bf0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:49.908299 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c1ce8-8eb5-408c-b78c-ff5c1ed1bf0c None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:49.908586 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c1ce8-8eb5-408c-b78c-ff5c1ed1bf0c None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:49.908883 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c1ce8-8eb5-408c-b78c-ff5c1ed1bf0c None admin] PATH_INFO: `/v3/users/d6ec61573023416283703a9ad154c7ec` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:49.910046 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c1ce8-8eb5-408c-b78c-ff5c1ed1bf0c None admin] RBAC: Authorizing `identity:get_user(user_id=d6ec61573023416283703a9ad154c7ec)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:49.911760 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c1ce8-8eb5-408c-b78c-ff5c1ed1bf0c None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:49.913461 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 98/200] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:45:49 2022] GET /identity/v3/users/d6ec61573023416283703a9ad154c7ec => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:49.918195 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c1ce8-8eb5-408c-b78c-ff5c1ed1bf0c None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:49.925318 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde6c54-45ce-4768-b35c-4f790b6ad788 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:49.968233 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e9a6a-c469-43cc-85b9-f74e0a096130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:49.968896 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e9a6a-c469-43cc-85b9-f74e0a096130 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:49.969213 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e9a6a-c469-43cc-85b9-f74e0a096130 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:49.970009 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e9a6a-c469-43cc-85b9-f74e0a096130 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:50.011215 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:50.015983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:50.054988 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c1ce8-8eb5-408c-b78c-ff5c1ed1bf0c None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:50.059536 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e9a6a-c469-43cc-85b9-f74e0a096130 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:50.062148 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e9a6a-c469-43cc-85b9-f74e0a096130 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:50.099204 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff778ec4-0e54-41ca-a8ab-13677bfd7017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:50.099850 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff778ec4-0e54-41ca-a8ab-13677bfd7017 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:50.100131 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff778ec4-0e54-41ca-a8ab-13677bfd7017 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:50.100405 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff778ec4-0e54-41ca-a8ab-13677bfd7017 None admin] PATH_INFO: `/v3/projects/7c5e57fbc705432ab1fdaa879674274e` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:50.102870 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff778ec4-0e54-41ca-a8ab-13677bfd7017 None admin] RBAC: Authorizing `identity:get_project(project_id=7c5e57fbc705432ab1fdaa879674274e)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:50.104831 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff778ec4-0e54-41ca-a8ab-13677bfd7017 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:50.106058 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 99/201] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:45:49 2022] GET /identity/v3/projects/7c5e57fbc705432ab1fdaa879674274e => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:50.106915 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff778ec4-0e54-41ca-a8ab-13677bfd7017 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:50.207200 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 103/202] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:45:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 15:45:50.208516 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e9a6a-c469-43cc-85b9-f74e0a096130 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:50.223903 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff778ec4-0e54-41ca-a8ab-13677bfd7017 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:50.262955 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7418ccb0-21b2-4446-b484-478f528ca339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:50.263495 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418ccb0-21b2-4446-b484-478f528ca339 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:50.263816 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418ccb0-21b2-4446-b484-478f528ca339 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:50.264109 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418ccb0-21b2-4446-b484-478f528ca339 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:50.274796 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:50.292940 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:50.343025 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7418ccb0-21b2-4446-b484-478f528ca339 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:50.344416 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7418ccb0-21b2-4446-b484-478f528ca339 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:50.353405 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e9a6a-c469-43cc-85b9-f74e0a096130 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:50.388663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7b1d9-b076-4ea3-b2b3-ca0d8ce7e26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:50.389343 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7b1d9-b076-4ea3-b2b3-ca0d8ce7e26c None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:50.389624 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7b1d9-b076-4ea3-b2b3-ca0d8ce7e26c None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:50.389895 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7b1d9-b076-4ea3-b2b3-ca0d8ce7e26c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:50.390628 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7b1d9-b076-4ea3-b2b3-ca0d8ce7e26c None admin] RBAC: Adding query filter params (role.id=676938e69210499ca11ee75dd572d0dc, scope.project.id=7c5e57fbc705432ab1fdaa879674274e, user.id=d6ec61573023416283703a9ad154c7ec) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:50.390936 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7b1d9-b076-4ea3-b2b3-ca0d8ce7e26c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:50.392393 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7b1d9-b076-4ea3-b2b3-ca0d8ce7e26c None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:50.404814 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 104/203] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:45:50 2022] GET /identity/v3/role_assignments?user.id=d6ec61573023416283703a9ad154c7ec&scope.project.id=7c5e57fbc705432ab1fdaa879674274e&role.id=676938e69210499ca11ee75dd572d0dc => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:50.404814 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7b1d9-b076-4ea3-b2b3-ca0d8ce7e26c None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:50.520194 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 100/204] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:45:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 15:45:50.525878 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7418ccb0-21b2-4446-b484-478f528ca339 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:50.592959 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7b1d9-b076-4ea3-b2b3-ca0d8ce7e26c None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:50.594568 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:50.618927 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:50.642104 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611432e2-bbed-4a1b-8f6b-02da5c644046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:50.642754 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611432e2-bbed-4a1b-8f6b-02da5c644046 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:50.643279 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611432e2-bbed-4a1b-8f6b-02da5c644046 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:50.643548 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611432e2-bbed-4a1b-8f6b-02da5c644046 None admin] PATH_INFO: `/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:50.647724 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611432e2-bbed-4a1b-8f6b-02da5c644046 None admin] RBAC: Authorizing `identity:get_project(project_id=ecc1689f0ba04f14ac9c0d53a2a4a32d)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:50.649225 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611432e2-bbed-4a1b-8f6b-02da5c644046 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:50.650895 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 105/205] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:45:50 2022] GET /identity/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:50.657314 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611432e2-bbed-4a1b-8f6b-02da5c644046 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:50.676208 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7418ccb0-21b2-4446-b484-478f528ca339 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:50.715833 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cdc8b6-4732-4689-9531-33c938c7033e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:50.717117 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdc8b6-4732-4689-9531-33c938c7033e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:50.717684 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdc8b6-4732-4689-9531-33c938c7033e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:50.718134 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdc8b6-4732-4689-9531-33c938c7033e None admin] PATH_INFO: `/v3/projects/7c5e57fbc705432ab1fdaa879674274e` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:50.719565 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cdc8b6-4732-4689-9531-33c938c7033e None admin] RBAC: Authorizing `identity:get_project(project_id=7c5e57fbc705432ab1fdaa879674274e)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:50.726697 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cdc8b6-4732-4689-9531-33c938c7033e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:50.729116 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 101/206] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:45:50 2022] GET /identity/v3/projects/7c5e57fbc705432ab1fdaa879674274e => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:45:50.735641 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cdc8b6-4732-4689-9531-33c938c7033e None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:50.895953 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cdc8b6-4732-4689-9531-33c938c7033e None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:50.898025 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611432e2-bbed-4a1b-8f6b-02da5c644046 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:50.913272 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:50.933502 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfb04f-6347-4b51-ac08-1dbbc9ef8a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:50.934214 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfb04f-6347-4b51-ac08-1dbbc9ef8a79 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:50.934499 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfb04f-6347-4b51-ac08-1dbbc9ef8a79 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:50.934775 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfb04f-6347-4b51-ac08-1dbbc9ef8a79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:50.936056 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfb04f-6347-4b51-ac08-1dbbc9ef8a79 None admin] RBAC: Adding query filter params (role.id=3e70c1b76757442a9bddbeab151c6fc6, scope.project.id=7c5e57fbc705432ab1fdaa879674274e, user.id=d6ec61573023416283703a9ad154c7ec) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:50.936367 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfb04f-6347-4b51-ac08-1dbbc9ef8a79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:50.938124 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfb04f-6347-4b51-ac08-1dbbc9ef8a79 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:50.944516 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 102/207] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:45:50 2022] GET /identity/v3/role_assignments?user.id=d6ec61573023416283703a9ad154c7ec&scope.project.id=7c5e57fbc705432ab1fdaa879674274e&role.id=3e70c1b76757442a9bddbeab151c6fc6 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:50.970677 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e816e6-39dc-48d8-af58-e90f8df24ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:50.971567 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e816e6-39dc-48d8-af58-e90f8df24ba2 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:50.972019 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e816e6-39dc-48d8-af58-e90f8df24ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:50.972436 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e816e6-39dc-48d8-af58-e90f8df24ba2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:50.973402 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e816e6-39dc-48d8-af58-e90f8df24ba2 None admin] RBAC: Adding query filter params (role.id=1e3d7a32e093474f86d5673fedf09dc5, scope.project.id=ecc1689f0ba04f14ac9c0d53a2a4a32d, user.id=5612016f58c348f19c007373e8ea5f5e) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:50.973846 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e816e6-39dc-48d8-af58-e90f8df24ba2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:50.975442 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e816e6-39dc-48d8-af58-e90f8df24ba2 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:50.991162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 106/208] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:45:50 2022] GET /identity/v3/role_assignments?user.id=5612016f58c348f19c007373e8ea5f5e&scope.project.id=ecc1689f0ba04f14ac9c0d53a2a4a32d&role.id=1e3d7a32e093474f86d5673fedf09dc5 => generated 608 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:45:51.889420 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7418e1-51a4-4db3-ba01-b129e1c80a61 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:51.889956 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7418e1-51a4-4db3-ba01-b129e1c80a61 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:51.890242 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7418e1-51a4-4db3-ba01-b129e1c80a61 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:51.891772 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 103/209] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:45:51.897190 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674bdc10-a07f-4006-8536-df67ca40a708 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:51.897695 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674bdc10-a07f-4006-8536-df67ca40a708 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:51.898297 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674bdc10-a07f-4006-8536-df67ca40a708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:51.921611 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-674bdc10-a07f-4006-8536-df67ca40a708 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:51.924229 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-674bdc10-a07f-4006-8536-df67ca40a708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:45:51.987928 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:52.013206 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 107/210] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:45:52.114384 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34bef2-602f-4ebb-b1da-f5794333ea71 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:52.115030 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34bef2-602f-4ebb-b1da-f5794333ea71 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:52.115506 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34bef2-602f-4ebb-b1da-f5794333ea71 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:52.117090 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 104/211] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:45:52.122412 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd711141-0a4f-414b-b9b0-5e63b1987a5e None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:52.122974 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd711141-0a4f-414b-b9b0-5e63b1987a5e None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:52.123450 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd711141-0a4f-414b-b9b0-5e63b1987a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:52.142589 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-cd711141-0a4f-414b-b9b0-5e63b1987a5e None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:52.144335 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-cd711141-0a4f-414b-b9b0-5e63b1987a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:45:52.215804 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 108/212] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:45:52.286921 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34bef2-602f-4ebb-b1da-f5794333ea71 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:52.395191 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34bef2-602f-4ebb-b1da-f5794333ea71 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:52.430598 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52b047-eebc-4bdd-b5ab-27d3ecc4c2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:52.431606 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52b047-eebc-4bdd-b5ab-27d3ecc4c2ea None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:52.432079 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52b047-eebc-4bdd-b5ab-27d3ecc4c2ea None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:52.432540 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52b047-eebc-4bdd-b5ab-27d3ecc4c2ea None admin] PATH_INFO: `/v3/roles/member` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:52.443346 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52b047-eebc-4bdd-b5ab-27d3ecc4c2ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:45:52.449100 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-aa52b047-eebc-4bdd-b5ab-27d3ecc4c2ea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 15:45:52.449100 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:45:52.449100 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:45:52.449100 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:45:52.449100 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:45:52.449100 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:45:52.449100 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:45:52.449100 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:45:52.449100 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:45:52.449100 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:45:52.449100 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:45:52.449100 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:45:52.449100 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:45:52.449100 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:45:52.449100 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:45:52.449100 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:45:52.449954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:45:52.449954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:45:52.449954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:45:52.449954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:45:52.449954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:45:52.449954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:45:52.449954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:45:52.449954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:45:52.449954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:45:52.449954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:45:52.449954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:45:52.449954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:45:52.449954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:45:52.449954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:45:52.449954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:45:52.449954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:45:52.450739 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:45:52.450739 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:45:52.450739 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:45:52.450739 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:45:52.450739 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:45:52.450739 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:45:52.450739 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:45:52.450739 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:45:52.450739 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:45:52.450739 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:45:52.450739 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 15:45:52.450739 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:45:52.453618 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 105/213] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:45:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:45:52.459587 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd711141-0a4f-414b-b9b0-5e63b1987a5e None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:52.499415 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52b047-eebc-4bdd-b5ab-27d3ecc4c2ea None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:52.532813 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:52.576840 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd711141-0a4f-414b-b9b0-5e63b1987a5e None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:52.590822 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:52.608913 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52b047-eebc-4bdd-b5ab-27d3ecc4c2ea None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:52.614286 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c49b0-f492-4d53-932a-a45906a1ff04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:52.614906 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c49b0-f492-4d53-932a-a45906a1ff04 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:52.615192 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c49b0-f492-4d53-932a-a45906a1ff04 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:52.615467 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c49b0-f492-4d53-932a-a45906a1ff04 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:52.616143 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c49b0-f492-4d53-932a-a45906a1ff04 None admin] RBAC: Adding query filter params (name=member) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:52.616446 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c49b0-f492-4d53-932a-a45906a1ff04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:52.617869 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c49b0-f492-4d53-932a-a45906a1ff04 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:52.626316 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 109/214] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 30 15:45:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:52.626316 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85bab0d-8ef4-4abd-af33-c792b9b89ddd None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:52.626316 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85bab0d-8ef4-4abd-af33-c792b9b89ddd None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:52.626316 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85bab0d-8ef4-4abd-af33-c792b9b89ddd None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:52.626316 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 110/215] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:45:52.634184 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85bab0d-8ef4-4abd-af33-c792b9b89ddd None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:52.651093 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5fc9e-e0d4-44d9-b6aa-531524b672ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:52.651729 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5fc9e-e0d4-44d9-b6aa-531524b672ff None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:52.652013 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5fc9e-e0d4-44d9-b6aa-531524b672ff None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:52.652287 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5fc9e-e0d4-44d9-b6aa-531524b672ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:52.653395 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b5fc9e-e0d4-44d9-b6aa-531524b672ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:52.655445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b5fc9e-e0d4-44d9-b6aa-531524b672ff None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:52.660834 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 106/216] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:45:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:45:52.660834 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c07d9-2dc0-4097-a5a2-3ff7d924ec54 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:52.660834 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c07d9-2dc0-4097-a5a2-3ff7d924ec54 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:52.660834 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c07d9-2dc0-4097-a5a2-3ff7d924ec54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:52.678937 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-942c07d9-2dc0-4097-a5a2-3ff7d924ec54 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:52.680136 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-942c07d9-2dc0-4097-a5a2-3ff7d924ec54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:45:52.751945 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85bab0d-8ef4-4abd-af33-c792b9b89ddd None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:52.756235 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 107/217] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:45:52.756999 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c07d9-2dc0-4097-a5a2-3ff7d924ec54 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:52.795585 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:52.797438 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bfd03-c870-4989-bea0-3aed0baf6a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:52.798405 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bfd03-c870-4989-bea0-3aed0baf6a0a None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:52.798712 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bfd03-c870-4989-bea0-3aed0baf6a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:52.798939 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bfd03-c870-4989-bea0-3aed0baf6a0a None admin] PATH_INFO: `/v3/users/941738604a714d828a1cf19d308e994c` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:52.815864 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393bfd03-c870-4989-bea0-3aed0baf6a0a None admin] RBAC: Authorizing `identity:get_user(user_id=941738604a714d828a1cf19d308e994c)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:52.817171 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393bfd03-c870-4989-bea0-3aed0baf6a0a None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:52.823467 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 111/218] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:45:52 2022] GET /identity/v3/users/941738604a714d828a1cf19d308e994c => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:52.825254 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bfd03-c870-4989-bea0-3aed0baf6a0a None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:52.863749 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:52.886603 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c07d9-2dc0-4097-a5a2-3ff7d924ec54 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:52.924611 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862537f-4178-4613-aeef-e7dc44415404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:52.925459 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862537f-4178-4613-aeef-e7dc44415404 None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:52.925839 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862537f-4178-4613-aeef-e7dc44415404 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:52.926213 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862537f-4178-4613-aeef-e7dc44415404 None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:52.926987 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0862537f-4178-4613-aeef-e7dc44415404 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:52.928652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0862537f-4178-4613-aeef-e7dc44415404 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:52.937063 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bfd03-c870-4989-bea0-3aed0baf6a0a None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:52.958221 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 108/219] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Aug 30 15:45:52 2022] POST /identity/v3/users => generated 297 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:45:52.976262 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a6c66-93ad-4f08-b13b-df958ec23dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:52.977236 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a6c66-93ad-4f08-b13b-df958ec23dcf None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:52.977655 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a6c66-93ad-4f08-b13b-df958ec23dcf None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:52.978061 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a6c66-93ad-4f08-b13b-df958ec23dcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:53.026856 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862537f-4178-4613-aeef-e7dc44415404 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:53.055719 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a6c66-93ad-4f08-b13b-df958ec23dcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:53.057252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a6c66-93ad-4f08-b13b-df958ec23dcf None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:53.096068 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:53.129914 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:53.150681 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862537f-4178-4613-aeef-e7dc44415404 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:53.178443 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 112/220] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:45:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 15:45:53.182978 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ce9b6-5453-41e1-b036-c970ce722d1f None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:53.182978 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ce9b6-5453-41e1-b036-c970ce722d1f None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:53.182978 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ce9b6-5453-41e1-b036-c970ce722d1f None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:53.182978 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 113/221] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:45:53.186363 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ce9b6-5453-41e1-b036-c970ce722d1f None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:53.190636 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f7230-79b6-4a88-b3b4-eb0f17e51639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:53.191285 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f7230-79b6-4a88-b3b4-eb0f17e51639 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:53.191831 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f7230-79b6-4a88-b3b4-eb0f17e51639 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:53.191831 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f7230-79b6-4a88-b3b4-eb0f17e51639 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:53.204614 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f7230-79b6-4a88-b3b4-eb0f17e51639 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:45:53.210040 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-324f7230-79b6-4a88-b3b4-eb0f17e51639 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:45:53.210040 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:45:53.210040 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:45:53.210040 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:45:53.210040 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:45:53.210040 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:45:53.210040 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:45:53.210040 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:45:53.210040 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:45:53.210040 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:45:53.210040 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:45:53.210040 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:45:53.210040 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:45:53.210040 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:45:53.210040 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:45:53.210040 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:45:53.210888 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:45:53.210888 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:45:53.210888 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:45:53.210888 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:45:53.210888 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:45:53.210888 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:45:53.210888 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:45:53.210888 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:45:53.210888 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:45:53.210888 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:45:53.210888 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:45:53.210888 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:45:53.210888 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:45:53.210888 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:45:53.210888 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:45:53.210888 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:45:53.211655 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:45:53.211655 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:45:53.211655 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:45:53.211655 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:45:53.211655 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:45:53.211655 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:45:53.211655 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:45:53.211655 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:45:53.211655 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:45:53.211655 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:45:53.211655 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:45:53.211655 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:45:53.211655 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 109/222] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 30 15:45:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 15:45:53.214464 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45d91c-e2e3-42b0-a78c-e855a499d1ac None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:53.214755 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45d91c-e2e3-42b0-a78c-e855a499d1ac None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:53.215033 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45d91c-e2e3-42b0-a78c-e855a499d1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:53.235626 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-fb45d91c-e2e3-42b0-a78c-e855a499d1ac None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:53.237370 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-fb45d91c-e2e3-42b0-a78c-e855a499d1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:45:53.320603 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ce9b6-5453-41e1-b036-c970ce722d1f None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:53.325099 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 110/223] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:45:53.327151 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45d91c-e2e3-42b0-a78c-e855a499d1ac None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:53.366616 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324977b9-9138-4fa7-ac91-06941d5ea434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:53.367254 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324977b9-9138-4fa7-ac91-06941d5ea434 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:53.367526 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324977b9-9138-4fa7-ac91-06941d5ea434 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:53.367797 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324977b9-9138-4fa7-ac91-06941d5ea434 None admin] PATH_INFO: `/v3/projects/7c5e57fbc705432ab1fdaa879674274e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:53.369483 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324977b9-9138-4fa7-ac91-06941d5ea434 None admin] RBAC: Authorizing `identity:get_project(project_id=7c5e57fbc705432ab1fdaa879674274e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:53.370932 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324977b9-9138-4fa7-ac91-06941d5ea434 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:53.373582 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 114/224] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:45:53 2022] GET /identity/v3/projects/7c5e57fbc705432ab1fdaa879674274e => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:53.378450 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324977b9-9138-4fa7-ac91-06941d5ea434 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:53.382534 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:53.437268 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:53.481164 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45d91c-e2e3-42b0-a78c-e855a499d1ac None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:53.517778 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324977b9-9138-4fa7-ac91-06941d5ea434 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:53.556675 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7506ec-8a50-4a5f-933a-83c8e2c97435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:53.557376 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7506ec-8a50-4a5f-933a-83c8e2c97435 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:53.557655 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7506ec-8a50-4a5f-933a-83c8e2c97435 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:53.557921 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7506ec-8a50-4a5f-933a-83c8e2c97435 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:53.558595 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7506ec-8a50-4a5f-933a-83c8e2c97435 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:53.558893 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7506ec-8a50-4a5f-933a-83c8e2c97435 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:53.560283 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7506ec-8a50-4a5f-933a-83c8e2c97435 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:53.581585 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 111/225] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:45:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:53.590001 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7506ec-8a50-4a5f-933a-83c8e2c97435 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:53.591924 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16db138-9c22-46d4-9021-a45a213a11f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:53.594451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16db138-9c22-46d4-9021-a45a213a11f1 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:53.594735 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16db138-9c22-46d4-9021-a45a213a11f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:53.595005 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16db138-9c22-46d4-9021-a45a213a11f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:53.596070 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16db138-9c22-46d4-9021-a45a213a11f1 None admin] RBAC: Adding query filter params (role.id=a82e6f447c1b4b56b530dacfae06dee1, scope.project.id=7c5e57fbc705432ab1fdaa879674274e, user.id=941738604a714d828a1cf19d308e994c) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:53.596372 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16db138-9c22-46d4-9021-a45a213a11f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:53.597851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16db138-9c22-46d4-9021-a45a213a11f1 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:53.606779 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 115/226] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:45:53 2022] GET /identity/v3/role_assignments?user.id=941738604a714d828a1cf19d308e994c&scope.project.id=7c5e57fbc705432ab1fdaa879674274e&role.id=a82e6f447c1b4b56b530dacfae06dee1 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:53.609314 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16db138-9c22-46d4-9021-a45a213a11f1 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:53.731996 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7506ec-8a50-4a5f-933a-83c8e2c97435 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:53.740931 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:53.809588 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd230d-b24d-4ed8-af7c-2b346c4ffe62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:53.810243 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd230d-b24d-4ed8-af7c-2b346c4ffe62 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:53.811411 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd230d-b24d-4ed8-af7c-2b346c4ffe62 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:53.811686 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd230d-b24d-4ed8-af7c-2b346c4ffe62 None admin] PATH_INFO: `/v3/users/d6ec61573023416283703a9ad154c7ec` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:53.814074 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16db138-9c22-46d4-9021-a45a213a11f1 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:53.816249 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd230d-b24d-4ed8-af7c-2b346c4ffe62 None admin] RBAC: Authorizing `identity:get_user(user_id=d6ec61573023416283703a9ad154c7ec)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:53.817750 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd230d-b24d-4ed8-af7c-2b346c4ffe62 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:53.819376 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 112/227] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:45:53 2022] GET /identity/v3/users/d6ec61573023416283703a9ad154c7ec => generated 283 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:53.825869 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd230d-b24d-4ed8-af7c-2b346c4ffe62 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:53.830275 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:53.870073 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb24ac-ff54-4239-ae1c-758209972530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:53.871149 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb24ac-ff54-4239-ae1c-758209972530 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:53.871628 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb24ac-ff54-4239-ae1c-758209972530 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:53.872095 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb24ac-ff54-4239-ae1c-758209972530 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:53.884862 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb24ac-ff54-4239-ae1c-758209972530 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:45:53.891651 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-6dbb24ac-ff54-4239-ae1c-758209972530 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 15:45:53.891651 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:45:53.891651 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:45:53.891651 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:45:53.891651 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:45:53.891651 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:45:53.891651 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:45:53.891651 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:45:53.891651 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:45:53.891651 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:45:53.891651 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:45:53.891651 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:45:53.891651 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:45:53.891651 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:45:53.891651 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:45:53.891651 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:45:53.892536 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:45:53.892536 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:45:53.892536 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:45:53.892536 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:45:53.892536 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:45:53.892536 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:45:53.892536 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:45:53.892536 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:45:53.892536 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:45:53.892536 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:45:53.892536 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:45:53.892536 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:45:53.892536 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:45:53.892536 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:45:53.892536 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:45:53.892536 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:45:53.893620 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:45:53.893620 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:45:53.893620 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:45:53.893620 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:45:53.893620 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:45:53.893620 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:45:53.893620 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:45:53.893620 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:45:53.893620 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:45:53.893620 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:45:53.893620 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 15:45:53.893620 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:45:53.896329 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 116/228] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Aug 30 15:45:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:45:53.902348 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb24ac-ff54-4239-ae1c-758209972530 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:53.970887 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd230d-b24d-4ed8-af7c-2b346c4ffe62 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:54.024154 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb24ac-ff54-4239-ae1c-758209972530 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:54.055517 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:54.062970 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ebc1e-609d-4086-a982-cd60006c9136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:54.063647 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ebc1e-609d-4086-a982-cd60006c9136 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:54.063886 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ebc1e-609d-4086-a982-cd60006c9136 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:54.064153 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ebc1e-609d-4086-a982-cd60006c9136 None admin] PATH_INFO: `/v3/projects/7c5e57fbc705432ab1fdaa879674274e` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:54.065405 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ebc1e-609d-4086-a982-cd60006c9136 None admin] RBAC: Authorizing `identity:get_project(project_id=7c5e57fbc705432ab1fdaa879674274e)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:54.068051 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150321a3-c033-40aa-9d06-0aae31ca8342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:54.068912 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150321a3-c033-40aa-9d06-0aae31ca8342 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:54.069575 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150321a3-c033-40aa-9d06-0aae31ca8342 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:54.069759 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ebc1e-609d-4086-a982-cd60006c9136 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:54.070223 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150321a3-c033-40aa-9d06-0aae31ca8342 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:54.071088 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150321a3-c033-40aa-9d06-0aae31ca8342 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:54.071584 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150321a3-c033-40aa-9d06-0aae31ca8342 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:54.071767 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 113/229] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:45:53 2022] GET /identity/v3/projects/7c5e57fbc705432ab1fdaa879674274e => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:54.073375 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150321a3-c033-40aa-9d06-0aae31ca8342 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:54.083339 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ebc1e-609d-4086-a982-cd60006c9136 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:54.086643 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 117/230] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:45:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:45:54.093076 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150321a3-c033-40aa-9d06-0aae31ca8342 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:54.212435 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150321a3-c033-40aa-9d06-0aae31ca8342 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:54.254416 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:54.258963 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1390845-886a-4a3d-b7f2-34b46dce4dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:54.259852 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1390845-886a-4a3d-b7f2-34b46dce4dcd None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:54.260355 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1390845-886a-4a3d-b7f2-34b46dce4dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:54.261488 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1390845-886a-4a3d-b7f2-34b46dce4dcd None admin] PATH_INFO: `/v3/users/d6ec61573023416283703a9ad154c7ec` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:54.262849 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1390845-886a-4a3d-b7f2-34b46dce4dcd None admin] RBAC: Authorizing `identity:get_user(user_id=d6ec61573023416283703a9ad154c7ec)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:54.265068 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1390845-886a-4a3d-b7f2-34b46dce4dcd None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:54.267007 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 118/231] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:45:54 2022] GET /identity/v3/users/d6ec61573023416283703a9ad154c7ec => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:45:54.272863 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1390845-886a-4a3d-b7f2-34b46dce4dcd None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:54.319568 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ebc1e-609d-4086-a982-cd60006c9136 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:54.333750 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:54.382664 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1390845-886a-4a3d-b7f2-34b46dce4dcd None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:54.398308 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16337415-c7c8-4462-bd07-8036330f0937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:54.398791 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16337415-c7c8-4462-bd07-8036330f0937 None admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:54.399075 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16337415-c7c8-4462-bd07-8036330f0937 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:54.399346 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16337415-c7c8-4462-bd07-8036330f0937 None admin] PATH_INFO: `/v3/projects/7c5e57fbc705432ab1fdaa879674274e/users/d6ec61573023416283703a9ad154c7ec/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:54.401314 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16337415-c7c8-4462-bd07-8036330f0937 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c5e57fbc705432ab1fdaa879674274e, user_id=d6ec61573023416283703a9ad154c7ec, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:54.402775 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16337415-c7c8-4462-bd07-8036330f0937 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:54.424305 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2b601-08f9-4da0-b026-b0b3490ce392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:54.425541 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2b601-08f9-4da0-b026-b0b3490ce392 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:54.426050 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2b601-08f9-4da0-b026-b0b3490ce392 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:54.426521 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2b601-08f9-4da0-b026-b0b3490ce392 None admin] PATH_INFO: `/v3/projects/7c5e57fbc705432ab1fdaa879674274e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:54.428041 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2b601-08f9-4da0-b026-b0b3490ce392 None admin] RBAC: Authorizing `identity:get_project(project_id=7c5e57fbc705432ab1fdaa879674274e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:54.430127 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2b601-08f9-4da0-b026-b0b3490ce392 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:54.432044 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 119/232] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:45:54 2022] GET /identity/v3/projects/7c5e57fbc705432ab1fdaa879674274e => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:54.438462 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2b601-08f9-4da0-b026-b0b3490ce392 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:54.455789 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 114/233] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 30 15:45:54 2022] PUT /identity/v3/projects/7c5e57fbc705432ab1fdaa879674274e/users/d6ec61573023416283703a9ad154c7ec/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:45:54.562360 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2b601-08f9-4da0-b026-b0b3490ce392 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:54.588395 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:54.606448 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc83b3eb-745b-4784-91e1-9fd54b4cabdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:54.608207 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83b3eb-745b-4784-91e1-9fd54b4cabdd None admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:54.608695 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83b3eb-745b-4784-91e1-9fd54b4cabdd None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:54.609194 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83b3eb-745b-4784-91e1-9fd54b4cabdd None admin] PATH_INFO: `/v3/projects/7c5e57fbc705432ab1fdaa879674274e/users/d6ec61573023416283703a9ad154c7ec/roles/3e70c1b76757442a9bddbeab151c6fc6` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:54.614804 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc83b3eb-745b-4784-91e1-9fd54b4cabdd None admin] RBAC: Authorizing `identity:create_grant(project_id=7c5e57fbc705432ab1fdaa879674274e, user_id=d6ec61573023416283703a9ad154c7ec, role_id=3e70c1b76757442a9bddbeab151c6fc6)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:54.616733 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc83b3eb-745b-4784-91e1-9fd54b4cabdd None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:54.647125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 120/234] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 30 15:45:54 2022] PUT /identity/v3/projects/7c5e57fbc705432ab1fdaa879674274e/users/d6ec61573023416283703a9ad154c7ec/roles/3e70c1b76757442a9bddbeab151c6fc6 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:45:55.406586 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40eb741-78e6-4635-a7e9-eeb8a84f2bc0 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:55.407095 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40eb741-78e6-4635-a7e9-eeb8a84f2bc0 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:55.407205 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40eb741-78e6-4635-a7e9-eeb8a84f2bc0 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:55.408604 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 115/235] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:45:55.422394 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715f24b-7a13-4db0-9318-4891a421b30c None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:55.422855 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715f24b-7a13-4db0-9318-4891a421b30c None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:55.422926 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715f24b-7a13-4db0-9318-4891a421b30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:55.449781 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-e715f24b-7a13-4db0-9318-4891a421b30c None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:55.451608 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-e715f24b-7a13-4db0-9318-4891a421b30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:45:55.474462 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba4db1-1d98-4e28-90cb-6ea24ac8ee38 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:55.474764 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba4db1-1d98-4e28-90cb-6ea24ac8ee38 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:55.475001 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba4db1-1d98-4e28-90cb-6ea24ac8ee38 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:55.476326 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 116/236] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 15:45:55.481324 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547c04e-7048-4e88-b812-94ae4d99baa8 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:55.481603 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547c04e-7048-4e88-b812-94ae4d99baa8 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:55.481870 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547c04e-7048-4e88-b812-94ae4d99baa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:55.504456 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-f547c04e-7048-4e88-b812-94ae4d99baa8 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:55.505668 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-f547c04e-7048-4e88-b812-94ae4d99baa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:45:55.569218 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 121/237] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:45:55.605652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 117/238] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 15:45:55.912580 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec9eab-b64c-42e3-9c66-900e235217ee None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:55.912969 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec9eab-b64c-42e3-9c66-900e235217ee None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:55.913164 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec9eab-b64c-42e3-9c66-900e235217ee None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:55.914486 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 122/239] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:45:55.919606 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5f49f-c366-44a0-a917-b7f414919c69 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:55.919974 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5f49f-c366-44a0-a917-b7f414919c69 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:55.920244 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5f49f-c366-44a0-a917-b7f414919c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:55.946862 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-15d5f49f-c366-44a0-a917-b7f414919c69 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:55.948083 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-15d5f49f-c366-44a0-a917-b7f414919c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:45:56.003183 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec9eab-b64c-42e3-9c66-900e235217ee None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:56.023880 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:56.040170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 118/240] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:45:56.041044 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d5f49f-c366-44a0-a917-b7f414919c69 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:56.193389 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec9eab-b64c-42e3-9c66-900e235217ee None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:56.227592 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:56.237334 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d5f49f-c366-44a0-a917-b7f414919c69 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:56.258334 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24960b4-3421-4962-9bbe-42a9816e7c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:56.258901 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24960b4-3421-4962-9bbe-42a9816e7c2a None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:56.259180 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24960b4-3421-4962-9bbe-42a9816e7c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:56.259452 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24960b4-3421-4962-9bbe-42a9816e7c2a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:56.271501 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24960b4-3421-4962-9bbe-42a9816e7c2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:45:56.276622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-f24960b4-3421-4962-9bbe-42a9816e7c2a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 15:45:56.276622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:45:56.276622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:45:56.276622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:45:56.276622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:45:56.276622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:45:56.276622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:45:56.276622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:45:56.276622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:45:56.276622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:45:56.276622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:45:56.276622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:45:56.276622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:45:56.276622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:45:56.276622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:45:56.276622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:45:56.277491 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:45:56.277491 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:45:56.277491 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:45:56.277491 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:45:56.277491 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:45:56.277491 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:45:56.277491 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:45:56.277491 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:45:56.277491 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:45:56.277491 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:45:56.277491 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:45:56.277491 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:45:56.277491 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:45:56.277491 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:45:56.277491 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:45:56.277491 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:45:56.278254 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:45:56.278254 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:45:56.278254 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:45:56.278254 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:45:56.278254 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:45:56.278254 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:45:56.278254 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:45:56.278254 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:45:56.278254 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:45:56.278254 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:45:56.278254 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 15:45:56.278254 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:45:56.278254 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 123/241] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:45:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 15:45:56.285698 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24960b4-3421-4962-9bbe-42a9816e7c2a None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:56.302543 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eeffa0-b92e-436c-8073-451a8ded148c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:56.303188 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eeffa0-b92e-436c-8073-451a8ded148c None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:56.303518 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eeffa0-b92e-436c-8073-451a8ded148c None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:56.303788 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eeffa0-b92e-436c-8073-451a8ded148c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:56.304970 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eeffa0-b92e-436c-8073-451a8ded148c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:56.306583 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eeffa0-b92e-436c-8073-451a8ded148c None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:56.308485 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 119/242] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:45:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:56.317159 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eeffa0-b92e-436c-8073-451a8ded148c None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:56.410641 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24960b4-3421-4962-9bbe-42a9816e7c2a None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:56.414966 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:56.447509 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5fec54-d33d-4a72-a86f-7f0bd4fb5589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:56.448177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fec54-d33d-4a72-a86f-7f0bd4fb5589 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:56.448459 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fec54-d33d-4a72-a86f-7f0bd4fb5589 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:56.448733 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fec54-d33d-4a72-a86f-7f0bd4fb5589 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:56.449434 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5fec54-d33d-4a72-a86f-7f0bd4fb5589 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:56.449734 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5fec54-d33d-4a72-a86f-7f0bd4fb5589 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:56.451897 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5fec54-d33d-4a72-a86f-7f0bd4fb5589 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:56.460476 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eeffa0-b92e-436c-8073-451a8ded148c None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:56.461050 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 124/243] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 30 15:45:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:56.461990 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5fec54-d33d-4a72-a86f-7f0bd4fb5589 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:56.498575 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37891975-8e23-4650-8881-7afacf9736c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:56.499413 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:56.500243 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37891975-8e23-4650-8881-7afacf9736c3 None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:56.500529 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37891975-8e23-4650-8881-7afacf9736c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:56.500889 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37891975-8e23-4650-8881-7afacf9736c3 None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:56.501560 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37891975-8e23-4650-8881-7afacf9736c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:56.503030 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37891975-8e23-4650-8881-7afacf9736c3 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:56.530682 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 120/244] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Aug 30 15:45:56 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:45:56.531462 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37891975-8e23-4650-8881-7afacf9736c3 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:56.585087 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5fec54-d33d-4a72-a86f-7f0bd4fb5589 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:56.623862 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17b46d-5d86-4046-83ce-f4dc2cfb01f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:56.624560 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17b46d-5d86-4046-83ce-f4dc2cfb01f7 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:56.624958 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17b46d-5d86-4046-83ce-f4dc2cfb01f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:56.625235 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17b46d-5d86-4046-83ce-f4dc2cfb01f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:56.637234 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17b46d-5d86-4046-83ce-f4dc2cfb01f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:45:56.643482 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-bb17b46d-5d86-4046-83ce-f4dc2cfb01f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 15:45:56.643482 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:45:56.643482 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:45:56.643482 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:45:56.643482 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:45:56.643482 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:45:56.643482 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:45:56.643482 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:45:56.643482 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:45:56.643482 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:45:56.643482 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:45:56.643482 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:45:56.643482 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:45:56.643482 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:45:56.643482 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:45:56.643482 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:45:56.645391 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:45:56.645391 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:45:56.645391 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:45:56.645391 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:45:56.645391 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:45:56.645391 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:45:56.645391 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:45:56.645391 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:45:56.645391 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:45:56.645391 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:45:56.645391 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:45:56.645391 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:45:56.645391 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:45:56.645391 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:45:56.645391 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:45:56.645391 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:45:56.646366 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:45:56.646366 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:45:56.646366 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:45:56.646366 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:45:56.646366 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:45:56.646366 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:45:56.646366 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:45:56.646366 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:45:56.646366 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:45:56.646366 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:45:56.646366 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 15:45:56.646366 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:45:56.646366 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 125/245] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:45:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:45:56.650611 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37891975-8e23-4650-8881-7afacf9736c3 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:56.653026 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17b46d-5d86-4046-83ce-f4dc2cfb01f7 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:56.671889 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:56.696581 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d757349-acdb-4879-9422-5d808433464a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:56.697405 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d757349-acdb-4879-9422-5d808433464a None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:56.697683 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d757349-acdb-4879-9422-5d808433464a None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:56.697956 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d757349-acdb-4879-9422-5d808433464a None admin] PATH_INFO: `/v3/users/8a0ee8d1f353435086ac5ee57db5d043` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:56.714270 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d757349-acdb-4879-9422-5d808433464a None admin] RBAC: Authorizing `identity:get_user(user_id=8a0ee8d1f353435086ac5ee57db5d043)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:56.715925 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d757349-acdb-4879-9422-5d808433464a None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:56.717974 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 121/246] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:45:56 2022] GET /identity/v3/users/8a0ee8d1f353435086ac5ee57db5d043 => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:56.725457 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d757349-acdb-4879-9422-5d808433464a None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:56.756989 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:56.762777 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17b46d-5d86-4046-83ce-f4dc2cfb01f7 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:56.830522 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95f523-ce3c-4211-bbb8-e45a28a424ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:56.833139 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95f523-ce3c-4211-bbb8-e45a28a424ac None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:56.833710 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95f523-ce3c-4211-bbb8-e45a28a424ac None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:56.834223 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95f523-ce3c-4211-bbb8-e45a28a424ac None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:56.835602 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95f523-ce3c-4211-bbb8-e45a28a424ac None admin] RBAC: Adding query filter params (name=member) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:56.836141 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95f523-ce3c-4211-bbb8-e45a28a424ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:56.837877 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95f523-ce3c-4211-bbb8-e45a28a424ac None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:56.844534 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d757349-acdb-4879-9422-5d808433464a None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:56.849683 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 126/247] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 30 15:45:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:56.857297 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95f523-ce3c-4211-bbb8-e45a28a424ac None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:56.897267 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a214f-8baa-47a8-bda0-c0f6ccd4842e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:56.897697 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a214f-8baa-47a8-bda0-c0f6ccd4842e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:56.899252 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a214f-8baa-47a8-bda0-c0f6ccd4842e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:56.899252 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a214f-8baa-47a8-bda0-c0f6ccd4842e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:56.955727 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:56.992636 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95f523-ce3c-4211-bbb8-e45a28a424ac None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:56.996664 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9a214f-8baa-47a8-bda0-c0f6ccd4842e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:56.998308 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9a214f-8baa-47a8-bda0-c0f6ccd4842e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:57.039172 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8368e5-f831-40ac-add8-e9463e0a0236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:57.039828 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8368e5-f831-40ac-add8-e9463e0a0236 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:57.040107 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8368e5-f831-40ac-add8-e9463e0a0236 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:57.040391 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8368e5-f831-40ac-add8-e9463e0a0236 None admin] PATH_INFO: `/v3/users/941738604a714d828a1cf19d308e994c` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:57.041575 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8368e5-f831-40ac-add8-e9463e0a0236 None admin] RBAC: Authorizing `identity:get_user(user_id=941738604a714d828a1cf19d308e994c)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:57.043042 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8368e5-f831-40ac-add8-e9463e0a0236 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:57.045600 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 127/248] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:45:56 2022] GET /identity/v3/users/941738604a714d828a1cf19d308e994c => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:45:57.048826 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de525806-412a-4187-b892-05e861d6fdb8 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:57.049365 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de525806-412a-4187-b892-05e861d6fdb8 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:57.049856 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de525806-412a-4187-b892-05e861d6fdb8 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:57.051376 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 128/249] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:45:57.052683 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de525806-412a-4187-b892-05e861d6fdb8 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:57.087622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:57.142643 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 122/250] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:45:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 15:45:57.143959 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d69276-0a9b-4cc1-9726-a7240eeda11b None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:57.144302 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d69276-0a9b-4cc1-9726-a7240eeda11b None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:57.144579 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d69276-0a9b-4cc1-9726-a7240eeda11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:57.167737 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-04d69276-0a9b-4cc1-9726-a7240eeda11b None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:57.168964 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-04d69276-0a9b-4cc1-9726-a7240eeda11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:45:57.199028 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de525806-412a-4187-b892-05e861d6fdb8 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:57.243822 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f37165-4f12-4608-a74b-b19e15fa22ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:57.244470 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f37165-4f12-4608-a74b-b19e15fa22ed None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:57.244750 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f37165-4f12-4608-a74b-b19e15fa22ed None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:57.245071 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f37165-4f12-4608-a74b-b19e15fa22ed None admin] PATH_INFO: `/v3/projects/7c5e57fbc705432ab1fdaa879674274e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:57.246192 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f37165-4f12-4608-a74b-b19e15fa22ed None admin] RBAC: Authorizing `identity:get_project(project_id=7c5e57fbc705432ab1fdaa879674274e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:57.247640 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f37165-4f12-4608-a74b-b19e15fa22ed None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:57.250115 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 129/251] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:45:57 2022] GET /identity/v3/projects/7c5e57fbc705432ab1fdaa879674274e => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:57.250724 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f37165-4f12-4608-a74b-b19e15fa22ed None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:57.258249 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 123/252] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:45:57.259558 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd85bb-8f7a-457c-9fa3-88fce70eef06 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:57.259888 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd85bb-8f7a-457c-9fa3-88fce70eef06 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:57.260168 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd85bb-8f7a-457c-9fa3-88fce70eef06 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:57.261728 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 124/253] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:45:57.262418 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd85bb-8f7a-457c-9fa3-88fce70eef06 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:57.274323 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:57.370932 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:57.383650 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f37165-4f12-4608-a74b-b19e15fa22ed None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:57.451671 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d3048-320a-4bae-9530-512543a0d9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:57.453176 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d3048-320a-4bae-9530-512543a0d9ae None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:57.453657 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d3048-320a-4bae-9530-512543a0d9ae None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:57.454136 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d3048-320a-4bae-9530-512543a0d9ae None admin] PATH_INFO: `/v3/projects/7c5e57fbc705432ab1fdaa879674274e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:57.455465 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654d3048-320a-4bae-9530-512543a0d9ae None admin] RBAC: Authorizing `identity:get_project(project_id=7c5e57fbc705432ab1fdaa879674274e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:57.457135 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654d3048-320a-4bae-9530-512543a0d9ae None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:57.460111 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 130/254] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:45:57 2022] GET /identity/v3/projects/7c5e57fbc705432ab1fdaa879674274e => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:57.463992 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f2fbb-0e92-4837-b354-efd4f91f5cf8 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:57.465232 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f2fbb-0e92-4837-b354-efd4f91f5cf8 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:57.467581 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f2fbb-0e92-4837-b354-efd4f91f5cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:57.482036 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd85bb-8f7a-457c-9fa3-88fce70eef06 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:57.505916 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-844f2fbb-0e92-4837-b354-efd4f91f5cf8 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:57.507018 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-844f2fbb-0e92-4837-b354-efd4f91f5cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:45:57.531302 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35769bd3-2dc0-496e-9219-6b8c968a2244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:57.531975 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35769bd3-2dc0-496e-9219-6b8c968a2244 None admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:57.532256 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35769bd3-2dc0-496e-9219-6b8c968a2244 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:57.532527 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35769bd3-2dc0-496e-9219-6b8c968a2244 None admin] PATH_INFO: `/v3/projects/7c5e57fbc705432ab1fdaa879674274e/users/941738604a714d828a1cf19d308e994c/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:57.536413 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35769bd3-2dc0-496e-9219-6b8c968a2244 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c5e57fbc705432ab1fdaa879674274e, user_id=941738604a714d828a1cf19d308e994c, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:57.537924 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35769bd3-2dc0-496e-9219-6b8c968a2244 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:57.562405 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 125/255] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 30 15:45:57 2022] PUT /identity/v3/projects/7c5e57fbc705432ab1fdaa879674274e/users/941738604a714d828a1cf19d308e994c/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:45:57.563263 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35769bd3-2dc0-496e-9219-6b8c968a2244 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:57.641006 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 131/256] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:45:57.643405 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f2fbb-0e92-4837-b354-efd4f91f5cf8 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:57.689665 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:57.748129 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35769bd3-2dc0-496e-9219-6b8c968a2244 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:57.788401 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06461a89-97c0-486a-9b3b-d2ae43e781b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:57.789078 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06461a89-97c0-486a-9b3b-d2ae43e781b2 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:57.789252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:57.789357 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06461a89-97c0-486a-9b3b-d2ae43e781b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:57.789624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06461a89-97c0-486a-9b3b-d2ae43e781b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:57.790800 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06461a89-97c0-486a-9b3b-d2ae43e781b2 None admin] RBAC: Adding query filter params (role.id=1e3d7a32e093474f86d5673fedf09dc5, scope.project.id=7c5e57fbc705432ab1fdaa879674274e, user.id=8a0ee8d1f353435086ac5ee57db5d043) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:57.791106 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06461a89-97c0-486a-9b3b-d2ae43e781b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:57.792706 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06461a89-97c0-486a-9b3b-d2ae43e781b2 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:57.800451 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 126/257] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:45:57 2022] GET /identity/v3/role_assignments?user.id=8a0ee8d1f353435086ac5ee57db5d043&scope.project.id=7c5e57fbc705432ab1fdaa879674274e&role.id=1e3d7a32e093474f86d5673fedf09dc5 => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:57.801505 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f2fbb-0e92-4837-b354-efd4f91f5cf8 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:57.868126 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214df13-3e3b-484c-91d5-9a169dac954d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:57.869057 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214df13-3e3b-484c-91d5-9a169dac954d None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:57.869475 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214df13-3e3b-484c-91d5-9a169dac954d None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:57.869881 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214df13-3e3b-484c-91d5-9a169dac954d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:57.886853 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3214df13-3e3b-484c-91d5-9a169dac954d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:45:57.892553 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-3214df13-3e3b-484c-91d5-9a169dac954d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:45:57.892553 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:45:57.892553 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:45:57.892553 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:45:57.892553 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:45:57.892553 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:45:57.892553 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:45:57.892553 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:45:57.892553 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:45:57.892553 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:45:57.892553 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:45:57.892553 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:45:57.892553 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:45:57.892553 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:45:57.892553 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:45:57.892553 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:45:57.893892 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:45:57.893892 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:45:57.893892 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:45:57.893892 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:45:57.893892 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:45:57.893892 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:45:57.893892 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:45:57.893892 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:45:57.893892 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:45:57.893892 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:45:57.893892 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:45:57.893892 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:45:57.893892 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:45:57.893892 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:45:57.893892 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:45:57.893892 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:45:57.894851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:45:57.894851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:45:57.894851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:45:57.894851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:45:57.894851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:45:57.894851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:45:57.894851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:45:57.894851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:45:57.894851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:45:57.894851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:45:57.894851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:45:57.894851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:45:57.901221 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 132/258] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 30 15:45:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:45:57.907552 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06461a89-97c0-486a-9b3b-d2ae43e781b2 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:58.058174 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06461a89-97c0-486a-9b3b-d2ae43e781b2 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:58.090062 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214df13-3e3b-484c-91d5-9a169dac954d None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:58.096119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:58.109070 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace30cc-5c2f-4a12-aeae-c9ae7c96df19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:58.109694 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace30cc-5c2f-4a12-aeae-c9ae7c96df19 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:58.109979 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace30cc-5c2f-4a12-aeae-c9ae7c96df19 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:58.110259 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace30cc-5c2f-4a12-aeae-c9ae7c96df19 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:58.110941 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace30cc-5c2f-4a12-aeae-c9ae7c96df19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:58.111644 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace30cc-5c2f-4a12-aeae-c9ae7c96df19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:58.112645 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace30cc-5c2f-4a12-aeae-c9ae7c96df19 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:58.122368 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 127/259] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:45:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:58.129233 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace30cc-5c2f-4a12-aeae-c9ae7c96df19 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:58.292095 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214df13-3e3b-484c-91d5-9a169dac954d None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:58.314879 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace30cc-5c2f-4a12-aeae-c9ae7c96df19 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:58.350915 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a35efa-47a2-402c-98c8-f379e6aa8509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:58.351931 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a35efa-47a2-402c-98c8-f379e6aa8509 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:58.353108 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a35efa-47a2-402c-98c8-f379e6aa8509 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:58.353736 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a35efa-47a2-402c-98c8-f379e6aa8509 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:58.375534 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d8193-fcfa-4771-a37d-d94137e847ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:58.376693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d8193-fcfa-4771-a37d-d94137e847ce None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:58.379154 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d8193-fcfa-4771-a37d-d94137e847ce None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:58.379639 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d8193-fcfa-4771-a37d-d94137e847ce None admin] PATH_INFO: `/v3/users/d6ec61573023416283703a9ad154c7ec` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:58.381746 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d8193-fcfa-4771-a37d-d94137e847ce None admin] RBAC: Authorizing `identity:get_user(user_id=d6ec61573023416283703a9ad154c7ec)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:58.389026 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a35efa-47a2-402c-98c8-f379e6aa8509 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:45:58.390820 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d8193-fcfa-4771-a37d-d94137e847ce None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:58.397865 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 128/260] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:45:58 2022] GET /identity/v3/users/d6ec61573023416283703a9ad154c7ec => generated 283 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:58.398836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-02a35efa-47a2-402c-98c8-f379e6aa8509 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 15:45:58.398836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:45:58.398836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:45:58.398836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:45:58.398836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:45:58.398836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:45:58.398836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:45:58.398836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:45:58.398836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:45:58.398836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:45:58.398836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:45:58.398836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:45:58.398836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:45:58.398836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:45:58.398836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:45:58.398836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:45:58.399694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:45:58.399694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:45:58.399694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:45:58.399694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:45:58.399694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:45:58.399694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:45:58.399694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:45:58.399694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:45:58.399694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:45:58.399694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:45:58.399694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:45:58.399694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:45:58.399694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:45:58.399694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:45:58.399694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:45:58.399694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:45:58.400488 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:45:58.400488 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:45:58.400488 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:45:58.400488 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:45:58.400488 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:45:58.400488 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:45:58.400488 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:45:58.400488 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:45:58.400488 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:45:58.400488 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:45:58.400488 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 15:45:58.400488 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:45:58.402881 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 133/261] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Aug 30 15:45:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:45:58.408642 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d8193-fcfa-4771-a37d-d94137e847ce None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:58.410579 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a35efa-47a2-402c-98c8-f379e6aa8509 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:58.447061 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:58.516337 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:58.595869 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d8193-fcfa-4771-a37d-d94137e847ce None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:58.630797 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a35efa-47a2-402c-98c8-f379e6aa8509 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:58.678825 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722f12f-eea0-45cf-b1d1-d090148e7447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:58.679444 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722f12f-eea0-45cf-b1d1-d090148e7447 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:58.679718 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722f12f-eea0-45cf-b1d1-d090148e7447 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:58.679982 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722f12f-eea0-45cf-b1d1-d090148e7447 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:58.680656 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d722f12f-eea0-45cf-b1d1-d090148e7447 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:58.680987 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d722f12f-eea0-45cf-b1d1-d090148e7447 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:58.682371 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d722f12f-eea0-45cf-b1d1-d090148e7447 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:58.700034 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 129/262] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:45:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:58.705674 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722f12f-eea0-45cf-b1d1-d090148e7447 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:58.719760 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510a1c5-2f01-4eef-8acd-0acec0ecae8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:58.719760 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510a1c5-2f01-4eef-8acd-0acec0ecae8b None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:58.719760 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510a1c5-2f01-4eef-8acd-0acec0ecae8b None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:58.719760 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510a1c5-2f01-4eef-8acd-0acec0ecae8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:58.847338 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0510a1c5-2f01-4eef-8acd-0acec0ecae8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:58.848878 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0510a1c5-2f01-4eef-8acd-0acec0ecae8b None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:58.865352 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:58.966897 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722f12f-eea0-45cf-b1d1-d090148e7447 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:58.996277 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:59.025479 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de89a83-0436-4a34-89e5-80637527c379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:59.026134 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de89a83-0436-4a34-89e5-80637527c379 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:59.026415 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de89a83-0436-4a34-89e5-80637527c379 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:59.026689 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de89a83-0436-4a34-89e5-80637527c379 None admin] PATH_INFO: `/v3/users/d6ec61573023416283703a9ad154c7ec` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:59.027968 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de89a83-0436-4a34-89e5-80637527c379 None admin] RBAC: Authorizing `identity:get_user(user_id=d6ec61573023416283703a9ad154c7ec)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:59.030097 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de89a83-0436-4a34-89e5-80637527c379 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:59.032135 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 130/263] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:45:58 2022] GET /identity/v3/users/d6ec61573023416283703a9ad154c7ec => generated 283 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:45:59.037406 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de89a83-0436-4a34-89e5-80637527c379 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:59.043092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 134/264] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:45:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 15:45:59.048744 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510a1c5-2f01-4eef-8acd-0acec0ecae8b None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:59.187624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de89a83-0436-4a34-89e5-80637527c379 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:59.241926 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8a8b0-a9f5-4e7d-9615-08a3fab21ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:59.242556 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8a8b0-a9f5-4e7d-9615-08a3fab21ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:59.242837 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8a8b0-a9f5-4e7d-9615-08a3fab21ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:59.243114 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8a8b0-a9f5-4e7d-9615-08a3fab21ee8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:59.341543 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:59.358378 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8a8b0-a9f5-4e7d-9615-08a3fab21ee8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:59.359987 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8a8b0-a9f5-4e7d-9615-08a3fab21ee8 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:59.361778 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510a1c5-2f01-4eef-8acd-0acec0ecae8b None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:59.389315 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:59.449612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71de2e1-5724-4406-8056-728ca28af1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:59.450185 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71de2e1-5724-4406-8056-728ca28af1b7 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:59.450468 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71de2e1-5724-4406-8056-728ca28af1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:59.450741 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71de2e1-5724-4406-8056-728ca28af1b7 None admin] PATH_INFO: `/v3/projects/7c5e57fbc705432ab1fdaa879674274e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:59.457508 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71de2e1-5724-4406-8056-728ca28af1b7 None admin] RBAC: Authorizing `identity:get_project(project_id=7c5e57fbc705432ab1fdaa879674274e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:59.459117 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71de2e1-5724-4406-8056-728ca28af1b7 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:59.460961 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 135/265] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:45:59 2022] GET /identity/v3/projects/7c5e57fbc705432ab1fdaa879674274e => generated 302 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:45:59.469703 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71de2e1-5724-4406-8056-728ca28af1b7 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:59.529639 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 131/266] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:45:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 15:45:59.534761 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5422299-606c-4911-a78d-661dda109a83 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:59.535047 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5422299-606c-4911-a78d-661dda109a83 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:59.535314 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5422299-606c-4911-a78d-661dda109a83 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:59.537275 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 132/267] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:45:59.543280 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5422299-606c-4911-a78d-661dda109a83 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:59.627683 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71de2e1-5724-4406-8056-728ca28af1b7 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:59.694981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933088c-0240-456e-9acb-0622fe9e3bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:59.696853 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933088c-0240-456e-9acb-0622fe9e3bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:59.697141 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933088c-0240-456e-9acb-0622fe9e3bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:59.697418 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933088c-0240-456e-9acb-0622fe9e3bd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:59.698159 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c933088c-0240-456e-9acb-0622fe9e3bd8 None admin] RBAC: Adding query filter params (role.id=676938e69210499ca11ee75dd572d0dc, scope.project.id=7c5e57fbc705432ab1fdaa879674274e, user.id=d6ec61573023416283703a9ad154c7ec) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:45:59.700752 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c933088c-0240-456e-9acb-0622fe9e3bd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:59.703088 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c933088c-0240-456e-9acb-0622fe9e3bd8 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:59.711091 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 136/268] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:45:59 2022] GET /identity/v3/role_assignments?user.id=d6ec61573023416283703a9ad154c7ec&scope.project.id=7c5e57fbc705432ab1fdaa879674274e&role.id=676938e69210499ca11ee75dd572d0dc => generated 608 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:59.712304 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868ec09-cb56-454f-af15-5646c9ab08e3 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:59.712582 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868ec09-cb56-454f-af15-5646c9ab08e3 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:59.712884 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868ec09-cb56-454f-af15-5646c9ab08e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:59.738370 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:59.750696 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-d868ec09-cb56-454f-af15-5646c9ab08e3 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:59.753914 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-d868ec09-cb56-454f-af15-5646c9ab08e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:45:59.768627 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5422299-606c-4911-a78d-661dda109a83 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:45:59.834007 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd8c65-6457-41c8-bcb0-bcdc2f94b700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:45:59.838866 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd8c65-6457-41c8-bcb0-bcdc2f94b700 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:59.839405 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd8c65-6457-41c8-bcb0-bcdc2f94b700 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:59.839929 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd8c65-6457-41c8-bcb0-bcdc2f94b700 None admin] PATH_INFO: `/v3/projects/7c5e57fbc705432ab1fdaa879674274e` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:59.843696 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd8c65-6457-41c8-bcb0-bcdc2f94b700 None admin] RBAC: Authorizing `identity:get_project(project_id=7c5e57fbc705432ab1fdaa879674274e)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:45:59.845151 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:45:59.845510 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd8c65-6457-41c8-bcb0-bcdc2f94b700 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:45:59.847274 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 133/269] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:45:59 2022] GET /identity/v3/projects/7c5e57fbc705432ab1fdaa879674274e => generated 302 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:45:59.852887 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d9cd9-584c-4caa-a03d-b24049436adc None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:59.853169 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d9cd9-584c-4caa-a03d-b24049436adc None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:59.853439 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d9cd9-584c-4caa-a03d-b24049436adc None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:59.856158 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 134/270] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:45:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:45:59.857040 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d9cd9-584c-4caa-a03d-b24049436adc None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:45:59.914069 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 137/271] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:45:59.915359 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1327a-e2bd-40d8-a133-dadf82c347b9 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:45:59.915691 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1327a-e2bd-40d8-a133-dadf82c347b9 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:45:59.915960 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1327a-e2bd-40d8-a133-dadf82c347b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:45:59.948112 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-c1e1327a-e2bd-40d8-a133-dadf82c347b9 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:45:59.949314 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c1e1327a-e2bd-40d8-a133-dadf82c347b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:00.056368 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 138/272] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:45:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:46:00.094456 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d9cd9-584c-4caa-a03d-b24049436adc None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:00.155074 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761303c3-45e7-49af-8f8c-4825bb4a9e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:00.156076 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761303c3-45e7-49af-8f8c-4825bb4a9e20 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:00.156553 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761303c3-45e7-49af-8f8c-4825bb4a9e20 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:00.157063 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761303c3-45e7-49af-8f8c-4825bb4a9e20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:00.157995 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761303c3-45e7-49af-8f8c-4825bb4a9e20 None admin] RBAC: Adding query filter params (role.id=3e70c1b76757442a9bddbeab151c6fc6, scope.project.id=7c5e57fbc705432ab1fdaa879674274e, user.id=d6ec61573023416283703a9ad154c7ec) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:00.158498 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761303c3-45e7-49af-8f8c-4825bb4a9e20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:00.160156 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761303c3-45e7-49af-8f8c-4825bb4a9e20 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:00.169275 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 135/273] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:45:59 2022] GET /identity/v3/role_assignments?user.id=d6ec61573023416283703a9ad154c7ec&scope.project.id=7c5e57fbc705432ab1fdaa879674274e&role.id=3e70c1b76757442a9bddbeab151c6fc6 => generated 608 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:00.259986 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1327a-e2bd-40d8-a133-dadf82c347b9 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:00.334827 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cf02d-5dcb-4170-86fc-bad1b49983f7 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:00.335154 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cf02d-5dcb-4170-86fc-bad1b49983f7 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:00.335371 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cf02d-5dcb-4170-86fc-bad1b49983f7 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:00.337005 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 136/274] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:00.342547 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e22476-c831-461a-87f7-5c44edc82cf8 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:00.342827 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e22476-c831-461a-87f7-5c44edc82cf8 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:00.343100 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e22476-c831-461a-87f7-5c44edc82cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:00.388600 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1327a-e2bd-40d8-a133-dadf82c347b9 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:00.392194 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:00.394227 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-c4e22476-c831-461a-87f7-5c44edc82cf8 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:00.395475 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-c4e22476-c831-461a-87f7-5c44edc82cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:00.430140 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:00.431134 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4de106-1a6e-4213-9714-0c17c0e968d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:00.431597 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4de106-1a6e-4213-9714-0c17c0e968d0 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:00.432494 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4de106-1a6e-4213-9714-0c17c0e968d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:00.432494 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4de106-1a6e-4213-9714-0c17c0e968d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:00.445177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4de106-1a6e-4213-9714-0c17c0e968d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:00.449983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-3f4de106-1a6e-4213-9714-0c17c0e968d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 15:46:00.449983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:00.449983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:00.449983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:00.449983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:00.449983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:00.449983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:00.449983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:00.449983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:00.449983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:00.449983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:00.449983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:00.449983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:00.449983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:00.449983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:00.449983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:00.451041 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:00.451041 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:00.451041 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:00.451041 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:00.451041 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:00.451041 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:00.451041 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:00.451041 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:00.451041 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:00.451041 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:00.451041 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:00.451041 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:00.451041 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:00.451041 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:00.451041 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:00.451041 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:00.451823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:00.451823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:00.451823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:00.451823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:00.451823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:00.451823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:00.451823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:00.451823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:00.451823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:00.451823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:00.451823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 15:46:00.451823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:00.451823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 139/275] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:46:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:00.452567 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4de106-1a6e-4213-9714-0c17c0e968d0 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:00.496147 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 137/276] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 15:46:00.497371 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3901ffb-dd06-4381-ae2c-9e4f12a0da90 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:00.497657 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3901ffb-dd06-4381-ae2c-9e4f12a0da90 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:00.498552 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3901ffb-dd06-4381-ae2c-9e4f12a0da90 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:00.499804 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 138/277] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:00.500510 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3901ffb-dd06-4381-ae2c-9e4f12a0da90 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:00.566815 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4de106-1a6e-4213-9714-0c17c0e968d0 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:00.602621 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eccdf7c-0712-4de3-b366-6e9ea2fb439c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:00.603177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eccdf7c-0712-4de3-b366-6e9ea2fb439c None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:00.603456 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eccdf7c-0712-4de3-b366-6e9ea2fb439c None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:00.603725 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eccdf7c-0712-4de3-b366-6e9ea2fb439c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:00.604845 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eccdf7c-0712-4de3-b366-6e9ea2fb439c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:00.606310 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eccdf7c-0712-4de3-b366-6e9ea2fb439c None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:00.608502 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 140/278] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:00.609635 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252e1d8-5c00-4bf7-8ed8-4795eb784288 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:00.609918 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252e1d8-5c00-4bf7-8ed8-4795eb784288 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:00.610190 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252e1d8-5c00-4bf7-8ed8-4795eb784288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:00.621270 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3901ffb-dd06-4381-ae2c-9e4f12a0da90 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:00.628166 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-b252e1d8-5c00-4bf7-8ed8-4795eb784288 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:00.629375 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-b252e1d8-5c00-4bf7-8ed8-4795eb784288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:00.657699 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:00.659277 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ef5b3-55c3-4cc6-a0b0-dc02a82aa92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:00.659953 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ef5b3-55c3-4cc6-a0b0-dc02a82aa92d None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:00.660208 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ef5b3-55c3-4cc6-a0b0-dc02a82aa92d None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:00.660718 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ef5b3-55c3-4cc6-a0b0-dc02a82aa92d None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:00.661470 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ef5b3-55c3-4cc6-a0b0-dc02a82aa92d None admin] RBAC: Adding query filter params (name=member) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:00.661808 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ef5b3-55c3-4cc6-a0b0-dc02a82aa92d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:00.663198 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ef5b3-55c3-4cc6-a0b0-dc02a82aa92d None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:00.672982 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 139/279] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 30 15:46:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:00.673936 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ef5b3-55c3-4cc6-a0b0-dc02a82aa92d None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:00.690922 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:00.712961 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 141/280] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:46:00.712961 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252e1d8-5c00-4bf7-8ed8-4795eb784288 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:00.797335 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ef5b3-55c3-4cc6-a0b0-dc02a82aa92d None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:00.830046 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e991b7-8dd3-4fa5-95c2-b4c1b40094a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:00.830653 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e991b7-8dd3-4fa5-95c2-b4c1b40094a5 None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:00.830934 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e991b7-8dd3-4fa5-95c2-b4c1b40094a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:00.831207 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e991b7-8dd3-4fa5-95c2-b4c1b40094a5 None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:00.831856 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e991b7-8dd3-4fa5-95c2-b4c1b40094a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:00.832149 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252e1d8-5c00-4bf7-8ed8-4795eb784288 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:00.833410 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e991b7-8dd3-4fa5-95c2-b4c1b40094a5 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:00.858055 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 140/281] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Aug 30 15:46:00 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:46:00.861759 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e991b7-8dd3-4fa5-95c2-b4c1b40094a5 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:00.892415 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6d7f5-8d30-4d59-acc3-0d85ab25de34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:00.893353 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6d7f5-8d30-4d59-acc3-0d85ab25de34 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:00.893834 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6d7f5-8d30-4d59-acc3-0d85ab25de34 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:00.894288 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6d7f5-8d30-4d59-acc3-0d85ab25de34 None admin] PATH_INFO: `/v3/users/5ba116e322a540928c918db8a25ff5ec` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:00.918109 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6d7f5-8d30-4d59-acc3-0d85ab25de34 None admin] RBAC: Authorizing `identity:get_user(user_id=5ba116e322a540928c918db8a25ff5ec)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:00.919651 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6d7f5-8d30-4d59-acc3-0d85ab25de34 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:00.927596 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 142/282] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:46:00 2022] GET /identity/v3/users/5ba116e322a540928c918db8a25ff5ec => generated 293 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:00.928629 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6d7f5-8d30-4d59-acc3-0d85ab25de34 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:00.957033 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:00.978539 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:01.025985 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e991b7-8dd3-4fa5-95c2-b4c1b40094a5 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:01.053398 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6d7f5-8d30-4d59-acc3-0d85ab25de34 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:01.066441 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a647a49-697e-4735-b309-8062643d1ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:01.067087 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a647a49-697e-4735-b309-8062643d1ad8 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:01.067367 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a647a49-697e-4735-b309-8062643d1ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:01.067637 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a647a49-697e-4735-b309-8062643d1ad8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:01.079731 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a647a49-697e-4735-b309-8062643d1ad8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:01.086891 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-4a647a49-697e-4735-b309-8062643d1ad8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 15:46:01.086891 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:01.086891 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:01.086891 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:01.086891 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:01.086891 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:01.086891 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:01.086891 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:01.086891 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:01.086891 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:01.086891 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:01.086891 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:01.086891 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:01.086891 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:01.086891 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:01.086891 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:01.087883 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:01.087883 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:01.087883 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:01.087883 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:01.087883 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:01.087883 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:01.087883 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:01.087883 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:01.087883 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:01.087883 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:01.087883 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:01.087883 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:01.087883 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:01.087883 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:01.087883 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:01.087883 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:01.088908 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:01.088908 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:01.088908 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:01.088908 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:01.088908 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:01.088908 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:01.088908 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:01.088908 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:01.088908 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:01.088908 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:01.088908 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 15:46:01.088908 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:01.088908 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 141/283] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:46:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:01.089655 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a647a49-697e-4735-b309-8062643d1ad8 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:01.103785 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0bf567-26c1-423f-b7fe-519cf469f41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:01.104745 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bf567-26c1-423f-b7fe-519cf469f41f None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:01.106170 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bf567-26c1-423f-b7fe-519cf469f41f None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:01.106433 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bf567-26c1-423f-b7fe-519cf469f41f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:01.107662 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0bf567-26c1-423f-b7fe-519cf469f41f None admin] RBAC: Adding query filter params (role.id=a82e6f447c1b4b56b530dacfae06dee1, user.id=5ba116e322a540928c918db8a25ff5ec, scope.system=all) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:01.107965 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0bf567-26c1-423f-b7fe-519cf469f41f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:01.110845 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0bf567-26c1-423f-b7fe-519cf469f41f None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:01.115473 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 143/284] 10.222.0.25 () {56 vars in 1308 bytes} [Tue Aug 30 15:46:00 2022] GET /identity/v3/role_assignments?user.id=5ba116e322a540928c918db8a25ff5ec&scope.system=all&role.id=a82e6f447c1b4b56b530dacfae06dee1 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:01.116524 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0bf567-26c1-423f-b7fe-519cf469f41f None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:01.228275 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:01.241756 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a647a49-697e-4735-b309-8062643d1ad8 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:01.248680 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0bf567-26c1-423f-b7fe-519cf469f41f None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:01.277208 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:01.289613 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36c7e3-c28f-40be-a2fc-4666e3e29f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:01.290266 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36c7e3-c28f-40be-a2fc-4666e3e29f7a None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:01.290528 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36c7e3-c28f-40be-a2fc-4666e3e29f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:01.290801 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36c7e3-c28f-40be-a2fc-4666e3e29f7a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:01.292233 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da8211-ec89-4764-afdd-6bb387fa34ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:01.293091 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da8211-ec89-4764-afdd-6bb387fa34ef None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:01.293591 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da8211-ec89-4764-afdd-6bb387fa34ef None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:01.293928 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da8211-ec89-4764-afdd-6bb387fa34ef None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:01.295530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da8211-ec89-4764-afdd-6bb387fa34ef None admin] RBAC: Adding query filter params (name=member) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:01.295837 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da8211-ec89-4764-afdd-6bb387fa34ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:01.297275 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da8211-ec89-4764-afdd-6bb387fa34ef None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:01.303190 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a36c7e3-c28f-40be-a2fc-4666e3e29f7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:01.307940 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 144/285] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 30 15:46:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:01.309220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-2a36c7e3-c28f-40be-a2fc-4666e3e29f7a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 15:46:01.309220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:01.309220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:01.309220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:01.309220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:01.309220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:01.309220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:01.309220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:01.309220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:01.309220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:01.309220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:01.309220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:01.309220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:01.309220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:01.309220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:01.309220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:01.310085 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:01.310085 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:01.310085 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:01.310085 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:01.310085 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:01.310085 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:01.310085 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:01.310085 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:01.310085 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:01.310085 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:01.310085 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:01.310085 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:01.310085 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:01.310085 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:01.310085 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:01.310085 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:01.310951 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:01.310951 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:01.310951 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:01.310951 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:01.310951 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:01.310951 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:01.310951 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:01.310951 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:01.310951 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:01.310951 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:01.310951 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 15:46:01.310951 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:01.310951 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 142/286] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:46:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:01.313633 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da8211-ec89-4764-afdd-6bb387fa34ef None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:01.316500 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36c7e3-c28f-40be-a2fc-4666e3e29f7a None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:01.493171 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da8211-ec89-4764-afdd-6bb387fa34ef None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:01.509144 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36c7e3-c28f-40be-a2fc-4666e3e29f7a None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:01.550221 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d482376-2546-466c-b056-db64370086f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:01.550845 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d482376-2546-466c-b056-db64370086f2 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:01.551132 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d482376-2546-466c-b056-db64370086f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:01.551408 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d482376-2546-466c-b056-db64370086f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:01.552084 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d482376-2546-466c-b056-db64370086f2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:01.552385 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d482376-2546-466c-b056-db64370086f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:01.553963 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d482376-2546-466c-b056-db64370086f2 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:01.563313 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 143/287] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 30 15:46:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:46:01.569140 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d482376-2546-466c-b056-db64370086f2 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:01.583106 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4f109-3078-4396-a114-62249730f1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:01.583749 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4f109-3078-4396-a114-62249730f1db None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:01.584024 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4f109-3078-4396-a114-62249730f1db None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:01.584341 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4f109-3078-4396-a114-62249730f1db None admin] PATH_INFO: `/v3/users/941738604a714d828a1cf19d308e994c` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:01.587251 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c4f109-3078-4396-a114-62249730f1db None admin] RBAC: Authorizing `identity:get_user(user_id=941738604a714d828a1cf19d308e994c)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:01.588698 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c4f109-3078-4396-a114-62249730f1db None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:01.590353 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 145/288] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:46:01 2022] GET /identity/v3/users/941738604a714d828a1cf19d308e994c => generated 297 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:01.597908 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4f109-3078-4396-a114-62249730f1db None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:01.625158 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:01.657827 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:01.720378 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d482376-2546-466c-b056-db64370086f2 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:01.758103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0791a3-7419-4c7a-a420-72c0509c7e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:01.759192 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0791a3-7419-4c7a-a420-72c0509c7e4e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:01.759672 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0791a3-7419-4c7a-a420-72c0509c7e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:01.760144 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0791a3-7419-4c7a-a420-72c0509c7e4e None admin] PATH_INFO: `/v3/users/8a0ee8d1f353435086ac5ee57db5d043` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:01.761971 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0791a3-7419-4c7a-a420-72c0509c7e4e None admin] RBAC: Authorizing `identity:get_user(user_id=8a0ee8d1f353435086ac5ee57db5d043)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:01.764590 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0791a3-7419-4c7a-a420-72c0509c7e4e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:01.766995 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 144/289] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:46:01 2022] GET /identity/v3/users/8a0ee8d1f353435086ac5ee57db5d043 => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:46:01.772990 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0791a3-7419-4c7a-a420-72c0509c7e4e None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:01.795284 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4f109-3078-4396-a114-62249730f1db None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:01.881577 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0791a3-7419-4c7a-a420-72c0509c7e4e None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:01.905349 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:01.913064 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1db3c9-6a12-46c9-a21a-d93530ef3de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:01.913903 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1db3c9-6a12-46c9-a21a-d93530ef3de7 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:01.914012 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1db3c9-6a12-46c9-a21a-d93530ef3de7 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:01.914219 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1db3c9-6a12-46c9-a21a-d93530ef3de7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:01.928895 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c431a-de94-436f-b6f2-221583a5ec65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:01.929829 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c431a-de94-436f-b6f2-221583a5ec65 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:01.930306 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c431a-de94-436f-b6f2-221583a5ec65 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:01.930791 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c431a-de94-436f-b6f2-221583a5ec65 None admin] PATH_INFO: `/v3/projects/7c5e57fbc705432ab1fdaa879674274e` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:01.934290 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c431a-de94-436f-b6f2-221583a5ec65 None admin] RBAC: Authorizing `identity:get_project(project_id=7c5e57fbc705432ab1fdaa879674274e)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:01.936761 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c431a-de94-436f-b6f2-221583a5ec65 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:01.940531 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 145/290] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:46:01 2022] GET /identity/v3/projects/7c5e57fbc705432ab1fdaa879674274e => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:01.946499 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c431a-de94-436f-b6f2-221583a5ec65 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:02.061530 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c431a-de94-436f-b6f2-221583a5ec65 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:02.093792 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1db3c9-6a12-46c9-a21a-d93530ef3de7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:02.095285 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1db3c9-6a12-46c9-a21a-d93530ef3de7 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:02.102694 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c3d77-b234-4cf6-92e4-a1b53d8e1715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:02.103590 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c3d77-b234-4cf6-92e4-a1b53d8e1715 None admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:02.104045 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c3d77-b234-4cf6-92e4-a1b53d8e1715 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:02.104513 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c3d77-b234-4cf6-92e4-a1b53d8e1715 None admin] PATH_INFO: `/v3/projects/7c5e57fbc705432ab1fdaa879674274e/users/8a0ee8d1f353435086ac5ee57db5d043/roles/1e3d7a32e093474f86d5673fedf09dc5` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:02.106692 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608c3d77-b234-4cf6-92e4-a1b53d8e1715 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c5e57fbc705432ab1fdaa879674274e, user_id=8a0ee8d1f353435086ac5ee57db5d043, role_id=1e3d7a32e093474f86d5673fedf09dc5)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:02.109373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608c3d77-b234-4cf6-92e4-a1b53d8e1715 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:02.133076 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 146/291] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 30 15:46:01 2022] PUT /identity/v3/projects/7c5e57fbc705432ab1fdaa879674274e/users/8a0ee8d1f353435086ac5ee57db5d043/roles/1e3d7a32e093474f86d5673fedf09dc5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:46:02.140768 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:02.282288 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 146/292] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:46:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 685 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 15:46:02.288165 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c3d77-b234-4cf6-92e4-a1b53d8e1715 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:02.350886 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:02.411121 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c3d77-b234-4cf6-92e4-a1b53d8e1715 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:02.448868 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd89c6f-8472-4110-aa36-7cb5457f50f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:02.449930 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd89c6f-8472-4110-aa36-7cb5457f50f2 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:02.450413 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd89c6f-8472-4110-aa36-7cb5457f50f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:02.451461 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd89c6f-8472-4110-aa36-7cb5457f50f2 None admin] PATH_INFO: `/v3/projects/7c5e57fbc705432ab1fdaa879674274e` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:02.453014 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd89c6f-8472-4110-aa36-7cb5457f50f2 None admin] RBAC: Authorizing `identity:get_project(project_id=7c5e57fbc705432ab1fdaa879674274e)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:02.454745 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd89c6f-8472-4110-aa36-7cb5457f50f2 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:02.456724 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 147/293] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:46:02 2022] GET /identity/v3/projects/7c5e57fbc705432ab1fdaa879674274e => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:02.462905 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1db3c9-6a12-46c9-a21a-d93530ef3de7 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:02.612600 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1db3c9-6a12-46c9-a21a-d93530ef3de7 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:02.636759 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:02.666548 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ac99b-bb17-43de-99ce-a2fc40373a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:02.667170 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ac99b-bb17-43de-99ce-a2fc40373a74 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:02.667450 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ac99b-bb17-43de-99ce-a2fc40373a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:02.667724 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ac99b-bb17-43de-99ce-a2fc40373a74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:02.668453 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368ac99b-bb17-43de-99ce-a2fc40373a74 None admin] RBAC: Adding query filter params (role.id=a82e6f447c1b4b56b530dacfae06dee1, scope.project.id=7c5e57fbc705432ab1fdaa879674274e, user.id=941738604a714d828a1cf19d308e994c) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:02.668760 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368ac99b-bb17-43de-99ce-a2fc40373a74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:02.670767 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368ac99b-bb17-43de-99ce-a2fc40373a74 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:02.684200 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 147/294] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:46:02 2022] GET /identity/v3/role_assignments?user.id=941738604a714d828a1cf19d308e994c&scope.project.id=7c5e57fbc705432ab1fdaa879674274e&role.id=a82e6f447c1b4b56b530dacfae06dee1 => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:03.123563 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5553500-00c4-49fa-aaf6-2feb027e6c6c None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:03.124420 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5553500-00c4-49fa-aaf6-2feb027e6c6c None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:03.124696 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5553500-00c4-49fa-aaf6-2feb027e6c6c None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:03.126206 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 148/295] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:03.131908 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa55cf1-4abb-4a82-9444-f55ad0408df8 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:03.132320 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa55cf1-4abb-4a82-9444-f55ad0408df8 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:03.132491 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa55cf1-4abb-4a82-9444-f55ad0408df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:03.155522 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-8aa55cf1-4abb-4a82-9444-f55ad0408df8 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:03.156768 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-8aa55cf1-4abb-4a82-9444-f55ad0408df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:03.237448 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 148/296] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 15:46:03.328330 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2cc3e-e6e5-43e6-95c2-fd1cf2e86034 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:03.328717 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2cc3e-e6e5-43e6-95c2-fd1cf2e86034 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:03.328911 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2cc3e-e6e5-43e6-95c2-fd1cf2e86034 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:03.330594 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 149/297] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:03.336020 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547f31e-f245-4e70-ac8d-0546cabe4a2e None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:03.336304 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547f31e-f245-4e70-ac8d-0546cabe4a2e None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:03.336576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547f31e-f245-4e70-ac8d-0546cabe4a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:03.358098 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-8547f31e-f245-4e70-ac8d-0546cabe4a2e None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:03.359501 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-8547f31e-f245-4e70-ac8d-0546cabe4a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:03.430122 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 149/298] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:46:03.441601 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255dcd4a-3030-4c5d-91bf-36702061b922 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:03.441881 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255dcd4a-3030-4c5d-91bf-36702061b922 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:03.442155 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255dcd4a-3030-4c5d-91bf-36702061b922 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:03.443745 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 150/299] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:03.448677 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f0fa4-460b-478e-99cd-48f2811451b5 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:03.448998 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f0fa4-460b-478e-99cd-48f2811451b5 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:03.449269 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f0fa4-460b-478e-99cd-48f2811451b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:03.468427 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-881f0fa4-460b-478e-99cd-48f2811451b5 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:03.469671 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-881f0fa4-460b-478e-99cd-48f2811451b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:03.499590 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:03.532658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255dcd4a-3030-4c5d-91bf-36702061b922 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:03.548823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 150/300] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:46:03.651073 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255dcd4a-3030-4c5d-91bf-36702061b922 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:03.667299 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:03.689432 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728499ee-ca7e-454e-a281-7cc23ff9ca33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:03.690043 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728499ee-ca7e-454e-a281-7cc23ff9ca33 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:03.690325 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728499ee-ca7e-454e-a281-7cc23ff9ca33 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:03.690596 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728499ee-ca7e-454e-a281-7cc23ff9ca33 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:03.702215 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728499ee-ca7e-454e-a281-7cc23ff9ca33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:03.705432 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f0fa4-460b-478e-99cd-48f2811451b5 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:03.707228 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-728499ee-ca7e-454e-a281-7cc23ff9ca33 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 15:46:03.707228 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:03.707228 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:03.707228 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:03.707228 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:03.707228 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:03.707228 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:03.707228 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:03.707228 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:03.707228 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:03.707228 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:03.707228 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:03.707228 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:03.707228 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:03.707228 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:03.707228 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:03.708060 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:03.708060 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:03.708060 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:03.708060 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:03.708060 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:03.708060 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:03.708060 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:03.708060 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:03.708060 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:03.708060 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:03.708060 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:03.708060 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:03.708060 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:03.708060 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:03.708060 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:03.708060 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:03.708862 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:03.708862 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:03.708862 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:03.708862 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:03.708862 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:03.708862 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:03.708862 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:03.708862 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:03.708862 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:03.708862 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:03.708862 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 15:46:03.708862 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:03.708862 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 151/301] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:46:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:03.714018 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728499ee-ca7e-454e-a281-7cc23ff9ca33 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:03.815696 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728499ee-ca7e-454e-a281-7cc23ff9ca33 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:03.825379 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f0fa4-460b-478e-99cd-48f2811451b5 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:03.850701 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdc92c-b2bd-445c-80e6-005ecc4134e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:03.851319 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdc92c-b2bd-445c-80e6-005ecc4134e1 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:03.851601 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdc92c-b2bd-445c-80e6-005ecc4134e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:03.851871 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdc92c-b2bd-445c-80e6-005ecc4134e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:03.852575 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cdc92c-b2bd-445c-80e6-005ecc4134e1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:03.852899 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cdc92c-b2bd-445c-80e6-005ecc4134e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:03.854272 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cdc92c-b2bd-445c-80e6-005ecc4134e1 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:03.862472 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 152/302] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 30 15:46:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:46:03.864382 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c0b78-fc1e-4171-b0eb-c255ce33f99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:03.865253 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c0b78-fc1e-4171-b0eb-c255ce33f99d None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:03.865725 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c0b78-fc1e-4171-b0eb-c255ce33f99d None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:03.865826 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdc92c-b2bd-445c-80e6-005ecc4134e1 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:03.866416 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c0b78-fc1e-4171-b0eb-c255ce33f99d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:03.879314 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c0b78-fc1e-4171-b0eb-c255ce33f99d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:03.884120 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-951c0b78-fc1e-4171-b0eb-c255ce33f99d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 15:46:03.884120 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:03.884120 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:03.884120 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:03.884120 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:03.884120 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:03.884120 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:03.884120 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:03.884120 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:03.884120 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:03.884120 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:03.884120 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:03.884120 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:03.884120 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:03.884120 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:03.884120 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:03.885057 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:03.885057 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:03.885057 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:03.885057 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:03.885057 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:03.885057 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:03.885057 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:03.885057 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:03.885057 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:03.885057 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:03.885057 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:03.885057 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:03.885057 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:03.885057 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:03.885057 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:03.885057 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:03.885834 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:03.885834 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:03.885834 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:03.885834 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:03.885834 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:03.885834 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:03.885834 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:03.885834 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:03.885834 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:03.885834 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:03.885834 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 15:46:03.885834 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:03.885834 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 151/303] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:46:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:03.886458 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c0b78-fc1e-4171-b0eb-c255ce33f99d None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:03.913216 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:03.921014 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:03.986333 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdc92c-b2bd-445c-80e6-005ecc4134e1 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:03.992886 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c0b78-fc1e-4171-b0eb-c255ce33f99d None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:04.024202 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3d5da-ae1b-4774-812b-2ddf79e001a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:04.024867 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3d5da-ae1b-4774-812b-2ddf79e001a4 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:04.025149 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3d5da-ae1b-4774-812b-2ddf79e001a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:04.025426 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3d5da-ae1b-4774-812b-2ddf79e001a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:04.026638 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde3d5da-ae1b-4774-812b-2ddf79e001a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:04.028086 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde3d5da-ae1b-4774-812b-2ddf79e001a4 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:04.029746 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 153/304] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:04.030496 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3d5da-ae1b-4774-812b-2ddf79e001a4 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:04.031380 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9238c99-7cad-4f6a-b2fa-31f35dfa2908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:04.032211 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9238c99-7cad-4f6a-b2fa-31f35dfa2908 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:04.032655 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9238c99-7cad-4f6a-b2fa-31f35dfa2908 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:04.033122 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9238c99-7cad-4f6a-b2fa-31f35dfa2908 None admin] PATH_INFO: `/v3/users/b387ef5b328f441baa864c612008b953` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:04.048567 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9238c99-7cad-4f6a-b2fa-31f35dfa2908 None admin] RBAC: Authorizing `identity:get_user(user_id=b387ef5b328f441baa864c612008b953)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:04.050131 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9238c99-7cad-4f6a-b2fa-31f35dfa2908 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:04.051782 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 152/305] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:46:03 2022] GET /identity/v3/users/b387ef5b328f441baa864c612008b953 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:04.052580 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9238c99-7cad-4f6a-b2fa-31f35dfa2908 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:04.144050 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:04.145619 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3d5da-ae1b-4774-812b-2ddf79e001a4 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:04.148175 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:04.161986 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9238c99-7cad-4f6a-b2fa-31f35dfa2908 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:04.182310 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d5eae5-06ac-4b5d-9438-43b9377a1e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:04.182918 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5eae5-06ac-4b5d-9438-43b9377a1e32 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:04.183199 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5eae5-06ac-4b5d-9438-43b9377a1e32 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:04.183468 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5eae5-06ac-4b5d-9438-43b9377a1e32 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:04.184133 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d5eae5-06ac-4b5d-9438-43b9377a1e32 None admin] RBAC: Adding query filter params (name=member) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:04.184437 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d5eae5-06ac-4b5d-9438-43b9377a1e32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:04.186725 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d5eae5-06ac-4b5d-9438-43b9377a1e32 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:04.194942 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 154/306] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 30 15:46:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:04.195749 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d5eae5-06ac-4b5d-9438-43b9377a1e32 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:04.204152 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15f014-9144-45ab-8749-e805bba9eb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:04.204776 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15f014-9144-45ab-8749-e805bba9eb05 None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:04.205097 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15f014-9144-45ab-8749-e805bba9eb05 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:04.205371 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15f014-9144-45ab-8749-e805bba9eb05 None admin] PATH_INFO: `/v3/groups` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:04.206003 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15f014-9144-45ab-8749-e805bba9eb05 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:04.207445 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15f014-9144-45ab-8749-e805bba9eb05 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:04.223073 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 153/307] 10.222.0.25 () {60 vars in 1134 bytes} [Tue Aug 30 15:46:04 2022] POST /identity/v3/groups => generated 229 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:46:04.234198 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15f014-9144-45ab-8749-e805bba9eb05 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:04.321688 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d5eae5-06ac-4b5d-9438-43b9377a1e32 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:04.363926 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15f014-9144-45ab-8749-e805bba9eb05 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:04.368921 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a32a0-eac2-4a82-b912-7aa7f49b454e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:04.369614 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a32a0-eac2-4a82-b912-7aa7f49b454e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:04.369975 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a32a0-eac2-4a82-b912-7aa7f49b454e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:04.370314 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a32a0-eac2-4a82-b912-7aa7f49b454e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:04.371125 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a32a0-eac2-4a82-b912-7aa7f49b454e None admin] RBAC: Adding query filter params (role.id=1e3d7a32e093474f86d5673fedf09dc5, user.id=b387ef5b328f441baa864c612008b953, scope.system=all) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:04.371506 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a32a0-eac2-4a82-b912-7aa7f49b454e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:04.373145 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a32a0-eac2-4a82-b912-7aa7f49b454e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:04.379132 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 155/308] 10.222.0.25 () {56 vars in 1308 bytes} [Tue Aug 30 15:46:04 2022] GET /identity/v3/role_assignments?user.id=b387ef5b328f441baa864c612008b953&scope.system=all&role.id=1e3d7a32e093474f86d5673fedf09dc5 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:04.410845 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d75244-5fa0-4aba-9045-b3d9ec188218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:04.411903 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d75244-5fa0-4aba-9045-b3d9ec188218 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:04.412365 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d75244-5fa0-4aba-9045-b3d9ec188218 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:04.412850 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d75244-5fa0-4aba-9045-b3d9ec188218 None admin] PATH_INFO: `/v3/users/5ba116e322a540928c918db8a25ff5ec` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:04.414353 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d75244-5fa0-4aba-9045-b3d9ec188218 None admin] RBAC: Authorizing `identity:get_user(user_id=5ba116e322a540928c918db8a25ff5ec)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:04.416138 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d75244-5fa0-4aba-9045-b3d9ec188218 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:04.418114 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 154/309] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:46:04 2022] GET /identity/v3/users/5ba116e322a540928c918db8a25ff5ec => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:04.425267 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a32a0-eac2-4a82-b912-7aa7f49b454e None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:04.465044 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:04.533491 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b019ba-e6ec-4763-a748-eb724909e4ad None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:04.533795 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b019ba-e6ec-4763-a748-eb724909e4ad None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:04.534059 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b019ba-e6ec-4763-a748-eb724909e4ad None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:04.536144 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 155/310] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 15:46:04.541019 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d0643-c4ac-4c75-929f-ecfe9223df8c None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:04.541302 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d0643-c4ac-4c75-929f-ecfe9223df8c None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:04.541576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d0643-c4ac-4c75-929f-ecfe9223df8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:04.547758 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a32a0-eac2-4a82-b912-7aa7f49b454e None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:04.560929 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-801d0643-c4ac-4c75-929f-ecfe9223df8c None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:04.562200 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-801d0643-c4ac-4c75-929f-ecfe9223df8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:04.572287 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:04.588495 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b90c6-ea8f-4c3b-a82c-10f8ba9b9740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:04.589186 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b90c6-ea8f-4c3b-a82c-10f8ba9b9740 None admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:04.589462 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b90c6-ea8f-4c3b-a82c-10f8ba9b9740 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:04.589737 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b90c6-ea8f-4c3b-a82c-10f8ba9b9740 None admin] PATH_INFO: `/v3/system/users/5ba116e322a540928c918db8a25ff5ec/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:04.591158 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9b90c6-ea8f-4c3b-a82c-10f8ba9b9740 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5ba116e322a540928c918db8a25ff5ec, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:04.592606 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9b90c6-ea8f-4c3b-a82c-10f8ba9b9740 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:04.605472 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 156/311] 10.222.0.25 () {58 vars in 1334 bytes} [Tue Aug 30 15:46:04 2022] PUT /identity/v3/system/users/5ba116e322a540928c918db8a25ff5ec/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:46:04.658665 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 156/312] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 15:46:04.945905 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b90c6-ea8f-4c3b-a82c-10f8ba9b9740 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:05.046239 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:05.054468 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b90c6-ea8f-4c3b-a82c-10f8ba9b9740 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:05.092211 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b4157-d9a2-4064-8055-cc7734653c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:05.093215 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b4157-d9a2-4064-8055-cc7734653c7e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:05.093817 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b4157-d9a2-4064-8055-cc7734653c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:05.094313 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b4157-d9a2-4064-8055-cc7734653c7e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:05.104988 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b4157-d9a2-4064-8055-cc7734653c7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:05.110663 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-786b4157-d9a2-4064-8055-cc7734653c7e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 15:46:05.110663 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:05.110663 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:05.110663 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:05.110663 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:05.110663 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:05.110663 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:05.110663 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:05.110663 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:05.110663 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:05.110663 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:05.110663 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:05.110663 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:05.110663 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:05.110663 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:05.110663 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:05.111507 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:05.111507 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:05.111507 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:05.111507 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:05.111507 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:05.111507 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:05.111507 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:05.111507 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:05.111507 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:05.111507 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:05.111507 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:05.111507 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:05.111507 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:05.111507 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:05.111507 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:05.111507 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:05.112296 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:05.112296 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:05.112296 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:05.112296 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:05.112296 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:05.112296 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:05.112296 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:05.112296 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:05.112296 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:05.112296 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:05.112296 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 15:46:05.112296 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:05.114829 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 157/313] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:46:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:05.122213 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d0643-c4ac-4c75-929f-ecfe9223df8c None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:05.225077 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d0643-c4ac-4c75-929f-ecfe9223df8c None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:05.262287 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38d9d4-797c-4750-8a09-348ebd58b088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:05.263412 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38d9d4-797c-4750-8a09-348ebd58b088 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:05.263918 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38d9d4-797c-4750-8a09-348ebd58b088 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:05.264410 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38d9d4-797c-4750-8a09-348ebd58b088 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:05.265398 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f38d9d4-797c-4750-8a09-348ebd58b088 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:05.265902 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f38d9d4-797c-4750-8a09-348ebd58b088 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:05.267467 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f38d9d4-797c-4750-8a09-348ebd58b088 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:05.276396 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 157/314] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 30 15:46:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:05.282887 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b4157-d9a2-4064-8055-cc7734653c7e None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:05.390664 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b4157-d9a2-4064-8055-cc7734653c7e None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:05.425721 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1cf8bb-b9b7-4488-a091-e136bbec345b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:05.426362 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cf8bb-b9b7-4488-a091-e136bbec345b None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:05.426645 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cf8bb-b9b7-4488-a091-e136bbec345b None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:05.426923 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cf8bb-b9b7-4488-a091-e136bbec345b None admin] PATH_INFO: `/v3/users/8a0ee8d1f353435086ac5ee57db5d043` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:05.428059 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1cf8bb-b9b7-4488-a091-e136bbec345b None admin] RBAC: Authorizing `identity:get_user(user_id=8a0ee8d1f353435086ac5ee57db5d043)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:05.429543 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1cf8bb-b9b7-4488-a091-e136bbec345b None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:05.431206 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 158/315] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:46:05 2022] GET /identity/v3/users/8a0ee8d1f353435086ac5ee57db5d043 => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:05.437898 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38d9d4-797c-4750-8a09-348ebd58b088 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:05.447935 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:05.549535 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38d9d4-797c-4750-8a09-348ebd58b088 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:05.584567 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2cdd6e-b3f0-4e35-a10f-22253b5adf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:05.585526 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2cdd6e-b3f0-4e35-a10f-22253b5adf7a None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:05.586000 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2cdd6e-b3f0-4e35-a10f-22253b5adf7a None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:05.586462 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2cdd6e-b3f0-4e35-a10f-22253b5adf7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:05.656592 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2cdd6e-b3f0-4e35-a10f-22253b5adf7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:05.658399 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2cdd6e-b3f0-4e35-a10f-22253b5adf7a None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:05.679283 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:05.762820 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 158/316] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:46:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 15:46:05.769883 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1cf8bb-b9b7-4488-a091-e136bbec345b None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:05.796109 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:05.881886 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1cf8bb-b9b7-4488-a091-e136bbec345b None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:05.916880 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8c78b-10cb-45d1-9456-d2ddba6b5282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:05.917527 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8c78b-10cb-45d1-9456-d2ddba6b5282 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:05.917807 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8c78b-10cb-45d1-9456-d2ddba6b5282 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:05.918084 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8c78b-10cb-45d1-9456-d2ddba6b5282 None admin] PATH_INFO: `/v3/projects/7c5e57fbc705432ab1fdaa879674274e` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:05.919222 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8c78b-10cb-45d1-9456-d2ddba6b5282 None admin] RBAC: Authorizing `identity:get_project(project_id=7c5e57fbc705432ab1fdaa879674274e)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:05.921360 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8c78b-10cb-45d1-9456-d2ddba6b5282 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:05.923325 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 159/317] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:46:05 2022] GET /identity/v3/projects/7c5e57fbc705432ab1fdaa879674274e => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:05.929871 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2cdd6e-b3f0-4e35-a10f-22253b5adf7a None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:06.033776 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2cdd6e-b3f0-4e35-a10f-22253b5adf7a None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:06.045266 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:06.081266 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114fe31b-1757-4619-9dca-648629909b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:06.082245 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fe31b-1757-4619-9dca-648629909b44 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:06.082725 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fe31b-1757-4619-9dca-648629909b44 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:06.083202 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fe31b-1757-4619-9dca-648629909b44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:06.084162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114fe31b-1757-4619-9dca-648629909b44 None admin] RBAC: Adding query filter params (role.id=1e3d7a32e093474f86d5673fedf09dc5, scope.project.id=7c5e57fbc705432ab1fdaa879674274e, user.id=8a0ee8d1f353435086ac5ee57db5d043) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:06.084731 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114fe31b-1757-4619-9dca-648629909b44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:06.086433 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114fe31b-1757-4619-9dca-648629909b44 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:06.094019 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 159/318] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:46:05 2022] GET /identity/v3/role_assignments?user.id=8a0ee8d1f353435086ac5ee57db5d043&scope.project.id=7c5e57fbc705432ab1fdaa879674274e&role.id=1e3d7a32e093474f86d5673fedf09dc5 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:06.324319 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b35ef5-d833-4088-8699-37d39ef71e24 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:06.324989 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b35ef5-d833-4088-8699-37d39ef71e24 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:06.324989 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b35ef5-d833-4088-8699-37d39ef71e24 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:06.327399 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 160/319] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:06.332599 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86b152-eaeb-4588-b610-e2f64a66c1d0 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:06.333098 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86b152-eaeb-4588-b610-e2f64a66c1d0 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:06.333189 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86b152-eaeb-4588-b610-e2f64a66c1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:06.356633 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-9a86b152-eaeb-4588-b610-e2f64a66c1d0 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:06.357924 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-9a86b152-eaeb-4588-b610-e2f64a66c1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:06.414712 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e114515-107d-42fb-8022-1ad4d1d7d913 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:06.414997 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e114515-107d-42fb-8022-1ad4d1d7d913 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:06.415275 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e114515-107d-42fb-8022-1ad4d1d7d913 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:06.416616 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 161/320] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:06.421668 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c3592-09a3-4581-83bd-1dee4037b148 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:06.421954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c3592-09a3-4581-83bd-1dee4037b148 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:06.422230 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c3592-09a3-4581-83bd-1dee4037b148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:06.432805 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 160/321] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:46:06.445381 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-b51c3592-09a3-4581-83bd-1dee4037b148 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:06.446575 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-b51c3592-09a3-4581-83bd-1dee4037b148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:06.515644 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 162/322] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 15:46:06.534179 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6c7f2-d19d-4953-8b9a-c7cd1bf8b3c2 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:06.534468 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6c7f2-d19d-4953-8b9a-c7cd1bf8b3c2 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:06.534740 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6c7f2-d19d-4953-8b9a-c7cd1bf8b3c2 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:06.536186 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 161/323] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:06.541148 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db8154-b7a0-45e8-8c23-65b584f5f402 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:06.541435 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db8154-b7a0-45e8-8c23-65b584f5f402 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:06.541705 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db8154-b7a0-45e8-8c23-65b584f5f402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:06.561389 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-70db8154-b7a0-45e8-8c23-65b584f5f402 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:06.562571 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-70db8154-b7a0-45e8-8c23-65b584f5f402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:06.577415 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:06.630349 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 163/324] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:46:06.695387 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6c7f2-d19d-4953-8b9a-c7cd1bf8b3c2 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:06.785698 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db8154-b7a0-45e8-8c23-65b584f5f402 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:06.800156 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:06.804951 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6c7f2-d19d-4953-8b9a-c7cd1bf8b3c2 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:06.842736 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf409a11-388c-44ba-ab15-fa4e524c5f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:06.843295 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf409a11-388c-44ba-ab15-fa4e524c5f9c None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:06.843596 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf409a11-388c-44ba-ab15-fa4e524c5f9c None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:06.843846 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf409a11-388c-44ba-ab15-fa4e524c5f9c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:06.854447 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf409a11-388c-44ba-ab15-fa4e524c5f9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:06.859351 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-cf409a11-388c-44ba-ab15-fa4e524c5f9c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 15:46:06.859351 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:06.859351 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:06.859351 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:06.859351 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:06.859351 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:06.859351 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:06.859351 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:06.859351 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:06.859351 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:06.859351 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:06.859351 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:06.859351 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:06.859351 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:06.859351 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:06.859351 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:06.860217 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:06.860217 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:06.860217 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:06.860217 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:06.860217 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:06.860217 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:06.860217 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:06.860217 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:06.860217 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:06.860217 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:06.860217 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:06.860217 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:06.860217 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:06.860217 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:06.860217 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:06.860217 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:06.861015 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:06.861015 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:06.861015 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:06.861015 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:06.861015 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:06.861015 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:06.861015 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:06.861015 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:06.861015 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:06.861015 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:06.861015 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 15:46:06.861015 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:06.861015 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 162/325] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:46:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:06.866132 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf409a11-388c-44ba-ab15-fa4e524c5f9c None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:06.895291 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db8154-b7a0-45e8-8c23-65b584f5f402 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:06.928399 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977144dc-f351-438f-91f3-79571dfb832f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:06.929066 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977144dc-f351-438f-91f3-79571dfb832f None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:06.929348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977144dc-f351-438f-91f3-79571dfb832f None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:06.929620 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977144dc-f351-438f-91f3-79571dfb832f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:06.930726 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977144dc-f351-438f-91f3-79571dfb832f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:06.932176 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977144dc-f351-438f-91f3-79571dfb832f None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:06.933783 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 164/326] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:06.934533 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977144dc-f351-438f-91f3-79571dfb832f None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:06.956703 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:06.968444 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf409a11-388c-44ba-ab15-fa4e524c5f9c None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:07.002591 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8d5df-bbcc-43ef-a074-701d3c1a5d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:07.003195 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8d5df-bbcc-43ef-a074-701d3c1a5d17 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:07.003475 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8d5df-bbcc-43ef-a074-701d3c1a5d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:07.003745 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8d5df-bbcc-43ef-a074-701d3c1a5d17 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:07.004409 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8d5df-bbcc-43ef-a074-701d3c1a5d17 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:07.004706 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8d5df-bbcc-43ef-a074-701d3c1a5d17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:07.006107 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8d5df-bbcc-43ef-a074-701d3c1a5d17 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:07.014056 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 163/327] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 30 15:46:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:46:07.014820 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8d5df-bbcc-43ef-a074-701d3c1a5d17 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:07.038642 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:07.038796 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977144dc-f351-438f-91f3-79571dfb832f None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:07.073631 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766bcb2-f8d8-4fd8-8b5e-6d2225788a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:07.074260 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766bcb2-f8d8-4fd8-8b5e-6d2225788a90 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:07.074535 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766bcb2-f8d8-4fd8-8b5e-6d2225788a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:07.074808 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766bcb2-f8d8-4fd8-8b5e-6d2225788a90 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:07.085043 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766bcb2-f8d8-4fd8-8b5e-6d2225788a90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:07.089846 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-f766bcb2-f8d8-4fd8-8b5e-6d2225788a90 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 15:46:07.089846 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:07.089846 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:07.089846 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:07.089846 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:07.089846 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:07.089846 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:07.089846 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:07.089846 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:07.089846 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:07.089846 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:07.089846 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:07.089846 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:07.089846 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:07.089846 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:07.089846 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:07.090737 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:07.090737 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:07.090737 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:07.090737 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:07.090737 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:07.090737 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:07.090737 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:07.090737 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:07.090737 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:07.090737 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:07.090737 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:07.090737 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:07.090737 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:07.090737 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:07.090737 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:07.090737 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:07.091756 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:07.091756 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:07.091756 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:07.091756 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:07.091756 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:07.091756 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:07.091756 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:07.091756 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:07.091756 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:07.091756 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:07.091756 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 15:46:07.091756 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:07.091756 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 165/328] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:46:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:07.092574 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766bcb2-f8d8-4fd8-8b5e-6d2225788a90 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:07.115625 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8d5df-bbcc-43ef-a074-701d3c1a5d17 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:07.150496 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8e734-e357-471a-a9a3-c6e9078d28c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:07.151110 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8e734-e357-471a-a9a3-c6e9078d28c3 None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:07.151389 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8e734-e357-471a-a9a3-c6e9078d28c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:07.151664 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8e734-e357-471a-a9a3-c6e9078d28c3 None admin] PATH_INFO: `/v3/groups` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:07.152292 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf8e734-e357-471a-a9a3-c6e9078d28c3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:07.153805 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf8e734-e357-471a-a9a3-c6e9078d28c3 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:07.168482 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 164/329] 10.222.0.25 () {60 vars in 1134 bytes} [Tue Aug 30 15:46:07 2022] POST /identity/v3/groups => generated 226 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:46:07.169326 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8e734-e357-471a-a9a3-c6e9078d28c3 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:07.181756 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:07.210917 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766bcb2-f8d8-4fd8-8b5e-6d2225788a90 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:07.255992 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d89c28-57cf-479f-a15e-6167bb563ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:07.256888 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d89c28-57cf-479f-a15e-6167bb563ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:07.257295 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d89c28-57cf-479f-a15e-6167bb563ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:07.257896 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d89c28-57cf-479f-a15e-6167bb563ec5 None admin] PATH_INFO: `/v3/users/b387ef5b328f441baa864c612008b953` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:07.259514 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d89c28-57cf-479f-a15e-6167bb563ec5 None admin] RBAC: Authorizing `identity:get_user(user_id=b387ef5b328f441baa864c612008b953)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:07.261047 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d89c28-57cf-479f-a15e-6167bb563ec5 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:07.268152 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:07.268470 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 166/330] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:46:07 2022] GET /identity/v3/users/b387ef5b328f441baa864c612008b953 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:07.269490 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d89c28-57cf-479f-a15e-6167bb563ec5 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:07.286900 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8e734-e357-471a-a9a3-c6e9078d28c3 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:07.326978 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad3ea0-bcb9-40b5-88dd-96e5dcff5f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:07.327687 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad3ea0-bcb9-40b5-88dd-96e5dcff5f48 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:07.327962 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad3ea0-bcb9-40b5-88dd-96e5dcff5f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:07.328231 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad3ea0-bcb9-40b5-88dd-96e5dcff5f48 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:07.328924 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad3ea0-bcb9-40b5-88dd-96e5dcff5f48 None admin] RBAC: Adding query filter params (name=member) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:07.329222 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad3ea0-bcb9-40b5-88dd-96e5dcff5f48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:07.330603 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad3ea0-bcb9-40b5-88dd-96e5dcff5f48 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:07.344241 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 165/331] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 30 15:46:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:07.350135 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad3ea0-bcb9-40b5-88dd-96e5dcff5f48 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:07.391049 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d89c28-57cf-479f-a15e-6167bb563ec5 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:07.442509 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1d112-6cc0-4ad2-840c-73ae84a3a139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:07.443178 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1d112-6cc0-4ad2-840c-73ae84a3a139 None admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:07.443463 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1d112-6cc0-4ad2-840c-73ae84a3a139 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:07.444195 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1d112-6cc0-4ad2-840c-73ae84a3a139 None admin] PATH_INFO: `/v3/system/users/b387ef5b328f441baa864c612008b953/roles/1e3d7a32e093474f86d5673fedf09dc5` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:07.447049 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1d112-6cc0-4ad2-840c-73ae84a3a139 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b387ef5b328f441baa864c612008b953, role_id=1e3d7a32e093474f86d5673fedf09dc5)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:07.449045 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1d112-6cc0-4ad2-840c-73ae84a3a139 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:07.458606 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 167/332] 10.222.0.25 () {58 vars in 1334 bytes} [Tue Aug 30 15:46:07 2022] PUT /identity/v3/system/users/b387ef5b328f441baa864c612008b953/roles/1e3d7a32e093474f86d5673fedf09dc5 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:46:07.475795 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad3ea0-bcb9-40b5-88dd-96e5dcff5f48 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:07.515851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d9fee-b316-4fb7-bd07-d471f205cd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:07.516518 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d9fee-b316-4fb7-bd07-d471f205cd0d None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:07.516839 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d9fee-b316-4fb7-bd07-d471f205cd0d None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:07.517116 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d9fee-b316-4fb7-bd07-d471f205cd0d None admin] PATH_INFO: `/v3/users/5ba116e322a540928c918db8a25ff5ec` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:07.518597 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d9fee-b316-4fb7-bd07-d471f205cd0d None admin] RBAC: Authorizing `identity:get_user(user_id=5ba116e322a540928c918db8a25ff5ec)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:07.520117 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d9fee-b316-4fb7-bd07-d471f205cd0d None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:07.522055 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 166/333] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:46:07 2022] GET /identity/v3/users/5ba116e322a540928c918db8a25ff5ec => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:46:07.527991 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1d112-6cc0-4ad2-840c-73ae84a3a139 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:07.544024 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:07.647258 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1d112-6cc0-4ad2-840c-73ae84a3a139 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:07.689974 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c811af-9572-470a-ac7f-bf88c1afdccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:07.691023 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c811af-9572-470a-ac7f-bf88c1afdccb None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:07.691503 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c811af-9572-470a-ac7f-bf88c1afdccb None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:07.691988 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c811af-9572-470a-ac7f-bf88c1afdccb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:07.693371 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c811af-9572-470a-ac7f-bf88c1afdccb None admin] RBAC: Adding query filter params (role.id=a82e6f447c1b4b56b530dacfae06dee1, user.id=5ba116e322a540928c918db8a25ff5ec, scope.system=all) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:07.693691 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c811af-9572-470a-ac7f-bf88c1afdccb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:07.695218 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c811af-9572-470a-ac7f-bf88c1afdccb None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:07.714401 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 168/334] 10.222.0.25 () {56 vars in 1308 bytes} [Tue Aug 30 15:46:07 2022] GET /identity/v3/role_assignments?user.id=5ba116e322a540928c918db8a25ff5ec&scope.system=all&role.id=a82e6f447c1b4b56b530dacfae06dee1 => generated 510 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:09.348739 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937a6e7-6d09-43ca-b6a7-25d7694965e3 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:09.349266 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937a6e7-6d09-43ca-b6a7-25d7694965e3 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:09.349339 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937a6e7-6d09-43ca-b6a7-25d7694965e3 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:09.350758 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 167/335] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:09.356194 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5488cf-b9ed-486f-80b1-360738478a72 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:09.356635 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5488cf-b9ed-486f-80b1-360738478a72 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:09.356710 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5488cf-b9ed-486f-80b1-360738478a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:09.378290 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-9d5488cf-b9ed-486f-80b1-360738478a72 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:09.379506 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-9d5488cf-b9ed-486f-80b1-360738478a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:09.457909 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:09.467982 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 169/336] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 15:46:09.674809 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2cfc2a-203c-44dc-a729-6f715d374980 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:09.675142 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2cfc2a-203c-44dc-a729-6f715d374980 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:09.675318 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2cfc2a-203c-44dc-a729-6f715d374980 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:09.676610 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 168/337] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:09.682594 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98875fa-e265-4a33-bb03-ad65df30efb3 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:09.682887 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98875fa-e265-4a33-bb03-ad65df30efb3 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:09.683165 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98875fa-e265-4a33-bb03-ad65df30efb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:09.713821 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-e98875fa-e265-4a33-bb03-ad65df30efb3 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:09.715030 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-e98875fa-e265-4a33-bb03-ad65df30efb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:09.776718 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c67234-9bb7-418d-9f22-ff39fa45aee1 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:09.777050 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c67234-9bb7-418d-9f22-ff39fa45aee1 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:09.777316 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c67234-9bb7-418d-9f22-ff39fa45aee1 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:09.778922 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 169/338] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:09.784504 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a98637-b49f-4bdc-9a31-4b20615f7499 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:09.785048 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a98637-b49f-4bdc-9a31-4b20615f7499 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:09.785531 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a98637-b49f-4bdc-9a31-4b20615f7499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:09.806553 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-13a98637-b49f-4bdc-9a31-4b20615f7499 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:09.808032 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-13a98637-b49f-4bdc-9a31-4b20615f7499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:09.815027 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 170/339] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 15:46:09.817199 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:09.899562 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 170/340] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:46:09.948551 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98875fa-e265-4a33-bb03-ad65df30efb3 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:10.059084 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98875fa-e265-4a33-bb03-ad65df30efb3 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:10.089249 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:10.101692 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca62a4-947c-4f11-ac2a-684ae7f6edb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:10.102328 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca62a4-947c-4f11-ac2a-684ae7f6edb1 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:10.102643 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca62a4-947c-4f11-ac2a-684ae7f6edb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:10.102914 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca62a4-947c-4f11-ac2a-684ae7f6edb1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:10.119223 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca62a4-947c-4f11-ac2a-684ae7f6edb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:10.124754 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-c6ca62a4-947c-4f11-ac2a-684ae7f6edb1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 15:46:10.124754 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:10.124754 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:10.124754 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:10.124754 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:10.124754 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:10.124754 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:10.124754 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:10.124754 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:10.124754 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:10.124754 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:10.124754 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:10.124754 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:10.124754 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:10.124754 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:10.124754 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:10.125676 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:10.125676 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:10.125676 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:10.125676 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:10.125676 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:10.125676 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:10.125676 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:10.125676 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:10.125676 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:10.125676 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:10.125676 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:10.125676 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:10.125676 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:10.125676 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:10.125676 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:10.125676 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:10.126871 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:10.126871 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:10.126871 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:10.126871 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:10.126871 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:10.126871 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:10.126871 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:10.126871 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:10.126871 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:10.126871 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:10.126871 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 15:46:10.126871 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:10.126871 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 171/341] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:46:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:10.132337 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a98637-b49f-4bdc-9a31-4b20615f7499 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:10.259931 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a98637-b49f-4bdc-9a31-4b20615f7499 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:10.292339 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca62a4-947c-4f11-ac2a-684ae7f6edb1 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:10.298432 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932824a-1100-40eb-a82a-6182e917ee91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:10.299406 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932824a-1100-40eb-a82a-6182e917ee91 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:10.299406 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932824a-1100-40eb-a82a-6182e917ee91 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:10.299569 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932824a-1100-40eb-a82a-6182e917ee91 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:10.300301 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8932824a-1100-40eb-a82a-6182e917ee91 None admin] RBAC: Adding query filter params (name=member) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:10.300598 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8932824a-1100-40eb-a82a-6182e917ee91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:10.302052 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8932824a-1100-40eb-a82a-6182e917ee91 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:10.316267 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 171/342] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 30 15:46:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:10.316267 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932824a-1100-40eb-a82a-6182e917ee91 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:10.316829 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:10.425014 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932824a-1100-40eb-a82a-6182e917ee91 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:10.460545 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdfbb6a-fa7d-4d3e-a97f-f41756155768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:10.461455 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfbb6a-fa7d-4d3e-a97f-f41756155768 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:10.461871 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfbb6a-fa7d-4d3e-a97f-f41756155768 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:10.462296 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfbb6a-fa7d-4d3e-a97f-f41756155768 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:10.473871 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdfbb6a-fa7d-4d3e-a97f-f41756155768 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:10.479745 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-5bdfbb6a-fa7d-4d3e-a97f-f41756155768 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 15:46:10.479745 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:10.479745 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:10.479745 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:10.479745 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:10.479745 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:10.479745 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:10.479745 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:10.479745 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:10.479745 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:10.479745 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:10.479745 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:10.479745 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:10.479745 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:10.479745 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:10.479745 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:10.480858 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:10.480858 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:10.480858 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:10.480858 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:10.480858 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:10.480858 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:10.480858 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:10.480858 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:10.480858 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:10.480858 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:10.480858 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:10.480858 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:10.480858 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:10.480858 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:10.480858 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:10.480858 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:10.482525 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:10.482525 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:10.482525 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:10.482525 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:10.482525 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:10.482525 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:10.482525 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:10.482525 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:10.482525 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:10.482525 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:10.482525 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 15:46:10.482525 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:10.484624 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 172/343] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:46:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:10.485636 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdfbb6a-fa7d-4d3e-a97f-f41756155768 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:10.527026 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca62a4-947c-4f11-ac2a-684ae7f6edb1 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:10.553166 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:10.594598 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdfbb6a-fa7d-4d3e-a97f-f41756155768 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:10.629998 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e9711-8682-440b-916a-1000dbc22986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:10.630846 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e9711-8682-440b-916a-1000dbc22986 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:10.631266 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e9711-8682-440b-916a-1000dbc22986 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:10.631701 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e9711-8682-440b-916a-1000dbc22986 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:10.638073 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7bfff-4a4b-4212-b69b-628f56f19cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:10.638837 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7bfff-4a4b-4212-b69b-628f56f19cec None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:10.639125 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7bfff-4a4b-4212-b69b-628f56f19cec None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:10.639397 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7bfff-4a4b-4212-b69b-628f56f19cec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:10.671228 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc7bfff-4a4b-4212-b69b-628f56f19cec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:10.675329 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-fdc7bfff-4a4b-4212-b69b-628f56f19cec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 15:46:10.675329 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:10.675329 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:10.675329 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:10.675329 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:10.675329 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:10.675329 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:10.675329 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:10.675329 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:10.675329 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:10.675329 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:10.675329 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:10.675329 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:10.675329 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:10.675329 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:10.675329 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:10.676371 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:10.676371 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:10.676371 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:10.676371 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:10.676371 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:10.676371 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:10.676371 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:10.676371 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:10.676371 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:10.676371 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:10.676371 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:10.676371 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:10.676371 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:10.676371 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:10.676371 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:10.676371 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:10.677315 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:10.677315 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:10.677315 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:10.677315 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:10.677315 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:10.677315 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:10.677315 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:10.677315 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:10.677315 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:10.677315 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:10.677315 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 15:46:10.677315 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:10.677315 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 172/344] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Aug 30 15:46:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:10.677953 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7bfff-4a4b-4212-b69b-628f56f19cec None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:10.708971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e9711-8682-440b-916a-1000dbc22986 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:10.710795 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e9711-8682-440b-916a-1000dbc22986 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:10.757970 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:10.788266 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:10.812263 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7bfff-4a4b-4212-b69b-628f56f19cec None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:10.832402 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 173/345] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:46:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 15:46:10.833557 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e9711-8682-440b-916a-1000dbc22986 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:10.849610 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a0942-4f25-46f4-8cfc-faf540bd91d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:10.850476 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a0942-4f25-46f4-8cfc-faf540bd91d1 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:10.850892 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a0942-4f25-46f4-8cfc-faf540bd91d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:10.851297 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a0942-4f25-46f4-8cfc-faf540bd91d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:10.852152 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a0942-4f25-46f4-8cfc-faf540bd91d1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:10.852588 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a0942-4f25-46f4-8cfc-faf540bd91d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:10.854133 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a0942-4f25-46f4-8cfc-faf540bd91d1 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:10.863429 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 173/346] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 30 15:46:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:10.866636 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98c5d2-9dc1-4b6c-b438-dc7c9fedaeff None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:10.867090 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98c5d2-9dc1-4b6c-b438-dc7c9fedaeff None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:10.867513 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98c5d2-9dc1-4b6c-b438-dc7c9fedaeff None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:10.869170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 174/347] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:10.870027 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a98c5d2-9dc1-4b6c-b438-dc7c9fedaeff None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:10.943498 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e9711-8682-440b-916a-1000dbc22986 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:10.981617 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba31ab-0095-4b1a-ac18-35f1a0f4c10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:10.982636 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba31ab-0095-4b1a-ac18-35f1a0f4c10f None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:10.983079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba31ab-0095-4b1a-ac18-35f1a0f4c10f None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:10.983261 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a98c5d2-9dc1-4b6c-b438-dc7c9fedaeff None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:10.983493 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba31ab-0095-4b1a-ac18-35f1a0f4c10f None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:10.984297 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba31ab-0095-4b1a-ac18-35f1a0f4c10f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:10.984833 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba31ab-0095-4b1a-ac18-35f1a0f4c10f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:10.986467 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba31ab-0095-4b1a-ac18-35f1a0f4c10f None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:10.994187 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:10.996936 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 174/348] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:46:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:10.999531 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba31ab-0095-4b1a-ac18-35f1a0f4c10f None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:11.020338 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4347e-3304-458c-abff-3715e8853f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:11.021222 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4347e-3304-458c-abff-3715e8853f79 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:11.021672 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4347e-3304-458c-abff-3715e8853f79 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:11.022082 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4347e-3304-458c-abff-3715e8853f79 None admin] PATH_INFO: `/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:11.023354 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f4347e-3304-458c-abff-3715e8853f79 None admin] RBAC: Authorizing `identity:get_project(project_id=ecc1689f0ba04f14ac9c0d53a2a4a32d)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:11.025460 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f4347e-3304-458c-abff-3715e8853f79 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:11.027253 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 175/349] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:46:10 2022] GET /identity/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:11.028592 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccc40f-6457-4e06-9708-dead0e3f6903 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:11.029608 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccc40f-6457-4e06-9708-dead0e3f6903 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:11.030021 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccc40f-6457-4e06-9708-dead0e3f6903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:11.030702 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:11.049851 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-f1ccc40f-6457-4e06-9708-dead0e3f6903 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:11.051272 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-f1ccc40f-6457-4e06-9708-dead0e3f6903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:11.115253 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba31ab-0095-4b1a-ac18-35f1a0f4c10f None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:11.123847 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 176/350] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:46:11.128928 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ccc40f-6457-4e06-9708-dead0e3f6903 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:11.153689 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdee25-de3e-44ad-8fa1-bddce9274fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:11.154608 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdee25-de3e-44ad-8fa1-bddce9274fe2 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:11.155027 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdee25-de3e-44ad-8fa1-bddce9274fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:11.155435 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdee25-de3e-44ad-8fa1-bddce9274fe2 None admin] PATH_INFO: `/v3/users/b387ef5b328f441baa864c612008b953` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:11.156929 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fdee25-de3e-44ad-8fa1-bddce9274fe2 None admin] RBAC: Authorizing `identity:get_user(user_id=b387ef5b328f441baa864c612008b953)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:11.158683 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fdee25-de3e-44ad-8fa1-bddce9274fe2 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:11.160616 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 175/351] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:46:10 2022] GET /identity/v3/users/b387ef5b328f441baa864c612008b953 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:11.161517 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdee25-de3e-44ad-8fa1-bddce9274fe2 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:11.263687 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:11.272747 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdee25-de3e-44ad-8fa1-bddce9274fe2 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:11.310121 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5065aef-1078-49cf-9d5f-c8c07db9924a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:11.311338 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5065aef-1078-49cf-9d5f-c8c07db9924a None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:11.311756 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5065aef-1078-49cf-9d5f-c8c07db9924a None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:11.312163 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5065aef-1078-49cf-9d5f-c8c07db9924a None admin] PATH_INFO: `/v3/groups/a02d26f62b3c4994b3a8d4a596f9af72` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:11.318833 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5065aef-1078-49cf-9d5f-c8c07db9924a None admin] RBAC: Authorizing `identity:get_group(group_id=a02d26f62b3c4994b3a8d4a596f9af72)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:11.320464 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5065aef-1078-49cf-9d5f-c8c07db9924a None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:11.322248 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 176/352] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Aug 30 15:46:11 2022] GET /identity/v3/groups/a02d26f62b3c4994b3a8d4a596f9af72 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:11.323161 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5065aef-1078-49cf-9d5f-c8c07db9924a None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:11.324120 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ccc40f-6457-4e06-9708-dead0e3f6903 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:11.338902 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:11.413528 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83241d-8dbb-4637-b230-28eb753eec29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:11.414236 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83241d-8dbb-4637-b230-28eb753eec29 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:11.414448 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83241d-8dbb-4637-b230-28eb753eec29 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:11.414727 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83241d-8dbb-4637-b230-28eb753eec29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:11.439012 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5065aef-1078-49cf-9d5f-c8c07db9924a None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:11.476532 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5d5fa-fc04-4e6e-a9d3-0217c32eadfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:11.477481 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5d5fa-fc04-4e6e-a9d3-0217c32eadfa None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:11.477981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5d5fa-fc04-4e6e-a9d3-0217c32eadfa None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:11.478388 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5d5fa-fc04-4e6e-a9d3-0217c32eadfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:11.479306 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc5d5fa-fc04-4e6e-a9d3-0217c32eadfa None admin] RBAC: Adding query filter params (role.id=1e3d7a32e093474f86d5673fedf09dc5, user.id=b387ef5b328f441baa864c612008b953, scope.system=all) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:11.479745 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc5d5fa-fc04-4e6e-a9d3-0217c32eadfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:11.481446 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc5d5fa-fc04-4e6e-a9d3-0217c32eadfa None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:11.495082 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 177/353] 10.222.0.25 () {56 vars in 1308 bytes} [Tue Aug 30 15:46:11 2022] GET /identity/v3/role_assignments?user.id=b387ef5b328f441baa864c612008b953&scope.system=all&role.id=1e3d7a32e093474f86d5673fedf09dc5 => generated 510 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:11.496117 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5d5fa-fc04-4e6e-a9d3-0217c32eadfa None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:11.518311 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:11.547008 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83241d-8dbb-4637-b230-28eb753eec29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:11.548616 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83241d-8dbb-4637-b230-28eb753eec29 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:11.618476 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5d5fa-fc04-4e6e-a9d3-0217c32eadfa None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:11.656392 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 177/354] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:46:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 15:46:11.657365 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83241d-8dbb-4637-b230-28eb753eec29 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:11.659736 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fb4fb-f203-4934-9e06-e1bea74cff90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:11.660603 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fb4fb-f203-4934-9e06-e1bea74cff90 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:11.661064 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fb4fb-f203-4934-9e06-e1bea74cff90 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:11.661470 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fb4fb-f203-4934-9e06-e1bea74cff90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:11.662339 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7fb4fb-f203-4934-9e06-e1bea74cff90 None admin] RBAC: Adding query filter params (group.id=a02d26f62b3c4994b3a8d4a596f9af72, role.id=a82e6f447c1b4b56b530dacfae06dee1, scope.project.id=ecc1689f0ba04f14ac9c0d53a2a4a32d) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:11.662866 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7fb4fb-f203-4934-9e06-e1bea74cff90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:11.664502 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7fb4fb-f203-4934-9e06-e1bea74cff90 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:11.668998 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:11.673405 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 178/355] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Aug 30 15:46:11 2022] GET /identity/v3/role_assignments?group.id=a02d26f62b3c4994b3a8d4a596f9af72&scope.project.id=ecc1689f0ba04f14ac9c0d53a2a4a32d&role.id=a82e6f447c1b4b56b530dacfae06dee1 => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:11.674526 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fb4fb-f203-4934-9e06-e1bea74cff90 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:11.772643 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83241d-8dbb-4637-b230-28eb753eec29 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:11.784458 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:11.811284 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fb4fb-f203-4934-9e06-e1bea74cff90 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:11.813522 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08fb25e-0980-4dd3-8338-e0f05c117d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:11.814370 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fb25e-0980-4dd3-8338-e0f05c117d5d None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:11.814791 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fb25e-0980-4dd3-8338-e0f05c117d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:11.815197 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fb25e-0980-4dd3-8338-e0f05c117d5d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:11.828391 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08fb25e-0980-4dd3-8338-e0f05c117d5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:11.834853 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-c08fb25e-0980-4dd3-8338-e0f05c117d5d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 15:46:11.834853 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:11.834853 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:11.834853 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:11.834853 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:11.834853 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:11.834853 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:11.834853 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:11.834853 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:11.834853 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:11.834853 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:11.834853 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:11.834853 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:11.834853 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:11.834853 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:11.834853 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:11.835781 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:11.835781 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:11.835781 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:11.835781 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:11.835781 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:11.835781 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:11.835781 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:11.835781 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:11.835781 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:11.835781 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:11.835781 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:11.835781 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:11.835781 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:11.835781 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:11.835781 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:11.835781 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:11.836551 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:11.836551 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:11.836551 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:11.836551 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:11.836551 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:11.836551 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:11.836551 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:11.836551 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:11.836551 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:11.836551 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:11.836551 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 15:46:11.836551 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:11.839272 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 178/356] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:46:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:11.840741 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617de1b-7902-402a-85a8-bb703c99f303 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:11.841836 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617de1b-7902-402a-85a8-bb703c99f303 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:11.844808 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617de1b-7902-402a-85a8-bb703c99f303 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:11.846531 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 179/357] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:11.851094 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075f677-7235-4b3a-9f29-f9f3f298e9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:11.851578 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617de1b-7902-402a-85a8-bb703c99f303 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:11.851769 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075f677-7235-4b3a-9f29-f9f3f298e9fc None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:11.852007 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075f677-7235-4b3a-9f29-f9f3f298e9fc None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:11.852278 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075f677-7235-4b3a-9f29-f9f3f298e9fc None admin] PATH_INFO: `/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:11.853810 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075f677-7235-4b3a-9f29-f9f3f298e9fc None admin] RBAC: Authorizing `identity:get_project(project_id=ecc1689f0ba04f14ac9c0d53a2a4a32d)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:11.855267 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075f677-7235-4b3a-9f29-f9f3f298e9fc None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:11.857933 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 179/358] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:46:11 2022] GET /identity/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:11.858938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce40b60-9847-488a-a393-2a7094642efa None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:11.859238 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce40b60-9847-488a-a393-2a7094642efa None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:11.860348 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce40b60-9847-488a-a393-2a7094642efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:11.880096 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-bce40b60-9847-488a-a393-2a7094642efa None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:11.881136 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-bce40b60-9847-488a-a393-2a7094642efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:11.933875 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:11.964723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 180/359] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:46:11.965513 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce40b60-9847-488a-a393-2a7094642efa None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:11.972331 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617de1b-7902-402a-85a8-bb703c99f303 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:12.008425 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5625a66-2794-4695-adfd-bed923cb25b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:12.009443 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5625a66-2794-4695-adfd-bed923cb25b3 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:12.009917 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5625a66-2794-4695-adfd-bed923cb25b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:12.010390 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5625a66-2794-4695-adfd-bed923cb25b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:12.011259 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5625a66-2794-4695-adfd-bed923cb25b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:12.011764 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5625a66-2794-4695-adfd-bed923cb25b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:12.014734 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5625a66-2794-4695-adfd-bed923cb25b3 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:12.025253 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 180/360] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 30 15:46:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:46:12.031645 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5625a66-2794-4695-adfd-bed923cb25b3 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:12.065194 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:12.081263 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce40b60-9847-488a-a393-2a7094642efa None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:12.118928 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd062af-542d-49d3-97a1-0de67b9930da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:12.119341 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd062af-542d-49d3-97a1-0de67b9930da None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:12.119621 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd062af-542d-49d3-97a1-0de67b9930da None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:12.119890 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd062af-542d-49d3-97a1-0de67b9930da None admin] PATH_INFO: `/v3/groups/a02d26f62b3c4994b3a8d4a596f9af72` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:12.121028 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd062af-542d-49d3-97a1-0de67b9930da None admin] RBAC: Authorizing `identity:get_group(group_id=a02d26f62b3c4994b3a8d4a596f9af72)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:12.123098 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd062af-542d-49d3-97a1-0de67b9930da None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:12.125242 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 181/361] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Aug 30 15:46:11 2022] GET /identity/v3/groups/a02d26f62b3c4994b3a8d4a596f9af72 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:12.132450 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd062af-542d-49d3-97a1-0de67b9930da None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:12.159734 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5625a66-2794-4695-adfd-bed923cb25b3 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:12.243474 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721755fb-9352-463a-8925-7516b045da12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:12.244413 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721755fb-9352-463a-8925-7516b045da12 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:12.244891 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721755fb-9352-463a-8925-7516b045da12 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:12.245333 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721755fb-9352-463a-8925-7516b045da12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:12.250289 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:12.265332 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd062af-542d-49d3-97a1-0de67b9930da None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:12.309040 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0a590-5113-475e-912d-a2a3db509e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:12.310161 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0a590-5113-475e-912d-a2a3db509e3a None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:12.310506 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0a590-5113-475e-912d-a2a3db509e3a None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:12.310843 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0a590-5113-475e-912d-a2a3db509e3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:12.311796 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0a590-5113-475e-912d-a2a3db509e3a None admin] RBAC: Adding query filter params (group.id=a02d26f62b3c4994b3a8d4a596f9af72, role.id=3e70c1b76757442a9bddbeab151c6fc6, scope.project.id=ecc1689f0ba04f14ac9c0d53a2a4a32d) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:12.312202 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0a590-5113-475e-912d-a2a3db509e3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:12.314380 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0a590-5113-475e-912d-a2a3db509e3a None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:12.324831 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 182/362] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Aug 30 15:46:12 2022] GET /identity/v3/role_assignments?group.id=a02d26f62b3c4994b3a8d4a596f9af72&scope.project.id=ecc1689f0ba04f14ac9c0d53a2a4a32d&role.id=3e70c1b76757442a9bddbeab151c6fc6 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:12.324831 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5046167-16c8-4ba4-ab23-641416bd70fd None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:12.324831 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5046167-16c8-4ba4-ab23-641416bd70fd None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:12.324831 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5046167-16c8-4ba4-ab23-641416bd70fd None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:12.324831 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 183/363] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:12.331023 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362c623-1d21-41c2-b5f3-1c5bd08f418d None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:12.331315 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362c623-1d21-41c2-b5f3-1c5bd08f418d None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:12.331567 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362c623-1d21-41c2-b5f3-1c5bd08f418d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:12.360088 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721755fb-9352-463a-8925-7516b045da12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:12.361597 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721755fb-9352-463a-8925-7516b045da12 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:12.370602 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-3362c623-1d21-41c2-b5f3-1c5bd08f418d None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:12.373545 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-3362c623-1d21-41c2-b5f3-1c5bd08f418d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:12.376869 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:12.477804 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 184/364] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 15:46:12.478947 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362c623-1d21-41c2-b5f3-1c5bd08f418d None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:12.508851 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 181/365] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:46:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 15:46:12.515018 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721755fb-9352-463a-8925-7516b045da12 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:12.555825 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:12.641155 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362c623-1d21-41c2-b5f3-1c5bd08f418d None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:12.647514 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721755fb-9352-463a-8925-7516b045da12 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:12.688941 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e4000-b961-49dc-90e5-5517e06bd632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:12.690080 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e4000-b961-49dc-90e5-5517e06bd632 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:12.690530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e4000-b961-49dc-90e5-5517e06bd632 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:12.690966 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e4000-b961-49dc-90e5-5517e06bd632 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:12.692006 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a55b1-150f-4de9-a978-3b71a1ae6752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:12.692718 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a55b1-150f-4de9-a978-3b71a1ae6752 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:12.693115 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a55b1-150f-4de9-a978-3b71a1ae6752 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:12.693452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a55b1-150f-4de9-a978-3b71a1ae6752 None admin] PATH_INFO: `/v3/projects/7c5e57fbc705432ab1fdaa879674274e` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:12.694677 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a55b1-150f-4de9-a978-3b71a1ae6752 None admin] RBAC: Authorizing `identity:get_project(project_id=7c5e57fbc705432ab1fdaa879674274e)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:12.696191 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a55b1-150f-4de9-a978-3b71a1ae6752 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:12.704833 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 182/366] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:46:12 2022] GET /identity/v3/projects/7c5e57fbc705432ab1fdaa879674274e => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:12.705509 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e4000-b961-49dc-90e5-5517e06bd632 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:12.706347 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a55b1-150f-4de9-a978-3b71a1ae6752 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:12.711455 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:12.714584 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-c67e4000-b961-49dc-90e5-5517e06bd632 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 15:46:12.714584 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:12.714584 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:12.714584 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:12.714584 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:12.714584 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:12.714584 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:12.714584 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:12.714584 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:12.714584 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:12.714584 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:12.714584 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:12.714584 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:12.714584 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:12.714584 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:12.714584 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:12.715519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:12.715519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:12.715519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:12.715519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:12.715519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:12.715519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:12.715519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:12.715519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:12.715519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:12.715519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:12.715519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:12.715519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:12.715519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:12.715519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:12.715519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:12.715519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:12.716427 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:12.716427 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:12.716427 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:12.716427 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:12.716427 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:12.716427 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:12.716427 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:12.716427 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:12.716427 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:12.716427 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:12.716427 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 15:46:12.716427 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:12.716427 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 185/367] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Aug 30 15:46:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:12.724363 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e4000-b961-49dc-90e5-5517e06bd632 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:12.820371 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:12.824965 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a55b1-150f-4de9-a978-3b71a1ae6752 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:12.864524 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956e9a0-8c10-43a5-b370-914676de989e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:12.865538 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956e9a0-8c10-43a5-b370-914676de989e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:12.866010 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956e9a0-8c10-43a5-b370-914676de989e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:12.866497 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956e9a0-8c10-43a5-b370-914676de989e None admin] PATH_INFO: `/v3/groups/a02d26f62b3c4994b3a8d4a596f9af72` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:12.867800 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956e9a0-8c10-43a5-b370-914676de989e None admin] RBAC: Authorizing `identity:get_group(group_id=a02d26f62b3c4994b3a8d4a596f9af72)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:12.869490 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956e9a0-8c10-43a5-b370-914676de989e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:12.871574 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 183/368] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Aug 30 15:46:12 2022] GET /identity/v3/groups/a02d26f62b3c4994b3a8d4a596f9af72 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:46:12.878234 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956e9a0-8c10-43a5-b370-914676de989e None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:12.936110 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e4000-b961-49dc-90e5-5517e06bd632 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:12.974704 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80969b58-fa57-4345-ac7e-feb08da3cede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:12.975554 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80969b58-fa57-4345-ac7e-feb08da3cede None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:12.975971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80969b58-fa57-4345-ac7e-feb08da3cede None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:12.976400 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80969b58-fa57-4345-ac7e-feb08da3cede None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:12.977334 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80969b58-fa57-4345-ac7e-feb08da3cede None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:12.977873 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80969b58-fa57-4345-ac7e-feb08da3cede None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:12.979444 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80969b58-fa57-4345-ac7e-feb08da3cede None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:12.987420 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956e9a0-8c10-43a5-b370-914676de989e None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:12.989476 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 186/369] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:46:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:46:12.990730 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80969b58-fa57-4345-ac7e-feb08da3cede None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:13.025664 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c223a-d905-46e1-9eee-2bd319da2e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:13.026279 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c223a-d905-46e1-9eee-2bd319da2e7d None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:13.026555 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c223a-d905-46e1-9eee-2bd319da2e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:13.026826 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c223a-d905-46e1-9eee-2bd319da2e7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:13.027561 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c223a-d905-46e1-9eee-2bd319da2e7d None admin] RBAC: Adding query filter params (group.id=a02d26f62b3c4994b3a8d4a596f9af72, role.id=a82e6f447c1b4b56b530dacfae06dee1, scope.project.id=7c5e57fbc705432ab1fdaa879674274e) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:13.027863 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c223a-d905-46e1-9eee-2bd319da2e7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:13.029643 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c223a-d905-46e1-9eee-2bd319da2e7d None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:13.035841 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 184/370] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Aug 30 15:46:12 2022] GET /identity/v3/role_assignments?group.id=a02d26f62b3c4994b3a8d4a596f9af72&scope.project.id=7c5e57fbc705432ab1fdaa879674274e&role.id=a82e6f447c1b4b56b530dacfae06dee1 => generated 260 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:46:13.036650 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c223a-d905-46e1-9eee-2bd319da2e7d None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:13.061235 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:13.089695 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:13.109723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80969b58-fa57-4345-ac7e-feb08da3cede None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:13.148990 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99253ae1-95bb-48d7-9684-04dea336ce7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:13.150088 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99253ae1-95bb-48d7-9684-04dea336ce7e None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:13.150651 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99253ae1-95bb-48d7-9684-04dea336ce7e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:13.151125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99253ae1-95bb-48d7-9684-04dea336ce7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:13.164864 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99253ae1-95bb-48d7-9684-04dea336ce7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:13.171095 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-99253ae1-95bb-48d7-9684-04dea336ce7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:46:13.171095 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:13.171095 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:13.171095 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:13.171095 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:13.171095 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:13.171095 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:13.171095 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:13.171095 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:13.171095 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:13.171095 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:13.171095 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:13.171095 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:13.171095 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:13.171095 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:13.171095 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:13.171954 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:13.171954 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:13.171954 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:13.171954 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:13.171954 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:13.171954 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:13.171954 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:13.171954 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:13.171954 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:13.171954 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:13.171954 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:13.171954 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:13.171954 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:13.171954 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:13.171954 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:13.171954 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:13.172766 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:13.172766 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:13.172766 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:13.172766 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:13.172766 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:13.172766 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:13.172766 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:13.172766 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:13.172766 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:13.172766 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:13.172766 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:46:13.172766 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:13.175676 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 187/371] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 30 15:46:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:13.181806 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99253ae1-95bb-48d7-9684-04dea336ce7e None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:13.197204 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c223a-d905-46e1-9eee-2bd319da2e7d None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:13.245839 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd89ec-4c16-4cea-af79-15b1579438a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:13.246470 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd89ec-4c16-4cea-af79-15b1579438a2 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:13.246746 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd89ec-4c16-4cea-af79-15b1579438a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:13.247089 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd89ec-4c16-4cea-af79-15b1579438a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:13.296456 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99253ae1-95bb-48d7-9684-04dea336ce7e None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:13.322553 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:13.327721 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd89ec-4c16-4cea-af79-15b1579438a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:13.329416 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd89ec-4c16-4cea-af79-15b1579438a2 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:13.338633 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc5dae-9ffc-45dc-a732-7f1300cde9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:13.339553 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc5dae-9ffc-45dc-a732-7f1300cde9ae None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:13.340131 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc5dae-9ffc-45dc-a732-7f1300cde9ae None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:13.340613 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc5dae-9ffc-45dc-a732-7f1300cde9ae None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:13.342148 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc5dae-9ffc-45dc-a732-7f1300cde9ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:13.342660 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc5dae-9ffc-45dc-a732-7f1300cde9ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:13.344213 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc5dae-9ffc-45dc-a732-7f1300cde9ae None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:13.354791 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 188/372] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:46:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:13.361372 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:13.361896 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc5dae-9ffc-45dc-a732-7f1300cde9ae None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:13.450072 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 185/373] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:46:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 15:46:13.455748 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd89ec-4c16-4cea-af79-15b1579438a2 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:13.537005 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc5dae-9ffc-45dc-a732-7f1300cde9ae None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:13.598527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b55063-9da2-451a-a324-9adda9bc3bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:13.599079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b55063-9da2-451a-a324-9adda9bc3bdf None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:13.599352 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b55063-9da2-451a-a324-9adda9bc3bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:13.599623 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b55063-9da2-451a-a324-9adda9bc3bdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:13.601853 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd89ec-4c16-4cea-af79-15b1579438a2 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:13.633730 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:13.641726 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67814fe-5c41-4767-9a08-62589bcd703f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:13.642775 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67814fe-5c41-4767-9a08-62589bcd703f None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:13.643507 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67814fe-5c41-4767-9a08-62589bcd703f None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:13.643970 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67814fe-5c41-4767-9a08-62589bcd703f None admin] PATH_INFO: `/v3/projects/7c5e57fbc705432ab1fdaa879674274e` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:13.645403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67814fe-5c41-4767-9a08-62589bcd703f None admin] RBAC: Authorizing `identity:get_project(project_id=7c5e57fbc705432ab1fdaa879674274e)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:13.647064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67814fe-5c41-4767-9a08-62589bcd703f None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:13.649227 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 186/374] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:46:13 2022] GET /identity/v3/projects/7c5e57fbc705432ab1fdaa879674274e => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:13.654935 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67814fe-5c41-4767-9a08-62589bcd703f None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:13.713169 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:13.749863 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b55063-9da2-451a-a324-9adda9bc3bdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:13.753089 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b55063-9da2-451a-a324-9adda9bc3bdf None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:13.824532 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67814fe-5c41-4767-9a08-62589bcd703f None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:13.864646 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b2cb2-6c86-40d8-91c9-35aed3893bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:13.865284 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b2cb2-6c86-40d8-91c9-35aed3893bac None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:13.865560 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b2cb2-6c86-40d8-91c9-35aed3893bac None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:13.865827 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b2cb2-6c86-40d8-91c9-35aed3893bac None admin] PATH_INFO: `/v3/groups/a02d26f62b3c4994b3a8d4a596f9af72` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:13.867203 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b2cb2-6c86-40d8-91c9-35aed3893bac None admin] RBAC: Authorizing `identity:get_group(group_id=a02d26f62b3c4994b3a8d4a596f9af72)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:13.868836 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b2cb2-6c86-40d8-91c9-35aed3893bac None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:13.871326 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 187/375] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Aug 30 15:46:13 2022] GET /identity/v3/groups/a02d26f62b3c4994b3a8d4a596f9af72 => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:13.879397 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b2cb2-6c86-40d8-91c9-35aed3893bac None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:13.963033 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 189/376] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:46:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 15:46:13.970851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b55063-9da2-451a-a324-9adda9bc3bdf None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:14.005494 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:14.074471 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b2cb2-6c86-40d8-91c9-35aed3893bac None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:14.109146 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:14.136424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b55063-9da2-451a-a324-9adda9bc3bdf None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:14.150272 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e630f-b600-47e3-9041-4e0adc8af6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:14.151272 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e630f-b600-47e3-9041-4e0adc8af6ea None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:14.151748 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e630f-b600-47e3-9041-4e0adc8af6ea None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:14.152227 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e630f-b600-47e3-9041-4e0adc8af6ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:14.153205 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e630f-b600-47e3-9041-4e0adc8af6ea None admin] RBAC: Adding query filter params (group.id=a02d26f62b3c4994b3a8d4a596f9af72, role.id=3e70c1b76757442a9bddbeab151c6fc6, scope.project.id=7c5e57fbc705432ab1fdaa879674274e) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:14.154276 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e630f-b600-47e3-9041-4e0adc8af6ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:14.158336 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e630f-b600-47e3-9041-4e0adc8af6ea None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:14.172980 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 188/377] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Aug 30 15:46:13 2022] GET /identity/v3/role_assignments?group.id=a02d26f62b3c4994b3a8d4a596f9af72&scope.project.id=7c5e57fbc705432ab1fdaa879674274e&role.id=3e70c1b76757442a9bddbeab151c6fc6 => generated 260 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:46:14.174313 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb37c88-4bd9-4967-9c9b-c6c59a82b046 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:14.174604 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb37c88-4bd9-4967-9c9b-c6c59a82b046 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:14.174885 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb37c88-4bd9-4967-9c9b-c6c59a82b046 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:14.176267 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 189/378] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:14.190290 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500b83f-2e28-46f0-a46b-29bc6efe5cd7 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:14.190614 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500b83f-2e28-46f0-a46b-29bc6efe5cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:14.190853 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500b83f-2e28-46f0-a46b-29bc6efe5cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:14.202449 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bade272-20d3-4a07-96ca-950e87c48757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:14.203117 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bade272-20d3-4a07-96ca-950e87c48757 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:14.203403 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bade272-20d3-4a07-96ca-950e87c48757 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:14.203679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bade272-20d3-4a07-96ca-950e87c48757 None admin] PATH_INFO: `/v3/projects/68dd5aaf111a41b0974c3035d437038b` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:14.204908 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bade272-20d3-4a07-96ca-950e87c48757 None admin] RBAC: Authorizing `identity:get_project(project_id=68dd5aaf111a41b0974c3035d437038b)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:14.206409 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bade272-20d3-4a07-96ca-950e87c48757 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:14.208498 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 190/379] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:46:13 2022] GET /identity/v3/projects/68dd5aaf111a41b0974c3035d437038b => generated 344 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:14.214605 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bade272-20d3-4a07-96ca-950e87c48757 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:14.215730 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-6500b83f-2e28-46f0-a46b-29bc6efe5cd7 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:14.217223 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-6500b83f-2e28-46f0-a46b-29bc6efe5cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:14.316344 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 190/380] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:46:14.384811 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bade272-20d3-4a07-96ca-950e87c48757 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:14.421802 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72853e9-5a42-4f35-9d29-556c50ea2a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:14.422802 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72853e9-5a42-4f35-9d29-556c50ea2a23 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:14.423276 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72853e9-5a42-4f35-9d29-556c50ea2a23 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:14.423764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72853e9-5a42-4f35-9d29-556c50ea2a23 None admin] PATH_INFO: `/v3/groups/354da553a5e24e99bb17ad62c677bdac` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:14.429115 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72853e9-5a42-4f35-9d29-556c50ea2a23 None admin] RBAC: Authorizing `identity:get_group(group_id=354da553a5e24e99bb17ad62c677bdac)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:14.430841 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72853e9-5a42-4f35-9d29-556c50ea2a23 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:14.433029 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 191/381] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Aug 30 15:46:14 2022] GET /identity/v3/groups/354da553a5e24e99bb17ad62c677bdac => generated 229 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:46:14.439441 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500b83f-2e28-46f0-a46b-29bc6efe5cd7 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:14.509428 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:14.556998 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500b83f-2e28-46f0-a46b-29bc6efe5cd7 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:14.598213 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcb1c0-f164-4a59-9e79-6f5b14d02b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:14.599187 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcb1c0-f164-4a59-9e79-6f5b14d02b1b None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:14.599664 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcb1c0-f164-4a59-9e79-6f5b14d02b1b None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:14.600131 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcb1c0-f164-4a59-9e79-6f5b14d02b1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:14.601232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bcb1c0-f164-4a59-9e79-6f5b14d02b1b None admin] RBAC: Adding query filter params (group.id=354da553a5e24e99bb17ad62c677bdac, role.id=676938e69210499ca11ee75dd572d0dc, scope.project.id=68dd5aaf111a41b0974c3035d437038b) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:14.601754 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bcb1c0-f164-4a59-9e79-6f5b14d02b1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:14.603386 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bcb1c0-f164-4a59-9e79-6f5b14d02b1b None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:14.611331 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 191/382] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Aug 30 15:46:14 2022] GET /identity/v3/role_assignments?group.id=354da553a5e24e99bb17ad62c677bdac&scope.project.id=68dd5aaf111a41b0974c3035d437038b&role.id=676938e69210499ca11ee75dd572d0dc => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:14.734919 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72853e9-5a42-4f35-9d29-556c50ea2a23 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:14.759704 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:14.831735 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29caae8a-d916-4c70-b85c-130c369da06f None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:14.832050 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29caae8a-d916-4c70-b85c-130c369da06f None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:14.832281 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29caae8a-d916-4c70-b85c-130c369da06f None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:14.833928 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 192/383] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:14.839206 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c529bd8-9a5a-4cb7-9716-69232ad49aa4 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:14.839347 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c529bd8-9a5a-4cb7-9716-69232ad49aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:14.839547 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c529bd8-9a5a-4cb7-9716-69232ad49aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:14.872942 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-7c529bd8-9a5a-4cb7-9716-69232ad49aa4 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:14.874313 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-7c529bd8-9a5a-4cb7-9716-69232ad49aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:14.874827 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72853e9-5a42-4f35-9d29-556c50ea2a23 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:14.912866 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f0df5-6bfd-42af-af6e-1799a8d3475b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:14.913925 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f0df5-6bfd-42af-af6e-1799a8d3475b None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:14.914401 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f0df5-6bfd-42af-af6e-1799a8d3475b None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:14.914909 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f0df5-6bfd-42af-af6e-1799a8d3475b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:14.926548 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104f0df5-6bfd-42af-af6e-1799a8d3475b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:14.931827 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-104f0df5-6bfd-42af-af6e-1799a8d3475b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 15:46:14.931827 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:14.931827 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:14.931827 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:14.931827 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:14.931827 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:14.931827 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:14.931827 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:14.931827 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:14.931827 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:14.931827 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:14.931827 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:14.931827 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:14.931827 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:14.931827 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:14.931827 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:14.932700 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:14.932700 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:14.932700 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:14.932700 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:14.932700 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:14.932700 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:14.932700 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:14.932700 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:14.932700 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:14.932700 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:14.932700 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:14.932700 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:14.932700 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:14.932700 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:14.932700 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:14.932700 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:14.933496 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:14.933496 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:14.933496 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:14.933496 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:14.933496 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:14.933496 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:14.933496 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:14.933496 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:14.933496 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:14.933496 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:14.933496 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 15:46:14.933496 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:14.936347 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 192/384] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:46:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:14.942780 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f0df5-6bfd-42af-af6e-1799a8d3475b None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:15.013610 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 193/385] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:46:15.076670 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:15.105112 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f0df5-6bfd-42af-af6e-1799a8d3475b None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:15.151323 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4c74f-ea0a-4267-b25f-97f975cbc529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:15.151938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4c74f-ea0a-4267-b25f-97f975cbc529 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:15.152211 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4c74f-ea0a-4267-b25f-97f975cbc529 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:15.152474 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4c74f-ea0a-4267-b25f-97f975cbc529 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:15.153173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4c74f-ea0a-4267-b25f-97f975cbc529 None admin] RBAC: Adding query filter params (name=member) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:15.153467 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4c74f-ea0a-4267-b25f-97f975cbc529 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:15.155789 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4c74f-ea0a-4267-b25f-97f975cbc529 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:15.168569 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 193/386] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 30 15:46:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:46:15.174480 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c529bd8-9a5a-4cb7-9716-69232ad49aa4 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:15.233095 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:15.288898 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c529bd8-9a5a-4cb7-9716-69232ad49aa4 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:15.329052 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb871c-6f12-4055-81d6-abc0207bbd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:15.329697 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb871c-6f12-4055-81d6-abc0207bbd0a None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:15.329974 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb871c-6f12-4055-81d6-abc0207bbd0a None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:15.330243 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb871c-6f12-4055-81d6-abc0207bbd0a None admin] PATH_INFO: `/v3/groups/a02d26f62b3c4994b3a8d4a596f9af72` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:15.331369 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bb871c-6f12-4055-81d6-abc0207bbd0a None admin] RBAC: Authorizing `identity:get_group(group_id=a02d26f62b3c4994b3a8d4a596f9af72)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:15.332813 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bb871c-6f12-4055-81d6-abc0207bbd0a None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:15.334394 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 194/387] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Aug 30 15:46:15 2022] GET /identity/v3/groups/a02d26f62b3c4994b3a8d4a596f9af72 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:15.339937 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4c74f-ea0a-4267-b25f-97f975cbc529 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:15.379570 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb871c-6f12-4055-81d6-abc0207bbd0a None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:15.504809 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4c74f-ea0a-4267-b25f-97f975cbc529 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:15.558296 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb871c-6f12-4055-81d6-abc0207bbd0a None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:15.561788 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b596e4a-a1fe-46a4-86d7-7fb708fc48a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:15.562717 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b596e4a-a1fe-46a4-86d7-7fb708fc48a7 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:15.563194 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b596e4a-a1fe-46a4-86d7-7fb708fc48a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:15.563666 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b596e4a-a1fe-46a4-86d7-7fb708fc48a7 None admin] PATH_INFO: `/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:15.565059 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b596e4a-a1fe-46a4-86d7-7fb708fc48a7 None admin] RBAC: Authorizing `identity:get_project(project_id=ecc1689f0ba04f14ac9c0d53a2a4a32d)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:15.567670 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b596e4a-a1fe-46a4-86d7-7fb708fc48a7 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:15.572810 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 194/388] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:46:15 2022] GET /identity/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:15.578105 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b596e4a-a1fe-46a4-86d7-7fb708fc48a7 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:15.588869 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:15.611466 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:15.642414 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38e950-1e04-4e5a-b2ab-3fd4ab6694a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:15.643582 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38e950-1e04-4e5a-b2ab-3fd4ab6694a5 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:15.643998 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38e950-1e04-4e5a-b2ab-3fd4ab6694a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:15.644393 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38e950-1e04-4e5a-b2ab-3fd4ab6694a5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:15.666084 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf38e950-1e04-4e5a-b2ab-3fd4ab6694a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:15.675389 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-cf38e950-1e04-4e5a-b2ab-3fd4ab6694a5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 15:46:15.675389 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:15.675389 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:15.675389 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:15.675389 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:15.675389 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:15.675389 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:15.675389 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:15.675389 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:15.675389 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:15.675389 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:15.675389 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:15.675389 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:15.675389 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:15.675389 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:15.675389 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:15.676480 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:15.676480 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:15.676480 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:15.676480 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:15.676480 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:15.676480 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:15.676480 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:15.676480 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:15.676480 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:15.676480 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:15.676480 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:15.676480 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:15.676480 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:15.676480 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:15.676480 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:15.676480 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:15.681250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:15.681250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:15.681250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:15.681250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:15.681250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:15.681250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:15.681250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:15.681250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:15.681250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:15.681250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:15.681250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 15:46:15.681250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:15.683541 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 195/389] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Aug 30 15:46:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 15:46:15.689646 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38e950-1e04-4e5a-b2ab-3fd4ab6694a5 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:15.698814 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b596e4a-a1fe-46a4-86d7-7fb708fc48a7 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:15.750697 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caae94a-eb03-442f-a3e2-74628e7f1e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:15.751540 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caae94a-eb03-442f-a3e2-74628e7f1e57 None admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:15.751921 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caae94a-eb03-442f-a3e2-74628e7f1e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:15.752293 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caae94a-eb03-442f-a3e2-74628e7f1e57 None admin] PATH_INFO: `/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d/groups/a02d26f62b3c4994b3a8d4a596f9af72/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:15.756489 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caae94a-eb03-442f-a3e2-74628e7f1e57 None admin] RBAC: Authorizing `identity:create_grant(project_id=ecc1689f0ba04f14ac9c0d53a2a4a32d, group_id=a02d26f62b3c4994b3a8d4a596f9af72, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:15.758269 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caae94a-eb03-442f-a3e2-74628e7f1e57 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:15.792928 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 195/390] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Aug 30 15:46:15 2022] PUT /identity/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d/groups/a02d26f62b3c4994b3a8d4a596f9af72/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:46:15.814720 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38e950-1e04-4e5a-b2ab-3fd4ab6694a5 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:15.860215 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f22ce0f-4052-478b-9c4e-6843d03b8bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:15.861171 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22ce0f-4052-478b-9c4e-6843d03b8bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:15.861592 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22ce0f-4052-478b-9c4e-6843d03b8bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:15.862000 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22ce0f-4052-478b-9c4e-6843d03b8bd6 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:15.862948 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f22ce0f-4052-478b-9c4e-6843d03b8bd6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:15.863400 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f22ce0f-4052-478b-9c4e-6843d03b8bd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:15.865147 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f22ce0f-4052-478b-9c4e-6843d03b8bd6 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:15.875832 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 196/391] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:46:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:46:15.881450 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caae94a-eb03-442f-a3e2-74628e7f1e57 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:15.910219 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa2512-5a90-4d20-b9b9-4b140b356863 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:15.910739 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa2512-5a90-4d20-b9b9-4b140b356863 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:15.911148 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa2512-5a90-4d20-b9b9-4b140b356863 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:15.912920 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 197/392] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:15.924103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fc8ec-5ee2-4c7e-8928-aeff4d6dcf6f None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:15.924606 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fc8ec-5ee2-4c7e-8928-aeff4d6dcf6f None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:15.925054 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fc8ec-5ee2-4c7e-8928-aeff4d6dcf6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:15.953983 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-ed9fc8ec-5ee2-4c7e-8928-aeff4d6dcf6f None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:15.955455 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-ed9fc8ec-5ee2-4c7e-8928-aeff4d6dcf6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:16.000441 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:16.021675 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:16.066846 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caae94a-eb03-442f-a3e2-74628e7f1e57 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:16.073689 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 198/393] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 15:46:16.110135 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3660d-dc38-40cb-8253-296ed4071897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:16.111236 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3660d-dc38-40cb-8253-296ed4071897 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:16.111718 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3660d-dc38-40cb-8253-296ed4071897 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:16.112101 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3660d-dc38-40cb-8253-296ed4071897 None admin] PATH_INFO: `/v3/groups/a02d26f62b3c4994b3a8d4a596f9af72` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:16.113382 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3660d-dc38-40cb-8253-296ed4071897 None admin] RBAC: Authorizing `identity:get_group(group_id=a02d26f62b3c4994b3a8d4a596f9af72)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:16.118368 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3660d-dc38-40cb-8253-296ed4071897 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:16.120989 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 196/394] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Aug 30 15:46:15 2022] GET /identity/v3/groups/a02d26f62b3c4994b3a8d4a596f9af72 => generated 226 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:16.127060 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fc8ec-5ee2-4c7e-8928-aeff4d6dcf6f None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:16.241882 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fc8ec-5ee2-4c7e-8928-aeff4d6dcf6f None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:16.287734 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c95c8-4ecb-403e-b50e-1a8954d0a379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:16.288371 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c95c8-4ecb-403e-b50e-1a8954d0a379 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:16.288646 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c95c8-4ecb-403e-b50e-1a8954d0a379 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:16.288938 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c95c8-4ecb-403e-b50e-1a8954d0a379 None admin] PATH_INFO: `/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:16.293729 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891c95c8-4ecb-403e-b50e-1a8954d0a379 None admin] RBAC: Authorizing `identity:get_project(project_id=ecc1689f0ba04f14ac9c0d53a2a4a32d)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:16.296254 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891c95c8-4ecb-403e-b50e-1a8954d0a379 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:16.298290 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 199/395] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:46:16 2022] GET /identity/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:16.303778 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3660d-dc38-40cb-8253-296ed4071897 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:16.402231 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c95c8-4ecb-403e-b50e-1a8954d0a379 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:16.422090 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3660d-dc38-40cb-8253-296ed4071897 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:16.470207 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8ba67-3d66-4c0e-8a31-ce5a39327a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:16.470896 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8ba67-3d66-4c0e-8a31-ce5a39327a8b None admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:16.472031 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8ba67-3d66-4c0e-8a31-ce5a39327a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:16.472031 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8ba67-3d66-4c0e-8a31-ce5a39327a8b None admin] PATH_INFO: `/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d/groups/a02d26f62b3c4994b3a8d4a596f9af72/roles/3e70c1b76757442a9bddbeab151c6fc6` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:16.475276 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a8ba67-3d66-4c0e-8a31-ce5a39327a8b None admin] RBAC: Authorizing `identity:create_grant(project_id=ecc1689f0ba04f14ac9c0d53a2a4a32d, group_id=a02d26f62b3c4994b3a8d4a596f9af72, role_id=3e70c1b76757442a9bddbeab151c6fc6)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:16.476713 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a8ba67-3d66-4c0e-8a31-ce5a39327a8b None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:16.479309 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:16.482134 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:16.496012 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 197/396] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Aug 30 15:46:16 2022] PUT /identity/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d/groups/a02d26f62b3c4994b3a8d4a596f9af72/roles/3e70c1b76757442a9bddbeab151c6fc6 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:46:16.559495 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c95c8-4ecb-403e-b50e-1a8954d0a379 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:16.603350 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd03c9-cc84-49de-8dea-b0a4fb2e5c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:16.604385 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd03c9-cc84-49de-8dea-b0a4fb2e5c5c None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:16.604894 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd03c9-cc84-49de-8dea-b0a4fb2e5c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:16.605400 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd03c9-cc84-49de-8dea-b0a4fb2e5c5c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:16.622568 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd03c9-cc84-49de-8dea-b0a4fb2e5c5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:16.628309 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-60fd03c9-cc84-49de-8dea-b0a4fb2e5c5c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 15:46:16.628309 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:16.628309 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:16.628309 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:16.628309 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:16.628309 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:16.628309 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:16.628309 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:16.628309 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:16.628309 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:16.628309 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:16.628309 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:16.628309 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:16.628309 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:16.628309 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:16.628309 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:16.629212 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:16.629212 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:16.629212 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:16.629212 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:16.629212 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:16.629212 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:16.629212 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:16.629212 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:16.629212 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:16.629212 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:16.629212 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:16.629212 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:16.629212 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:16.629212 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:16.629212 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:16.629212 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:16.630089 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:16.630089 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:16.630089 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:16.630089 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:16.630089 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:16.630089 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:16.630089 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:16.630089 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:16.630089 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:16.630089 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:16.630089 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 15:46:16.630089 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:16.636884 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 200/397] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:46:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 15:46:16.642003 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8ba67-3d66-4c0e-8a31-ce5a39327a8b None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:16.771824 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8ba67-3d66-4c0e-8a31-ce5a39327a8b None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:16.808743 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54d154-a13e-4183-b7c0-3d51aa5947d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:16.809382 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54d154-a13e-4183-b7c0-3d51aa5947d9 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:16.809737 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54d154-a13e-4183-b7c0-3d51aa5947d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:16.810019 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54d154-a13e-4183-b7c0-3d51aa5947d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:16.810688 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54d154-a13e-4183-b7c0-3d51aa5947d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:16.810986 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54d154-a13e-4183-b7c0-3d51aa5947d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:16.812348 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54d154-a13e-4183-b7c0-3d51aa5947d9 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:16.821874 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 198/398] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 30 15:46:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:16.828150 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd03c9-cc84-49de-8dea-b0a4fb2e5c5c None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:16.944880 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd03c9-cc84-49de-8dea-b0a4fb2e5c5c None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:16.946653 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:16.987980 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc603675-0f6d-4175-b71d-122607916b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:16.988877 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc603675-0f6d-4175-b71d-122607916b9c None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:16.989307 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc603675-0f6d-4175-b71d-122607916b9c None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:16.989725 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc603675-0f6d-4175-b71d-122607916b9c None admin] PATH_INFO: `/v3/groups/a02d26f62b3c4994b3a8d4a596f9af72` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:16.991045 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc603675-0f6d-4175-b71d-122607916b9c None admin] RBAC: Authorizing `identity:get_group(group_id=a02d26f62b3c4994b3a8d4a596f9af72)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:16.992657 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc603675-0f6d-4175-b71d-122607916b9c None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:16.994756 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 201/399] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Aug 30 15:46:16 2022] GET /identity/v3/groups/a02d26f62b3c4994b3a8d4a596f9af72 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:17.000890 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54d154-a13e-4183-b7c0-3d51aa5947d9 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:17.058176 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a1040-0951-4a0b-af74-9aae52b3f8b7 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:17.058736 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a1040-0951-4a0b-af74-9aae52b3f8b7 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:17.059011 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a1040-0951-4a0b-af74-9aae52b3f8b7 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:17.061281 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 202/400] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:17.085158 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03116d-8d3f-46b9-8536-f893d383b979 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:17.085495 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03116d-8d3f-46b9-8536-f893d383b979 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:17.085696 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03116d-8d3f-46b9-8536-f893d383b979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:17.110063 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:17.117797 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-7c03116d-8d3f-46b9-8536-f893d383b979 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:17.119015 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-7c03116d-8d3f-46b9-8536-f893d383b979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:17.171096 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54d154-a13e-4183-b7c0-3d51aa5947d9 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:17.215624 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401f7cb-31cc-4c54-9c50-ae793d61bfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:17.217335 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401f7cb-31cc-4c54-9c50-ae793d61bfde None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:17.217731 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401f7cb-31cc-4c54-9c50-ae793d61bfde None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:17.218008 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401f7cb-31cc-4c54-9c50-ae793d61bfde None admin] PATH_INFO: `/v3/projects/7c5e57fbc705432ab1fdaa879674274e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:17.220813 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401f7cb-31cc-4c54-9c50-ae793d61bfde None admin] RBAC: Authorizing `identity:get_project(project_id=7c5e57fbc705432ab1fdaa879674274e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:17.222427 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401f7cb-31cc-4c54-9c50-ae793d61bfde None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:17.224611 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 199/401] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:46:16 2022] GET /identity/v3/projects/7c5e57fbc705432ab1fdaa879674274e => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:17.232797 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401f7cb-31cc-4c54-9c50-ae793d61bfde None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:17.295222 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 203/402] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:46:17.378997 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401f7cb-31cc-4c54-9c50-ae793d61bfde None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:17.411468 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:17.412708 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b74a7-25f5-4528-bbc9-c9b79863a3d9 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:17.413049 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b74a7-25f5-4528-bbc9-c9b79863a3d9 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:17.413311 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b74a7-25f5-4528-bbc9-c9b79863a3d9 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:17.415835 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 204/403] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:17.421299 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a79b2-8abc-4e96-910a-8d1d1a525a95 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:17.421580 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a79b2-8abc-4e96-910a-8d1d1a525a95 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:17.421856 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a79b2-8abc-4e96-910a-8d1d1a525a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:17.427812 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a76b6-dd2d-4afc-8454-6d891fa178b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:17.428725 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a76b6-dd2d-4afc-8454-6d891fa178b6 None admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:17.429189 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a76b6-dd2d-4afc-8454-6d891fa178b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:17.429657 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a76b6-dd2d-4afc-8454-6d891fa178b6 None admin] PATH_INFO: `/v3/projects/7c5e57fbc705432ab1fdaa879674274e/groups/a02d26f62b3c4994b3a8d4a596f9af72/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:17.431630 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a76b6-dd2d-4afc-8454-6d891fa178b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c5e57fbc705432ab1fdaa879674274e, group_id=a02d26f62b3c4994b3a8d4a596f9af72, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:17.433165 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a76b6-dd2d-4afc-8454-6d891fa178b6 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:17.443357 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-0e1a79b2-8abc-4e96-910a-8d1d1a525a95 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:17.444993 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-0e1a79b2-8abc-4e96-910a-8d1d1a525a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:17.461104 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 200/404] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Aug 30 15:46:17 2022] PUT /identity/v3/projects/7c5e57fbc705432ab1fdaa879674274e/groups/a02d26f62b3c4994b3a8d4a596f9af72/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:46:17.574538 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 205/405] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:46:17.683691 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a76b6-dd2d-4afc-8454-6d891fa178b6 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:17.791963 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a76b6-dd2d-4afc-8454-6d891fa178b6 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:17.827502 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597df13-bb8e-4b39-8d1b-31bd16ac8cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:17.828111 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597df13-bb8e-4b39-8d1b-31bd16ac8cbd None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:17.828396 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597df13-bb8e-4b39-8d1b-31bd16ac8cbd None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:17.828662 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597df13-bb8e-4b39-8d1b-31bd16ac8cbd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:17.839484 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597df13-bb8e-4b39-8d1b-31bd16ac8cbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:17.844889 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-2597df13-bb8e-4b39-8d1b-31bd16ac8cbd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 15:46:17.844889 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:17.844889 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:17.844889 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:17.844889 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:17.844889 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:17.844889 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:17.844889 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:17.844889 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:17.844889 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:17.844889 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:17.844889 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:17.844889 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:17.844889 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:17.844889 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:17.844889 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:17.845747 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:17.845747 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:17.845747 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:17.845747 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:17.845747 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:17.845747 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:17.845747 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:17.845747 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:17.845747 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:17.845747 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:17.845747 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:17.845747 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:17.845747 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:17.845747 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:17.845747 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:17.845747 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:17.846941 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:17.846941 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:17.846941 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:17.846941 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:17.846941 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:17.846941 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:17.846941 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:17.846941 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:17.846941 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:17.846941 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:17.846941 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 15:46:17.846941 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:17.846941 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 201/406] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Aug 30 15:46:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:17.853907 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a79b2-8abc-4e96-910a-8d1d1a525a95 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:17.887129 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597df13-bb8e-4b39-8d1b-31bd16ac8cbd None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:17.893289 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:17.948201 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:18.013785 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597df13-bb8e-4b39-8d1b-31bd16ac8cbd None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:18.018980 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a79b2-8abc-4e96-910a-8d1d1a525a95 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:18.055041 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89088d50-82e2-4615-a10d-5200df7e5d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:18.055677 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89088d50-82e2-4615-a10d-5200df7e5d8d None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:18.055954 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89088d50-82e2-4615-a10d-5200df7e5d8d None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:18.056225 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89088d50-82e2-4615-a10d-5200df7e5d8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:18.069806 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89088d50-82e2-4615-a10d-5200df7e5d8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:18.075839 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-89088d50-82e2-4615-a10d-5200df7e5d8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:46:18.075839 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:18.075839 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:18.075839 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:18.075839 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:18.075839 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:18.075839 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:18.075839 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:18.075839 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:18.075839 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:18.075839 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:18.075839 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:18.075839 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:18.075839 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:18.075839 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:18.075839 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:18.076838 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:18.076838 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:18.076838 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:18.076838 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:18.076838 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:18.076838 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:18.076838 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:18.076838 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:18.076838 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:18.076838 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:18.076838 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:18.076838 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:18.076838 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:18.076838 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:18.076838 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:18.076838 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:18.077712 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:18.077712 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:18.077712 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:18.077712 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:18.077712 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:18.077712 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:18.077712 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:18.077712 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:18.077712 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:18.077712 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:18.077712 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:46:18.077712 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:18.077712 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 202/407] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 30 15:46:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 15:46:18.082854 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89088d50-82e2-4615-a10d-5200df7e5d8d None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:18.093509 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce41b7-c3e9-4ea2-9432-ef39a825be48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:18.094146 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce41b7-c3e9-4ea2-9432-ef39a825be48 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:18.094432 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce41b7-c3e9-4ea2-9432-ef39a825be48 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:18.094708 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce41b7-c3e9-4ea2-9432-ef39a825be48 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:18.095396 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce41b7-c3e9-4ea2-9432-ef39a825be48 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:18.095698 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce41b7-c3e9-4ea2-9432-ef39a825be48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:18.097124 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce41b7-c3e9-4ea2-9432-ef39a825be48 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:18.119071 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 206/408] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:46:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:18.145862 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce41b7-c3e9-4ea2-9432-ef39a825be48 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:18.207066 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89088d50-82e2-4615-a10d-5200df7e5d8d None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:18.226491 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:18.247121 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285ec94-b3f7-4df9-92e4-fa551212e09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:18.248319 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285ec94-b3f7-4df9-92e4-fa551212e09f None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:18.248596 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285ec94-b3f7-4df9-92e4-fa551212e09f None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:18.248893 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285ec94-b3f7-4df9-92e4-fa551212e09f None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:18.249562 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285ec94-b3f7-4df9-92e4-fa551212e09f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:18.249861 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285ec94-b3f7-4df9-92e4-fa551212e09f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:18.251399 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285ec94-b3f7-4df9-92e4-fa551212e09f None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:18.260976 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 203/409] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:46:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:18.267764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285ec94-b3f7-4df9-92e4-fa551212e09f None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:18.380903 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285ec94-b3f7-4df9-92e4-fa551212e09f None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:18.423513 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:18.440140 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce41b7-c3e9-4ea2-9432-ef39a825be48 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:18.446629 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ba03a-8953-4124-8b9d-7e75f6ceceb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:18.447281 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ba03a-8953-4124-8b9d-7e75f6ceceb8 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:18.447559 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ba03a-8953-4124-8b9d-7e75f6ceceb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:18.447834 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ba03a-8953-4124-8b9d-7e75f6ceceb8 None admin] PATH_INFO: `/v3/groups/354da553a5e24e99bb17ad62c677bdac` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:18.452376 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ba03a-8953-4124-8b9d-7e75f6ceceb8 None admin] RBAC: Authorizing `identity:get_group(group_id=354da553a5e24e99bb17ad62c677bdac)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:18.453925 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ba03a-8953-4124-8b9d-7e75f6ceceb8 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:18.459227 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 204/410] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Aug 30 15:46:18 2022] GET /identity/v3/groups/354da553a5e24e99bb17ad62c677bdac => generated 229 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:46:18.464728 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ba03a-8953-4124-8b9d-7e75f6ceceb8 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:18.515607 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c8da7-887a-4831-984c-068bce69a6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:18.516255 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c8da7-887a-4831-984c-068bce69a6a4 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:18.516537 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c8da7-887a-4831-984c-068bce69a6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:18.516834 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c8da7-887a-4831-984c-068bce69a6a4 None admin] PATH_INFO: `/v3/groups/a02d26f62b3c4994b3a8d4a596f9af72` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:18.519214 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c8da7-887a-4831-984c-068bce69a6a4 None admin] RBAC: Authorizing `identity:get_group(group_id=a02d26f62b3c4994b3a8d4a596f9af72)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:18.521520 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c8da7-887a-4831-984c-068bce69a6a4 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:18.523584 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 207/411] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Aug 30 15:46:18 2022] GET /identity/v3/groups/a02d26f62b3c4994b3a8d4a596f9af72 => generated 226 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:18.530588 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c8da7-887a-4831-984c-068bce69a6a4 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:18.534914 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:18.636049 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ba03a-8953-4124-8b9d-7e75f6ceceb8 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:18.661833 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c8da7-887a-4831-984c-068bce69a6a4 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:18.681281 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586b636-6f3f-4fee-ade1-2256dd78623a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:18.681924 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586b636-6f3f-4fee-ade1-2256dd78623a None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:18.682203 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586b636-6f3f-4fee-ade1-2256dd78623a None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:18.682475 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586b636-6f3f-4fee-ade1-2256dd78623a None admin] PATH_INFO: `/v3/projects/68dd5aaf111a41b0974c3035d437038b` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:18.684189 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5586b636-6f3f-4fee-ade1-2256dd78623a None admin] RBAC: Authorizing `identity:get_project(project_id=68dd5aaf111a41b0974c3035d437038b)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:18.686593 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5586b636-6f3f-4fee-ade1-2256dd78623a None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:18.689359 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 205/412] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:46:18 2022] GET /identity/v3/projects/68dd5aaf111a41b0974c3035d437038b => generated 344 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:18.691200 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e606eb5-9fc7-4d3c-b31e-57c2b914aa24 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:18.691485 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e606eb5-9fc7-4d3c-b31e-57c2b914aa24 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:18.691760 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e606eb5-9fc7-4d3c-b31e-57c2b914aa24 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:18.693555 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 206/413] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:18.698304 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e606eb5-9fc7-4d3c-b31e-57c2b914aa24 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:18.702869 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7498b53-fccf-47e5-994b-70d6736495d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:18.704503 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7498b53-fccf-47e5-994b-70d6736495d6 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:18.704814 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7498b53-fccf-47e5-994b-70d6736495d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:18.705100 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7498b53-fccf-47e5-994b-70d6736495d6 None admin] PATH_INFO: `/v3/projects/7c5e57fbc705432ab1fdaa879674274e` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:18.706274 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7498b53-fccf-47e5-994b-70d6736495d6 None admin] RBAC: Authorizing `identity:get_project(project_id=7c5e57fbc705432ab1fdaa879674274e)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:18.707720 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7498b53-fccf-47e5-994b-70d6736495d6 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:18.710618 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 208/414] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:46:18 2022] GET /identity/v3/projects/7c5e57fbc705432ab1fdaa879674274e => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:18.711832 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d85b0c-db30-4741-a15f-09a8dff07d9a None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:18.712116 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d85b0c-db30-4741-a15f-09a8dff07d9a None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:18.712388 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d85b0c-db30-4741-a15f-09a8dff07d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:18.736771 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-69d85b0c-db30-4741-a15f-09a8dff07d9a None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:18.738271 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-69d85b0c-db30-4741-a15f-09a8dff07d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:18.784119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:18.830876 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e606eb5-9fc7-4d3c-b31e-57c2b914aa24 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:18.832590 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:18.842521 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 209/415] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:46:18.844040 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d85b0c-db30-4741-a15f-09a8dff07d9a None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:18.897318 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e4847-ae6d-4c99-9b7a-4c2b8fa78b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:18.897921 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e4847-ae6d-4c99-9b7a-4c2b8fa78b55 None admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:18.898197 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e4847-ae6d-4c99-9b7a-4c2b8fa78b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:18.898468 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e4847-ae6d-4c99-9b7a-4c2b8fa78b55 None admin] PATH_INFO: `/v3/projects/68dd5aaf111a41b0974c3035d437038b/groups/354da553a5e24e99bb17ad62c677bdac/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:18.901640 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e4847-ae6d-4c99-9b7a-4c2b8fa78b55 None admin] RBAC: Authorizing `identity:create_grant(project_id=68dd5aaf111a41b0974c3035d437038b, group_id=354da553a5e24e99bb17ad62c677bdac, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:18.903077 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e4847-ae6d-4c99-9b7a-4c2b8fa78b55 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:18.943335 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 207/416] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Aug 30 15:46:18 2022] PUT /identity/v3/projects/68dd5aaf111a41b0974c3035d437038b/groups/354da553a5e24e99bb17ad62c677bdac/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:46:18.997839 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d85b0c-db30-4741-a15f-09a8dff07d9a None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:19.037762 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c5271-6faf-4076-9189-6e67893b9e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:19.038578 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c5271-6faf-4076-9189-6e67893b9e8b None admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:19.038861 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c5271-6faf-4076-9189-6e67893b9e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:19.039132 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c5271-6faf-4076-9189-6e67893b9e8b None admin] PATH_INFO: `/v3/projects/7c5e57fbc705432ab1fdaa879674274e/groups/a02d26f62b3c4994b3a8d4a596f9af72/roles/3e70c1b76757442a9bddbeab151c6fc6` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:19.041644 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c5271-6faf-4076-9189-6e67893b9e8b None admin] RBAC: Authorizing `identity:create_grant(project_id=7c5e57fbc705432ab1fdaa879674274e, group_id=a02d26f62b3c4994b3a8d4a596f9af72, role_id=3e70c1b76757442a9bddbeab151c6fc6)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:19.043182 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c5271-6faf-4076-9189-6e67893b9e8b None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:19.068262 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 210/417] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Aug 30 15:46:18 2022] PUT /identity/v3/projects/7c5e57fbc705432ab1fdaa879674274e/groups/a02d26f62b3c4994b3a8d4a596f9af72/roles/3e70c1b76757442a9bddbeab151c6fc6 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:46:19.159852 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44085089-1591-4c5b-a8e2-45820989655b None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:19.160055 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44085089-1591-4c5b-a8e2-45820989655b None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:19.160318 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44085089-1591-4c5b-a8e2-45820989655b None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:19.162028 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 208/418] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:19.168080 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb81ea-6f4f-4a62-a8e8-b7f8f4111d85 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:19.168434 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb81ea-6f4f-4a62-a8e8-b7f8f4111d85 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:19.168640 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb81ea-6f4f-4a62-a8e8-b7f8f4111d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:19.195196 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-89eb81ea-6f4f-4a62-a8e8-b7f8f4111d85 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:19.196460 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-89eb81ea-6f4f-4a62-a8e8-b7f8f4111d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:19.215597 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:19.244630 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44085089-1591-4c5b-a8e2-45820989655b None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:19.295635 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 211/419] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:46:19.417549 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44085089-1591-4c5b-a8e2-45820989655b None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:19.462643 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f48ec0c-a140-4867-af66-9667e6181f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:19.463290 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48ec0c-a140-4867-af66-9667e6181f21 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:19.463568 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48ec0c-a140-4867-af66-9667e6181f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:19.463839 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48ec0c-a140-4867-af66-9667e6181f21 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:19.477529 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f48ec0c-a140-4867-af66-9667e6181f21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:19.483541 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-9f48ec0c-a140-4867-af66-9667e6181f21 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 15:46:19.483541 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:19.483541 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:19.483541 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:19.483541 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:19.483541 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:19.483541 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:19.483541 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:19.483541 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:19.483541 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:19.483541 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:19.483541 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:19.483541 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:19.483541 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:19.483541 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:19.483541 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:19.484385 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:19.484385 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:19.484385 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:19.484385 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:19.484385 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:19.484385 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:19.484385 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:19.484385 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:19.484385 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:19.484385 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:19.484385 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:19.484385 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:19.484385 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:19.484385 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:19.484385 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:19.484385 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:19.485199 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:19.485199 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:19.485199 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:19.485199 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:19.485199 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:19.485199 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:19.485199 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:19.485199 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:19.485199 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:19.485199 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:19.485199 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 15:46:19.485199 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:19.489045 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 209/420] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:46:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 15:46:19.490335 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb81ea-6f4f-4a62-a8e8-b7f8f4111d85 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:19.657105 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb81ea-6f4f-4a62-a8e8-b7f8f4111d85 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:19.697689 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f48ec0c-a140-4867-af66-9667e6181f21 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:19.712262 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea449d-3361-4883-8b94-7e4f78ed24e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:19.712961 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea449d-3361-4883-8b94-7e4f78ed24e7 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:19.713242 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea449d-3361-4883-8b94-7e4f78ed24e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:19.713513 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea449d-3361-4883-8b94-7e4f78ed24e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:19.714194 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea449d-3361-4883-8b94-7e4f78ed24e7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:19.714496 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea449d-3361-4883-8b94-7e4f78ed24e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:19.716549 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea449d-3361-4883-8b94-7e4f78ed24e7 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:19.726727 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:19.736031 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 212/421] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 30 15:46:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:19.746441 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea449d-3361-4883-8b94-7e4f78ed24e7 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:19.770119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:19.819534 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f48ec0c-a140-4867-af66-9667e6181f21 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:19.858958 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86411725-ad2f-4910-a939-15b03e5449cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:19.860294 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86411725-ad2f-4910-a939-15b03e5449cd None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:19.860723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86411725-ad2f-4910-a939-15b03e5449cd None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:19.861158 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86411725-ad2f-4910-a939-15b03e5449cd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:19.872715 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86411725-ad2f-4910-a939-15b03e5449cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:19.878558 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-86411725-ad2f-4910-a939-15b03e5449cd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 15:46:19.878558 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:19.878558 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:19.878558 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:19.878558 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:19.878558 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:19.878558 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:19.878558 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:19.878558 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:19.878558 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:19.878558 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:19.878558 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:19.878558 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:19.878558 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:19.878558 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:19.878558 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:19.879633 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:19.879633 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:19.879633 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:19.879633 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:19.879633 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:19.879633 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:19.879633 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:19.879633 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:19.879633 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:19.879633 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:19.879633 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:19.879633 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:19.879633 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:19.879633 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:19.879633 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:19.879633 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:19.880603 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:19.880603 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:19.880603 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:19.880603 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:19.880603 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:19.880603 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:19.880603 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:19.880603 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:19.880603 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:19.880603 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:19.880603 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 15:46:19.880603 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:19.883094 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 210/422] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Aug 30 15:46:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 15:46:19.889502 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86411725-ad2f-4910-a939-15b03e5449cd None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:19.979632 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:19.991678 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea449d-3361-4883-8b94-7e4f78ed24e7 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:20.002439 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86411725-ad2f-4910-a939-15b03e5449cd None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:20.036971 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b12fb-7e61-44e0-9d34-f320557a4792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:20.037837 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b12fb-7e61-44e0-9d34-f320557a4792 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:20.038334 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b12fb-7e61-44e0-9d34-f320557a4792 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:20.038696 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b12fb-7e61-44e0-9d34-f320557a4792 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:20.046028 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8a047-1e08-4e15-8bb2-7664c116cd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:20.046822 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8a047-1e08-4e15-8bb2-7664c116cd46 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:20.047252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8a047-1e08-4e15-8bb2-7664c116cd46 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:20.047670 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8a047-1e08-4e15-8bb2-7664c116cd46 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:20.048470 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a8a047-1e08-4e15-8bb2-7664c116cd46 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:20.049348 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a8a047-1e08-4e15-8bb2-7664c116cd46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:20.051226 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a8a047-1e08-4e15-8bb2-7664c116cd46 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:20.066681 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 211/423] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:46:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:20.066681 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013e877-c3a5-4968-8a73-8b5739eb2c09 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:20.066681 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013e877-c3a5-4968-8a73-8b5739eb2c09 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:20.066681 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013e877-c3a5-4968-8a73-8b5739eb2c09 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:20.068150 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 212/424] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:20.069514 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013e877-c3a5-4968-8a73-8b5739eb2c09 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:20.124691 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b12fb-7e61-44e0-9d34-f320557a4792 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:20.126241 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b12fb-7e61-44e0-9d34-f320557a4792 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:20.139507 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:20.182366 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013e877-c3a5-4968-8a73-8b5739eb2c09 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:20.219037 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77247b-b6ac-4c9d-87d0-d70a484b3774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:20.219643 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77247b-b6ac-4c9d-87d0-d70a484b3774 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:20.219919 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77247b-b6ac-4c9d-87d0-d70a484b3774 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:20.220187 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77247b-b6ac-4c9d-87d0-d70a484b3774 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:20.236127 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:20.243805 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 213/425] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:46:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 15:46:20.245256 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0b60e-f34c-4b40-8a4b-4347cb54f757 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:20.245543 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0b60e-f34c-4b40-8a4b-4347cb54f757 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:20.245820 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0b60e-f34c-4b40-8a4b-4347cb54f757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:20.265880 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-ecb0b60e-f34c-4b40-8a4b-4347cb54f757 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:20.267192 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-ecb0b60e-f34c-4b40-8a4b-4347cb54f757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:20.295595 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe77247b-b6ac-4c9d-87d0-d70a484b3774 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:20.297293 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe77247b-b6ac-4c9d-87d0-d70a484b3774 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:20.351753 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 214/426] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:46:20.352677 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0b60e-f34c-4b40-8a4b-4347cb54f757 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:20.425903 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:20.469909 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 213/427] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:46:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 15:46:20.476527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77247b-b6ac-4c9d-87d0-d70a484b3774 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:20.554406 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0b60e-f34c-4b40-8a4b-4347cb54f757 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:20.568154 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:20.609631 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1cca4-1588-4761-99cc-e6697f292b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:20.610650 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1cca4-1588-4761-99cc-e6697f292b29 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:20.611129 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1cca4-1588-4761-99cc-e6697f292b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:20.611598 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1cca4-1588-4761-99cc-e6697f292b29 None admin] PATH_INFO: `/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:20.613056 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1cca4-1588-4761-99cc-e6697f292b29 None admin] RBAC: Authorizing `identity:get_project(project_id=ecc1689f0ba04f14ac9c0d53a2a4a32d)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:20.614701 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1cca4-1588-4761-99cc-e6697f292b29 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:20.617729 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 215/428] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:46:20 2022] GET /identity/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:20.624591 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1cca4-1588-4761-99cc-e6697f292b29 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:20.675276 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77247b-b6ac-4c9d-87d0-d70a484b3774 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:20.730511 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d1e12-a2f7-457a-95a4-5b84cb555153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:20.731497 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d1e12-a2f7-457a-95a4-5b84cb555153 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:20.732626 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d1e12-a2f7-457a-95a4-5b84cb555153 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:20.733138 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d1e12-a2f7-457a-95a4-5b84cb555153 None admin] PATH_INFO: `/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:20.735031 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d1e12-a2f7-457a-95a4-5b84cb555153 None admin] RBAC: Authorizing `identity:get_project(project_id=ecc1689f0ba04f14ac9c0d53a2a4a32d)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:20.737167 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d1e12-a2f7-457a-95a4-5b84cb555153 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:20.740204 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 214/429] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:46:20 2022] GET /identity/v3/projects/ecc1689f0ba04f14ac9c0d53a2a4a32d => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:20.745420 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d1e12-a2f7-457a-95a4-5b84cb555153 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:20.766558 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1cca4-1588-4761-99cc-e6697f292b29 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:20.777084 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:20.806655 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b94c5-4d52-4a6a-bb82-74f79d69a0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:20.807491 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b94c5-4d52-4a6a-bb82-74f79d69a0be None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:20.807873 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b94c5-4d52-4a6a-bb82-74f79d69a0be None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:20.808330 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b94c5-4d52-4a6a-bb82-74f79d69a0be None admin] PATH_INFO: `/v3/groups/a02d26f62b3c4994b3a8d4a596f9af72` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:20.809505 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1b94c5-4d52-4a6a-bb82-74f79d69a0be None admin] RBAC: Authorizing `identity:get_group(group_id=a02d26f62b3c4994b3a8d4a596f9af72)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:20.811269 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1b94c5-4d52-4a6a-bb82-74f79d69a0be None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:20.813493 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 216/430] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Aug 30 15:46:20 2022] GET /identity/v3/groups/a02d26f62b3c4994b3a8d4a596f9af72 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:20.814515 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b94c5-4d52-4a6a-bb82-74f79d69a0be None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:20.883149 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d1e12-a2f7-457a-95a4-5b84cb555153 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:20.898909 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:20.923848 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f21e81-d46a-4e2f-9e44-abdddaf79739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:20.924679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f21e81-d46a-4e2f-9e44-abdddaf79739 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:20.925507 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f21e81-d46a-4e2f-9e44-abdddaf79739 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:20.925970 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f21e81-d46a-4e2f-9e44-abdddaf79739 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:20.939356 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f21e81-d46a-4e2f-9e44-abdddaf79739 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:20.943639 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b94c5-4d52-4a6a-bb82-74f79d69a0be None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:20.944622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-91f21e81-d46a-4e2f-9e44-abdddaf79739 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 15:46:20.944622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:20.944622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:20.944622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:20.944622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:20.944622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:20.944622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:20.944622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:20.944622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:20.944622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:20.944622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:20.944622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:20.944622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:20.944622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:20.944622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:20.944622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:20.945679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:20.945679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:20.945679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:20.945679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:20.945679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:20.945679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:20.945679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:20.945679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:20.945679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:20.945679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:20.945679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:20.945679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:20.945679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:20.945679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:20.945679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:20.945679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:20.946669 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:20.946669 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:20.946669 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:20.946669 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:20.946669 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:20.946669 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:20.946669 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:20.946669 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:20.946669 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:20.946669 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:20.946669 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 15:46:20.946669 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:20.953838 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 215/431] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:46:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:20.954850 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f21e81-d46a-4e2f-9e44-abdddaf79739 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:20.988675 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55078b82-a60b-44f2-9255-368a2e044d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:20.989571 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55078b82-a60b-44f2-9255-368a2e044d5a None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:20.990064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55078b82-a60b-44f2-9255-368a2e044d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:20.990392 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55078b82-a60b-44f2-9255-368a2e044d5a None admin] PATH_INFO: `/v3/groups/a02d26f62b3c4994b3a8d4a596f9af72` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:20.991714 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55078b82-a60b-44f2-9255-368a2e044d5a None admin] RBAC: Authorizing `identity:get_group(group_id=a02d26f62b3c4994b3a8d4a596f9af72)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:20.993304 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55078b82-a60b-44f2-9255-368a2e044d5a None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:20.995259 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 217/432] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Aug 30 15:46:20 2022] GET /identity/v3/groups/a02d26f62b3c4994b3a8d4a596f9af72 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:21.000141 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55078b82-a60b-44f2-9255-368a2e044d5a None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:21.054199 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:21.089497 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f21e81-d46a-4e2f-9e44-abdddaf79739 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:21.124075 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55078b82-a60b-44f2-9255-368a2e044d5a None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:21.138599 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eeedb1-c225-4f7f-8fae-c6de77aa3baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:21.139617 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eeedb1-c225-4f7f-8fae-c6de77aa3baf None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:21.140057 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eeedb1-c225-4f7f-8fae-c6de77aa3baf None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:21.140469 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eeedb1-c225-4f7f-8fae-c6de77aa3baf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:21.142060 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eeedb1-c225-4f7f-8fae-c6de77aa3baf None admin] RBAC: Adding query filter params (group.id=a02d26f62b3c4994b3a8d4a596f9af72, role.id=a82e6f447c1b4b56b530dacfae06dee1, scope.project.id=ecc1689f0ba04f14ac9c0d53a2a4a32d) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:21.142519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eeedb1-c225-4f7f-8fae-c6de77aa3baf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:21.144954 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eeedb1-c225-4f7f-8fae-c6de77aa3baf None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:21.154420 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 216/433] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Aug 30 15:46:20 2022] GET /identity/v3/role_assignments?group.id=a02d26f62b3c4994b3a8d4a596f9af72&scope.project.id=ecc1689f0ba04f14ac9c0d53a2a4a32d&role.id=a82e6f447c1b4b56b530dacfae06dee1 => generated 611 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:21.155706 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eeedb1-c225-4f7f-8fae-c6de77aa3baf None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:21.178913 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1396ac-ffa8-4690-b9ae-879d52a9647e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:21.179633 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1396ac-ffa8-4690-b9ae-879d52a9647e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:21.179918 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1396ac-ffa8-4690-b9ae-879d52a9647e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:21.180199 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1396ac-ffa8-4690-b9ae-879d52a9647e None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:21.181001 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1396ac-ffa8-4690-b9ae-879d52a9647e None admin] RBAC: Adding query filter params (name=member) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:21.185226 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1396ac-ffa8-4690-b9ae-879d52a9647e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:21.186909 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1396ac-ffa8-4690-b9ae-879d52a9647e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:21.214158 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 218/434] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 30 15:46:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:21.222841 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1396ac-ffa8-4690-b9ae-879d52a9647e None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:21.247620 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:21.331938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eeedb1-c225-4f7f-8fae-c6de77aa3baf None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:21.370629 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04739e7-a3cc-44aa-8f5d-f661f49a5d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:21.371386 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04739e7-a3cc-44aa-8f5d-f661f49a5d7f None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:21.371386 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04739e7-a3cc-44aa-8f5d-f661f49a5d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:21.371640 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04739e7-a3cc-44aa-8f5d-f661f49a5d7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:21.372433 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04739e7-a3cc-44aa-8f5d-f661f49a5d7f None admin] RBAC: Adding query filter params (group.id=a02d26f62b3c4994b3a8d4a596f9af72, role.id=3e70c1b76757442a9bddbeab151c6fc6, scope.project.id=ecc1689f0ba04f14ac9c0d53a2a4a32d) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:21.372743 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04739e7-a3cc-44aa-8f5d-f661f49a5d7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:21.374269 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04739e7-a3cc-44aa-8f5d-f661f49a5d7f None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:21.380336 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 217/435] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Aug 30 15:46:21 2022] GET /identity/v3/role_assignments?group.id=a02d26f62b3c4994b3a8d4a596f9af72&scope.project.id=ecc1689f0ba04f14ac9c0d53a2a4a32d&role.id=3e70c1b76757442a9bddbeab151c6fc6 => generated 611 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:21.382594 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa1a35-4803-4288-b9a9-39583327dbe5 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:21.382888 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa1a35-4803-4288-b9a9-39583327dbe5 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:21.383165 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa1a35-4803-4288-b9a9-39583327dbe5 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:21.384453 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 218/436] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:21.385743 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebee23b-6a28-40aa-a8e6-e0d5857d4fd1 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:21.386090 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebee23b-6a28-40aa-a8e6-e0d5857d4fd1 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:21.386365 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebee23b-6a28-40aa-a8e6-e0d5857d4fd1 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:21.388341 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 219/437] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:21.394151 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1396ac-ffa8-4690-b9ae-879d52a9647e None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:21.394345 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30adae-7e30-4155-bcda-c3d877f7ce25 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:21.394603 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30adae-7e30-4155-bcda-c3d877f7ce25 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:21.394785 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30adae-7e30-4155-bcda-c3d877f7ce25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:21.403011 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:21.416273 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-7e30adae-7e30-4155-bcda-c3d877f7ce25 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:21.417641 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7e30adae-7e30-4155-bcda-c3d877f7ce25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:21.454551 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab86171-5b64-4c43-9a4d-89b11c12670e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:21.455188 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab86171-5b64-4c43-9a4d-89b11c12670e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:21.455466 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab86171-5b64-4c43-9a4d-89b11c12670e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:21.455989 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab86171-5b64-4c43-9a4d-89b11c12670e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:21.512283 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 220/438] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:46:21.516822 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c73a7-9a08-400d-ad64-3688cabd59bc None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:21.516822 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c73a7-9a08-400d-ad64-3688cabd59bc None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:21.516822 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c73a7-9a08-400d-ad64-3688cabd59bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:21.534679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-204c73a7-9a08-400d-ad64-3688cabd59bc None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:21.535889 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-204c73a7-9a08-400d-ad64-3688cabd59bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:21.556089 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab86171-5b64-4c43-9a4d-89b11c12670e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:21.557821 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab86171-5b64-4c43-9a4d-89b11c12670e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:21.564629 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:21.621579 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 221/439] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:46:21.675678 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 219/440] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:46:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 15:46:21.681255 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c73a7-9a08-400d-ad64-3688cabd59bc None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:21.791967 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c73a7-9a08-400d-ad64-3688cabd59bc None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:21.828723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a8036-a62d-483c-920d-68a571221d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:21.829393 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a8036-a62d-483c-920d-68a571221d3e None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:21.829719 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a8036-a62d-483c-920d-68a571221d3e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:21.829992 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a8036-a62d-483c-920d-68a571221d3e None admin] PATH_INFO: `/v3/projects/7c5e57fbc705432ab1fdaa879674274e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:21.831121 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a8036-a62d-483c-920d-68a571221d3e None admin] RBAC: Authorizing `identity:get_project(project_id=7c5e57fbc705432ab1fdaa879674274e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:21.832539 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a8036-a62d-483c-920d-68a571221d3e None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:21.834486 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 222/441] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:46:21 2022] GET /identity/v3/projects/7c5e57fbc705432ab1fdaa879674274e => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:21.839572 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab86171-5b64-4c43-9a4d-89b11c12670e None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:21.849771 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:21.849994 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a8036-a62d-483c-920d-68a571221d3e None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:21.882706 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:21.974547 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a8036-a62d-483c-920d-68a571221d3e None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:21.978935 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab86171-5b64-4c43-9a4d-89b11c12670e None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:22.007793 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1888090-1bbb-4987-adc0-cd38aef9f400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:22.008499 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1888090-1bbb-4987-adc0-cd38aef9f400 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:22.008797 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1888090-1bbb-4987-adc0-cd38aef9f400 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:22.009076 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1888090-1bbb-4987-adc0-cd38aef9f400 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:22.012590 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e7b3f-5c68-407c-b839-329c6fd50101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:22.013768 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e7b3f-5c68-407c-b839-329c6fd50101 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:22.014052 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e7b3f-5c68-407c-b839-329c6fd50101 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:22.014326 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e7b3f-5c68-407c-b839-329c6fd50101 None admin] PATH_INFO: `/v3/groups/a02d26f62b3c4994b3a8d4a596f9af72` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:22.015457 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44e7b3f-5c68-407c-b839-329c6fd50101 None admin] RBAC: Authorizing `identity:get_group(group_id=a02d26f62b3c4994b3a8d4a596f9af72)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:22.016946 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44e7b3f-5c68-407c-b839-329c6fd50101 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:22.018781 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 220/442] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Aug 30 15:46:21 2022] GET /identity/v3/groups/a02d26f62b3c4994b3a8d4a596f9af72 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:46:22.019534 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e7b3f-5c68-407c-b839-329c6fd50101 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:22.024500 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1888090-1bbb-4987-adc0-cd38aef9f400 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:22.030011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-d1888090-1bbb-4987-adc0-cd38aef9f400 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:46:22.030011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:22.030011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:22.030011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:22.030011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:22.030011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:22.030011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:22.030011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:22.030011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:22.030011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:22.030011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:22.030011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:22.030011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:22.030011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:22.030011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:22.030011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:22.031071 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:22.031071 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:22.031071 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:22.031071 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:22.031071 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:22.031071 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:22.031071 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:22.031071 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:22.031071 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:22.031071 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:22.031071 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:22.031071 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:22.031071 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:22.031071 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:22.031071 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:22.031071 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:22.031857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:22.031857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:22.031857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:22.031857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:22.031857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:22.031857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:22.031857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:22.031857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:22.031857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:22.031857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:22.031857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:46:22.031857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:22.031857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 223/443] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 30 15:46:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 15:46:22.031857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1888090-1bbb-4987-adc0-cd38aef9f400 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:22.095957 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:22.119794 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:22.120907 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e7b3f-5c68-407c-b839-329c6fd50101 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:22.132425 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1888090-1bbb-4987-adc0-cd38aef9f400 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:22.155671 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b115518-0f67-4a45-b903-5c0ed84b24be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:22.156232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b115518-0f67-4a45-b903-5c0ed84b24be None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:22.156510 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b115518-0f67-4a45-b903-5c0ed84b24be None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:22.156794 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b115518-0f67-4a45-b903-5c0ed84b24be None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:22.166648 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b115518-0f67-4a45-b903-5c0ed84b24be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:22.167482 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c3033-e3ba-4925-8983-64b19deff763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:22.168107 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c3033-e3ba-4925-8983-64b19deff763 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:22.168387 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c3033-e3ba-4925-8983-64b19deff763 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:22.168658 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c3033-e3ba-4925-8983-64b19deff763 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:22.169702 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c3033-e3ba-4925-8983-64b19deff763 None admin] RBAC: Adding query filter params (group.id=a02d26f62b3c4994b3a8d4a596f9af72, role.id=a82e6f447c1b4b56b530dacfae06dee1, scope.project.id=7c5e57fbc705432ab1fdaa879674274e) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:22.170010 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c3033-e3ba-4925-8983-64b19deff763 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:22.171451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c3033-e3ba-4925-8983-64b19deff763 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:22.171658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-7b115518-0f67-4a45-b903-5c0ed84b24be None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 15:46:22.171658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:22.171658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:22.171658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:22.171658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:22.171658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:22.171658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:22.171658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:22.171658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:22.171658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:22.171658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:22.171658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:22.171658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:22.171658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:22.171658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:22.171658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:22.172641 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:22.172641 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:22.172641 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:22.172641 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:22.172641 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:22.172641 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:22.172641 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:22.172641 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:22.172641 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:22.172641 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:22.172641 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:22.172641 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:22.172641 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:22.172641 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:22.172641 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:22.172641 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:22.173543 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:22.173543 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:22.173543 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:22.173543 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:22.173543 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:22.173543 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:22.173543 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:22.173543 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:22.173543 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:22.173543 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:22.173543 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 15:46:22.173543 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:22.173543 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 221/444] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Aug 30 15:46:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:22.174497 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b115518-0f67-4a45-b903-5c0ed84b24be None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:22.179757 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 224/445] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Aug 30 15:46:22 2022] GET /identity/v3/role_assignments?group.id=a02d26f62b3c4994b3a8d4a596f9af72&scope.project.id=7c5e57fbc705432ab1fdaa879674274e&role.id=a82e6f447c1b4b56b530dacfae06dee1 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:22.180482 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c3033-e3ba-4925-8983-64b19deff763 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:22.294865 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b115518-0f67-4a45-b903-5c0ed84b24be None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:22.296428 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c3033-e3ba-4925-8983-64b19deff763 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:22.335756 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c2ca6-2c91-40f9-a420-1f46a1dab336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:22.336376 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c2ca6-2c91-40f9-a420-1f46a1dab336 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:22.336661 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c2ca6-2c91-40f9-a420-1f46a1dab336 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:22.336998 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c2ca6-2c91-40f9-a420-1f46a1dab336 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:22.337303 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa52e7-c7ec-470f-8940-a90f35111628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:22.337676 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c2ca6-2c91-40f9-a420-1f46a1dab336 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:22.337913 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa52e7-c7ec-470f-8940-a90f35111628 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:22.338011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c2ca6-2c91-40f9-a420-1f46a1dab336 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:22.338190 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa52e7-c7ec-470f-8940-a90f35111628 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:22.338459 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa52e7-c7ec-470f-8940-a90f35111628 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:22.339132 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fa52e7-c7ec-470f-8940-a90f35111628 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:22.339372 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c2ca6-2c91-40f9-a420-1f46a1dab336 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:22.339474 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fa52e7-c7ec-470f-8940-a90f35111628 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:22.340872 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fa52e7-c7ec-470f-8940-a90f35111628 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:22.342618 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:22.351505 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 225/446] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:46:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:22.351686 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 222/447] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:46:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:22.356670 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c2ca6-2c91-40f9-a420-1f46a1dab336 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:22.359341 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa52e7-c7ec-470f-8940-a90f35111628 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:22.374874 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:22.480270 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c2ca6-2c91-40f9-a420-1f46a1dab336 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:22.489674 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa52e7-c7ec-470f-8940-a90f35111628 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:22.521912 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dac6c9-487e-4b22-91a1-7e5ddf9ad3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:22.522761 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dac6c9-487e-4b22-91a1-7e5ddf9ad3ec None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:22.523224 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dac6c9-487e-4b22-91a1-7e5ddf9ad3ec None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:22.523496 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dac6c9-487e-4b22-91a1-7e5ddf9ad3ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:22.531390 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d8139-0557-411e-9a33-90141a88c8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:22.532097 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d8139-0557-411e-9a33-90141a88c8e4 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:22.532482 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d8139-0557-411e-9a33-90141a88c8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:22.532863 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d8139-0557-411e-9a33-90141a88c8e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:22.591222 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dac6c9-487e-4b22-91a1-7e5ddf9ad3ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:22.592872 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dac6c9-487e-4b22-91a1-7e5ddf9ad3ec None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:22.594134 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:22.601314 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d8139-0557-411e-9a33-90141a88c8e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:22.602775 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d8139-0557-411e-9a33-90141a88c8e4 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:22.608481 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:22.691861 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 226/448] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:46:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 15:46:22.697581 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dac6c9-487e-4b22-91a1-7e5ddf9ad3ec None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:22.703239 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 223/449] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:46:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 15:46:22.708709 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d8139-0557-411e-9a33-90141a88c8e4 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:22.799387 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dac6c9-487e-4b22-91a1-7e5ddf9ad3ec None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:22.801961 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:22.808074 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d8139-0557-411e-9a33-90141a88c8e4 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:22.813582 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:22.833339 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf0be9-b9fa-4be3-8bf5-be949e3d5d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:22.833965 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf0be9-b9fa-4be3-8bf5-be949e3d5d74 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:22.834238 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf0be9-b9fa-4be3-8bf5-be949e3d5d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:22.834510 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf0be9-b9fa-4be3-8bf5-be949e3d5d74 None admin] PATH_INFO: `/v3/projects/7c5e57fbc705432ab1fdaa879674274e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:22.835622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf0be9-b9fa-4be3-8bf5-be949e3d5d74 None admin] RBAC: Authorizing `identity:get_project(project_id=7c5e57fbc705432ab1fdaa879674274e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:22.837085 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf0be9-b9fa-4be3-8bf5-be949e3d5d74 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:22.838680 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 227/450] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:46:22 2022] GET /identity/v3/projects/7c5e57fbc705432ab1fdaa879674274e => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:46:22.841777 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe9f2b-b300-4762-a8a5-7bf2924b8f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:22.842405 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe9f2b-b300-4762-a8a5-7bf2924b8f10 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:22.842684 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe9f2b-b300-4762-a8a5-7bf2924b8f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:22.842958 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe9f2b-b300-4762-a8a5-7bf2924b8f10 None admin] PATH_INFO: `/v3/projects/68dd5aaf111a41b0974c3035d437038b` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:22.844078 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf0be9-b9fa-4be3-8bf5-be949e3d5d74 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:22.844180 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe9f2b-b300-4762-a8a5-7bf2924b8f10 None admin] RBAC: Authorizing `identity:get_project(project_id=68dd5aaf111a41b0974c3035d437038b)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:22.845545 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe9f2b-b300-4762-a8a5-7bf2924b8f10 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:22.847154 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 224/451] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:46:22 2022] GET /identity/v3/projects/68dd5aaf111a41b0974c3035d437038b => generated 344 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:46:22.852275 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe9f2b-b300-4762-a8a5-7bf2924b8f10 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:22.942005 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf0be9-b9fa-4be3-8bf5-be949e3d5d74 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:22.951478 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe9f2b-b300-4762-a8a5-7bf2924b8f10 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:22.975398 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610c05d-761d-4393-9894-fe15be13a87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:22.976049 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610c05d-761d-4393-9894-fe15be13a87a None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:22.976332 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610c05d-761d-4393-9894-fe15be13a87a None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:22.976603 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610c05d-761d-4393-9894-fe15be13a87a None admin] PATH_INFO: `/v3/groups/a02d26f62b3c4994b3a8d4a596f9af72` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:22.977739 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3610c05d-761d-4393-9894-fe15be13a87a None admin] RBAC: Authorizing `identity:get_group(group_id=a02d26f62b3c4994b3a8d4a596f9af72)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:22.979168 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3610c05d-761d-4393-9894-fe15be13a87a None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:22.980699 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 228/452] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Aug 30 15:46:22 2022] GET /identity/v3/groups/a02d26f62b3c4994b3a8d4a596f9af72 => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:46:22.985349 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd299ff-645f-487f-8a3d-f5502046802b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:22.986276 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd299ff-645f-487f-8a3d-f5502046802b None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:22.986380 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd299ff-645f-487f-8a3d-f5502046802b None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:22.986623 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd299ff-645f-487f-8a3d-f5502046802b None admin] PATH_INFO: `/v3/groups/354da553a5e24e99bb17ad62c677bdac` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:22.987069 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610c05d-761d-4393-9894-fe15be13a87a None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:22.987754 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd299ff-645f-487f-8a3d-f5502046802b None admin] RBAC: Authorizing `identity:get_group(group_id=354da553a5e24e99bb17ad62c677bdac)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:22.989237 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd299ff-645f-487f-8a3d-f5502046802b None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:22.991755 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 225/453] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Aug 30 15:46:22 2022] GET /identity/v3/groups/354da553a5e24e99bb17ad62c677bdac => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:46:22.996239 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd299ff-645f-487f-8a3d-f5502046802b None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:23.027018 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:23.037807 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:23.088213 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610c05d-761d-4393-9894-fe15be13a87a None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:23.098103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd299ff-645f-487f-8a3d-f5502046802b None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:23.122680 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd2e66-a6d3-4b49-b49d-6eeb66b80a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:23.123284 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd2e66-a6d3-4b49-b49d-6eeb66b80a5a None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:23.123563 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd2e66-a6d3-4b49-b49d-6eeb66b80a5a None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:23.123850 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd2e66-a6d3-4b49-b49d-6eeb66b80a5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:23.124554 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd2e66-a6d3-4b49-b49d-6eeb66b80a5a None admin] RBAC: Adding query filter params (group.id=a02d26f62b3c4994b3a8d4a596f9af72, role.id=3e70c1b76757442a9bddbeab151c6fc6, scope.project.id=7c5e57fbc705432ab1fdaa879674274e) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:23.124898 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd2e66-a6d3-4b49-b49d-6eeb66b80a5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:23.126319 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd2e66-a6d3-4b49-b49d-6eeb66b80a5a None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:23.131921 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 229/454] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Aug 30 15:46:22 2022] GET /identity/v3/role_assignments?group.id=a02d26f62b3c4994b3a8d4a596f9af72&scope.project.id=7c5e57fbc705432ab1fdaa879674274e&role.id=3e70c1b76757442a9bddbeab151c6fc6 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:46:23.136868 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736aa145-08b4-4ede-875c-f0787648988f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:23.137502 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736aa145-08b4-4ede-875c-f0787648988f None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:23.138009 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736aa145-08b4-4ede-875c-f0787648988f None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:23.138505 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736aa145-08b4-4ede-875c-f0787648988f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:23.139324 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736aa145-08b4-4ede-875c-f0787648988f None admin] RBAC: Adding query filter params (group.id=354da553a5e24e99bb17ad62c677bdac, role.id=676938e69210499ca11ee75dd572d0dc, scope.project.id=68dd5aaf111a41b0974c3035d437038b) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:23.139637 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736aa145-08b4-4ede-875c-f0787648988f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:23.141165 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736aa145-08b4-4ede-875c-f0787648988f None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:23.148145 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 226/455] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Aug 30 15:46:22 2022] GET /identity/v3/role_assignments?group.id=354da553a5e24e99bb17ad62c677bdac&scope.project.id=68dd5aaf111a41b0974c3035d437038b&role.id=676938e69210499ca11ee75dd572d0dc => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:46:25.610231 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d6193-053a-43b6-b0b1-9bf7dbd68919 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:25.610768 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d6193-053a-43b6-b0b1-9bf7dbd68919 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:25.610768 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d6193-053a-43b6-b0b1-9bf7dbd68919 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:25.612388 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 230/456] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:25.617296 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c2b81-5a88-4f91-96f8-69d670b16bf5 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:25.617699 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c2b81-5a88-4f91-96f8-69d670b16bf5 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:25.617885 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c2b81-5a88-4f91-96f8-69d670b16bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:25.654376 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-ae4c2b81-5a88-4f91-96f8-69d670b16bf5 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:25.655589 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-ae4c2b81-5a88-4f91-96f8-69d670b16bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:25.748415 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 227/457] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 15:46:25.937111 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03395297-1184-408c-a6a4-224c117b909f None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:25.937446 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03395297-1184-408c-a6a4-224c117b909f None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:25.937562 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03395297-1184-408c-a6a4-224c117b909f None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:25.939166 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 231/458] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:25.944324 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6862c2-128f-43b1-94be-192da1d7ad58 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:25.944617 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6862c2-128f-43b1-94be-192da1d7ad58 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:25.944935 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6862c2-128f-43b1-94be-192da1d7ad58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:25.968011 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-4a6862c2-128f-43b1-94be-192da1d7ad58 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:25.969554 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-4a6862c2-128f-43b1-94be-192da1d7ad58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:25.996685 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:26.001704 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea363f8-477d-4e2b-90b4-a958db2ffd5b None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:26.001999 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea363f8-477d-4e2b-90b4-a958db2ffd5b None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:26.002685 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea363f8-477d-4e2b-90b4-a958db2ffd5b None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:26.004561 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 232/459] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:26.010779 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31dcc90-32e2-4910-9be2-e6118ac68af2 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:26.011232 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31dcc90-32e2-4910-9be2-e6118ac68af2 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:26.011681 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31dcc90-32e2-4910-9be2-e6118ac68af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:26.053822 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-e31dcc90-32e2-4910-9be2-e6118ac68af2 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:26.055250 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-e31dcc90-32e2-4910-9be2-e6118ac68af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:26.069254 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 228/460] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:46:26.156654 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6862c2-128f-43b1-94be-192da1d7ad58 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:26.157902 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 233/461] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:46:26.313659 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6862c2-128f-43b1-94be-192da1d7ad58 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:26.348232 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475c2af-1c29-4e00-a06e-f99dde0120b2 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:26.348669 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475c2af-1c29-4e00-a06e-f99dde0120b2 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:26.349210 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475c2af-1c29-4e00-a06e-f99dde0120b2 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:26.350882 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 234/462] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 15:46:26.355629 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a046f11-0a07-4fd7-83c8-1911eefe653f None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:26.355993 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a046f11-0a07-4fd7-83c8-1911eefe653f None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:26.356382 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a046f11-0a07-4fd7-83c8-1911eefe653f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:26.365386 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fc0e7-ebca-4ed9-ad71-fed0c4fdc152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:26.366288 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fc0e7-ebca-4ed9-ad71-fed0c4fdc152 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:26.366757 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fc0e7-ebca-4ed9-ad71-fed0c4fdc152 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:26.367201 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fc0e7-ebca-4ed9-ad71-fed0c4fdc152 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:26.386806 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3fc0e7-ebca-4ed9-ad71-fed0c4fdc152 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:26.388408 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-8a046f11-0a07-4fd7-83c8-1911eefe653f None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:26.388899 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3fc0e7-ebca-4ed9-ad71-fed0c4fdc152 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:26.390122 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-8a046f11-0a07-4fd7-83c8-1911eefe653f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:26.412365 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-9f3fc0e7-ebca-4ed9-ad71-fed0c4fdc152 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:26.412365 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:26.412365 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:26.412365 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:26.412365 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:26.412365 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:26.412365 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:26.412365 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:26.412365 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:26.412365 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:26.412365 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:26.412365 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:26.412365 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:26.412365 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:26.412365 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:26.412365 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:26.413334 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:26.413334 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:26.413334 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:26.413334 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:26.413334 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:26.413334 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:26.413334 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:26.413334 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:26.413334 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:26.413334 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:26.413334 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:26.413334 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:26.413334 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:26.413334 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:26.413334 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:26.413334 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:26.413334 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:26.414154 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:26.414154 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:26.414154 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:26.419653 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 229/463] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 15:46:26.421131 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fc0e7-ebca-4ed9-ad71-fed0c4fdc152 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:26.436603 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:26.441567 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:26.475733 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 235/464] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:46:26.475733 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a046f11-0a07-4fd7-83c8-1911eefe653f None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:26.562750 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fc0e7-ebca-4ed9-ad71-fed0c4fdc152 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:26.593443 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a046f11-0a07-4fd7-83c8-1911eefe653f None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:26.602891 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91150557-97c1-418a-a5b6-bcfa8a08e016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:26.603515 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91150557-97c1-418a-a5b6-bcfa8a08e016 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:26.604249 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91150557-97c1-418a-a5b6-bcfa8a08e016 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:26.604537 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91150557-97c1-418a-a5b6-bcfa8a08e016 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:26.605650 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91150557-97c1-418a-a5b6-bcfa8a08e016 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:26.605963 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91150557-97c1-418a-a5b6-bcfa8a08e016 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:26.608180 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91150557-97c1-418a-a5b6-bcfa8a08e016 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:26.631025 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702e7db-8e04-407f-9112-78df2940d6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:26.631755 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 230/465] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:46:26.632125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702e7db-8e04-407f-9112-78df2940d6f9 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:26.632125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702e7db-8e04-407f-9112-78df2940d6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:26.632345 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702e7db-8e04-407f-9112-78df2940d6f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:26.632641 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91150557-97c1-418a-a5b6-bcfa8a08e016 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:26.645223 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8702e7db-8e04-407f-9112-78df2940d6f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:26.646759 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8702e7db-8e04-407f-9112-78df2940d6f9 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:26.663411 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-8702e7db-8e04-407f-9112-78df2940d6f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:26.663411 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:26.663411 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:26.663411 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:26.663411 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:26.663411 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:26.663411 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:26.663411 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:26.663411 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:26.663411 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:26.663411 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:26.663411 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:26.663411 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:26.663411 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:26.663411 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:26.663411 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:26.664289 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:26.664289 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:26.664289 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:26.664289 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:26.664289 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:26.664289 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:26.664289 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:26.664289 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:26.664289 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:26.664289 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:26.664289 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:26.664289 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:26.664289 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:26.664289 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:26.664289 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:26.664289 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:26.664289 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:26.665125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:26.665125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:26.665125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:26.665125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 236/466] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:26.666272 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702e7db-8e04-407f-9112-78df2940d6f9 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:26.696163 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:26.719121 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:26.764976 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91150557-97c1-418a-a5b6-bcfa8a08e016 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:26.794314 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702e7db-8e04-407f-9112-78df2940d6f9 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:26.800808 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023b19e-03cc-4f7d-996f-361bcf0c503e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:26.801469 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023b19e-03cc-4f7d-996f-361bcf0c503e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:26.801734 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023b19e-03cc-4f7d-996f-361bcf0c503e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:26.802004 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023b19e-03cc-4f7d-996f-361bcf0c503e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:26.813713 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023b19e-03cc-4f7d-996f-361bcf0c503e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:26.815189 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023b19e-03cc-4f7d-996f-361bcf0c503e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:26.830343 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50479e-bc1a-4793-a5b9-14166c9d9e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:26.830968 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-5023b19e-03cc-4f7d-996f-361bcf0c503e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:26.830968 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:26.830968 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:26.830968 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:26.830968 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:26.830968 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:26.830968 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:26.830968 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:26.830968 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:26.830968 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:26.830968 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:26.830968 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:26.830968 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:26.830968 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:26.830968 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:26.830968 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:26.831799 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:26.831799 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:26.831799 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:26.831799 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:26.831799 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:26.831799 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:26.831799 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:26.831799 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:26.831799 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:26.831799 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:26.831799 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:26.831799 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:26.831799 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:26.831799 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:26.831799 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:26.831799 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:26.831799 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:26.832630 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:26.832630 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:26.832630 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:26.832806 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50479e-bc1a-4793-a5b9-14166c9d9e25 None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:26.832806 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50479e-bc1a-4793-a5b9-14166c9d9e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:26.832806 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50479e-bc1a-4793-a5b9-14166c9d9e25 None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:26.833009 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 231/467] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:26.833075 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d50479e-bc1a-4793-a5b9-14166c9d9e25 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:26.833970 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d50479e-bc1a-4793-a5b9-14166c9d9e25 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:26.837613 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023b19e-03cc-4f7d-996f-361bcf0c503e None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:26.864897 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 237/468] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Aug 30 15:46:26 2022] POST /identity/v3/users => generated 246 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:46:26.864897 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50479e-bc1a-4793-a5b9-14166c9d9e25 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:26.973006 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023b19e-03cc-4f7d-996f-361bcf0c503e None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:26.983977 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:27.005987 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:27.011620 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50479e-bc1a-4793-a5b9-14166c9d9e25 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:27.030368 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0ca92-aa4f-439b-87bc-32ac80057c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:27.030992 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0ca92-aa4f-439b-87bc-32ac80057c78 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:27.031426 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0ca92-aa4f-439b-87bc-32ac80057c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:27.031711 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0ca92-aa4f-439b-87bc-32ac80057c78 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:27.032718 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf0ca92-aa4f-439b-87bc-32ac80057c78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:27.033049 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf0ca92-aa4f-439b-87bc-32ac80057c78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:27.034556 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf0ca92-aa4f-439b-87bc-32ac80057c78 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:27.050443 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 232/469] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:27.051288 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0ca92-aa4f-439b-87bc-32ac80057c78 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:27.061538 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70935521-0e51-426b-b2c7-18f9f1b7e57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:27.062203 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70935521-0e51-426b-b2c7-18f9f1b7e57f None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:27.062203 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70935521-0e51-426b-b2c7-18f9f1b7e57f None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:27.062585 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70935521-0e51-426b-b2c7-18f9f1b7e57f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:27.079928 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70935521-0e51-426b-b2c7-18f9f1b7e57f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:27.079928 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70935521-0e51-426b-b2c7-18f9f1b7e57f None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:27.098107 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-70935521-0e51-426b-b2c7-18f9f1b7e57f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:27.098107 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:27.098107 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:27.098107 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:27.098107 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:27.098107 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:27.098107 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:27.098107 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:27.098107 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:27.098107 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:27.098107 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:27.098107 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:27.098107 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:27.098107 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:27.098107 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:27.098107 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:27.099025 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:27.099025 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:27.099025 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:27.099025 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:27.099025 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:27.099025 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:27.099025 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:27.099025 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:27.099025 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:27.099025 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:27.099025 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:27.099025 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:27.099025 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:27.099025 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:27.099025 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:27.099025 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:27.099025 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:27.099851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:27.099851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:27.099851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:27.099851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 238/470] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:27.100078 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70935521-0e51-426b-b2c7-18f9f1b7e57f None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:27.184178 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0ca92-aa4f-439b-87bc-32ac80057c78 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:27.223611 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f8064-0807-41e7-97dd-a951ec3a516f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:27.224218 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f8064-0807-41e7-97dd-a951ec3a516f None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:27.224496 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f8064-0807-41e7-97dd-a951ec3a516f None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:27.224765 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f8064-0807-41e7-97dd-a951ec3a516f None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:27.225438 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f8064-0807-41e7-97dd-a951ec3a516f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:27.225736 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f8064-0807-41e7-97dd-a951ec3a516f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:27.227133 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f8064-0807-41e7-97dd-a951ec3a516f None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:27.238153 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70935521-0e51-426b-b2c7-18f9f1b7e57f None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:27.244494 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 233/471] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:27.244494 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f8064-0807-41e7-97dd-a951ec3a516f None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:27.288506 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b90464-6967-4cd7-9dd9-846517a05a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:27.289521 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b90464-6967-4cd7-9dd9-846517a05a07 None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:27.290050 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b90464-6967-4cd7-9dd9-846517a05a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:27.290514 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:27.291323 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b90464-6967-4cd7-9dd9-846517a05a07 None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:27.292363 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b90464-6967-4cd7-9dd9-846517a05a07 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:27.295357 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b90464-6967-4cd7-9dd9-846517a05a07 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:27.304375 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:27.320479 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 239/472] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Aug 30 15:46:27 2022] POST /identity/v3/users => generated 248 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:46:27.321806 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10330f-1a17-4495-b2f5-c6998526361b None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:27.322100 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10330f-1a17-4495-b2f5-c6998526361b None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:27.322351 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10330f-1a17-4495-b2f5-c6998526361b None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:27.324929 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 240/473] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:27.324929 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10330f-1a17-4495-b2f5-c6998526361b None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:27.367535 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f8064-0807-41e7-97dd-a951ec3a516f None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:27.406522 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ebc6e-3811-473d-a94e-f10abfa4a41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:27.407424 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ebc6e-3811-473d-a94e-f10abfa4a41b None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:27.407845 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ebc6e-3811-473d-a94e-f10abfa4a41b None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:27.408258 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ebc6e-3811-473d-a94e-f10abfa4a41b None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:27.409239 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ebc6e-3811-473d-a94e-f10abfa4a41b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:27.409556 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ebc6e-3811-473d-a94e-f10abfa4a41b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:27.411054 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ebc6e-3811-473d-a94e-f10abfa4a41b None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:27.425763 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 234/474] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:27.427224 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086427a8-edf4-44ac-9d0c-1d980fc3785e None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:27.427536 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086427a8-edf4-44ac-9d0c-1d980fc3785e None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:27.427786 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086427a8-edf4-44ac-9d0c-1d980fc3785e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:27.447895 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-086427a8-edf4-44ac-9d0c-1d980fc3785e None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:27.449207 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-086427a8-edf4-44ac-9d0c-1d980fc3785e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:27.453869 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10330f-1a17-4495-b2f5-c6998526361b None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:27.504129 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0673745-eaa7-44ab-9d43-77db9431d2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:27.505374 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0673745-eaa7-44ab-9d43-77db9431d2aa None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:27.506041 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0673745-eaa7-44ab-9d43-77db9431d2aa None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:27.506328 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0673745-eaa7-44ab-9d43-77db9431d2aa None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:27.507100 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0673745-eaa7-44ab-9d43-77db9431d2aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:27.508964 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0673745-eaa7-44ab-9d43-77db9431d2aa None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:27.533571 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 235/475] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:46:27.534205 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086427a8-edf4-44ac-9d0c-1d980fc3785e None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:27.542352 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 241/476] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Aug 30 15:46:27 2022] POST /identity/v3/users => generated 248 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:46:27.582780 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:27.665840 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086427a8-edf4-44ac-9d0c-1d980fc3785e None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:27.703987 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa410675-6d6b-4c8c-99f5-0120c072a23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:27.704529 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa410675-6d6b-4c8c-99f5-0120c072a23b None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:27.704831 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa410675-6d6b-4c8c-99f5-0120c072a23b None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:27.705116 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa410675-6d6b-4c8c-99f5-0120c072a23b None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:27.705782 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa410675-6d6b-4c8c-99f5-0120c072a23b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:27.707230 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa410675-6d6b-4c8c-99f5-0120c072a23b None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:27.734927 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 236/477] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Aug 30 15:46:27 2022] POST /identity/v3/users => generated 249 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:46:27.842535 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0673745-eaa7-44ab-9d43-77db9431d2aa None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:27.898640 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:27.959013 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0673745-eaa7-44ab-9d43-77db9431d2aa None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:27.994887 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2df75e-98d7-4a0d-ab74-39c1b58623dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:27.995498 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2df75e-98d7-4a0d-ab74-39c1b58623dc None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:27.995775 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2df75e-98d7-4a0d-ab74-39c1b58623dc None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:27.996045 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2df75e-98d7-4a0d-ab74-39c1b58623dc None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:27.996770 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2df75e-98d7-4a0d-ab74-39c1b58623dc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:27.998822 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2df75e-98d7-4a0d-ab74-39c1b58623dc None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:28.009368 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.sql.core [None req-0c2df75e-98d7-4a0d-ab74-39c1b58623dc None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 15:46:28.009368 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 30 15:46:28.009368 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [parameters: {'id': '6216baa520ef4b119ac140474d62b05d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 30 15:46:28.009368 dv-cinder-855058-1-smb devstack@keystone.service[81419]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81419) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 15:46:28.026527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-0c2df75e-98d7-4a0d-ab74-39c1b58623dc None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 30 15:46:28.026527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:28.026527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 15:46:28.026527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 15:46:28.026527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 15:46:28.026527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 15:46:28.026527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 15:46:28.026527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 15:46:28.026527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 15:46:28.026527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application conn.query(q) Aug 30 15:46:28.026527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 15:46:28.026527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 15:46:28.026527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 15:46:28.026527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application result.read() Aug 30 15:46:28.026527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 15:46:28.027424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 15:46:28.027424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 15:46:28.027424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 15:46:28.027424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 15:46:28.027424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 15:46:28.027424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 15:46:28.027424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 15:46:28.027424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 15:46:28.027424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:28.027424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 15:46:28.027424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:28.027424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:28.027424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 15:46:28.027424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 15:46:28.027424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 30 15:46:28.027424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return ref.to_dict() Aug 30 15:46:28.027424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 15:46:28.027424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application next(self.gen) Aug 30 15:46:28.028474 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 15:46:28.028474 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application yield resource Aug 30 15:46:28.028474 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 15:46:28.028474 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application next(self.gen) Aug 30 15:46:28.028474 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 15:46:28.028474 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 15:46:28.028474 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 15:46:28.028474 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 15:46:28.028474 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 15:46:28.028474 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise self.value Aug 30 15:46:28.028474 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 15:46:28.028474 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 15:46:28.028474 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 15:46:28.028474 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application session.commit() Aug 30 15:46:28.028474 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 15:46:28.028474 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 15:46:28.028474 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 15:46:28.030228 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 15:46:28.030228 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 15:46:28.030228 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self.session.flush() Aug 30 15:46:28.030228 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 15:46:28.030228 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 15:46:28.030228 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 15:46:28.030228 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 15:46:28.030228 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 15:46:28.030228 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application compat.raise_( Aug 30 15:46:28.030228 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 15:46:28.030228 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception Aug 30 15:46:28.030228 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 15:46:28.030228 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 15:46:28.030228 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 15:46:28.030228 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 15:46:28.030228 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 15:46:28.030228 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 15:46:28.031079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 15:46:28.031079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 15:46:28.031079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 30 15:46:28.031079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 30 15:46:28.031079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 15:46:28.031079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 15:46:28.031079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 15:46:28.031079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 15:46:28.031079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 15:46:28.031079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 15:46:28.031079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 15:46:28.031079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 15:46:28.031079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 15:46:28.031079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 15:46:28.031079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 15:46:28.031079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception Aug 30 15:46:28.031857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 15:46:28.031857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 15:46:28.031857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 15:46:28.031857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 15:46:28.031857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 15:46:28.031857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 15:46:28.031857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 15:46:28.031857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application conn.query(q) Aug 30 15:46:28.031857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 15:46:28.031857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 15:46:28.031857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 15:46:28.031857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application result.read() Aug 30 15:46:28.031857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 15:46:28.031857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 15:46:28.031857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 15:46:28.031857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 15:46:28.032619 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 15:46:28.032619 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 15:46:28.032619 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 15:46:28.032619 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 15:46:28.032619 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 15:46:28.032619 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 30 15:46:28.032619 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [parameters: {'id': '6216baa520ef4b119ac140474d62b05d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 30 15:46:28.032619 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 15:46:28.032619 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:28.032619 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 15:46:28.032619 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:28.032619 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:28.032619 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:28.032619 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:28.032619 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:28.032619 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:28.035344 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:28.035344 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:28.035344 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:28.035344 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:28.035344 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:28.035344 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:28.035344 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 30 15:46:28.035344 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 30 15:46:28.035344 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:28.035344 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:28.035344 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 30 15:46:28.035344 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 30 15:46:28.035344 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 15:46:28.035344 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 15:46:28.035344 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 30 15:46:28.035344 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:28.036496 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 242/478] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Aug 30 15:46:27 2022] POST /identity/v3/roles => generated 144 bytes in 186 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:28.037906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa410675-6d6b-4c8c-99f5-0120c072a23b None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:28.146449 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:28.165211 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa410675-6d6b-4c8c-99f5-0120c072a23b None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:28.202506 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77613869-f4cf-4547-8f51-c01e0feab589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:28.203147 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77613869-f4cf-4547-8f51-c01e0feab589 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:28.203421 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77613869-f4cf-4547-8f51-c01e0feab589 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:28.203692 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77613869-f4cf-4547-8f51-c01e0feab589 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:28.214486 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77613869-f4cf-4547-8f51-c01e0feab589 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:28.220373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-77613869-f4cf-4547-8f51-c01e0feab589 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 15:46:28.220373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:28.220373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:28.220373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:28.220373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:28.220373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:28.220373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:28.220373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:28.220373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:28.220373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:28.220373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:28.220373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:28.220373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:28.220373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:28.220373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:28.220373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:28.221247 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:28.221247 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:28.221247 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:28.221247 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:28.221247 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:28.221247 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:28.221247 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:28.221247 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:28.221247 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:28.221247 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:28.221247 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:28.221247 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:28.221247 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:28.221247 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:28.221247 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:28.221247 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:28.222109 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:28.222109 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:28.222109 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:28.222109 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:28.222109 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:28.222109 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:28.222109 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:28.222109 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:28.222109 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:28.222109 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:28.222109 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 15:46:28.222109 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:28.222109 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 237/479] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Aug 30 15:46:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:28.228111 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2df75e-98d7-4a0d-ab74-39c1b58623dc None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:28.360736 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2df75e-98d7-4a0d-ab74-39c1b58623dc None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:28.371071 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:28.396419 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58abafc-1f55-4519-b28f-d89b5b39d4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:28.397096 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58abafc-1f55-4519-b28f-d89b5b39d4f6 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:28.397377 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58abafc-1f55-4519-b28f-d89b5b39d4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:28.397641 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58abafc-1f55-4519-b28f-d89b5b39d4f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:28.398299 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58abafc-1f55-4519-b28f-d89b5b39d4f6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:28.398593 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58abafc-1f55-4519-b28f-d89b5b39d4f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:28.399945 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58abafc-1f55-4519-b28f-d89b5b39d4f6 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:28.408735 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 243/480] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:46:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:46:29.123661 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace295d-b2d0-48e7-a6c7-5d1a1786f91a None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:29.124177 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace295d-b2d0-48e7-a6c7-5d1a1786f91a None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:29.124177 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace295d-b2d0-48e7-a6c7-5d1a1786f91a None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:29.125832 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 238/481] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:29.130789 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e1b13-9f74-4573-a38b-85c19248bb3c None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:29.131199 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e1b13-9f74-4573-a38b-85c19248bb3c None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:29.131364 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e1b13-9f74-4573-a38b-85c19248bb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:29.157760 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-5b0e1b13-9f74-4573-a38b-85c19248bb3c None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:29.158948 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-5b0e1b13-9f74-4573-a38b-85c19248bb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:29.246120 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 244/482] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:46:29.593749 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace295d-b2d0-48e7-a6c7-5d1a1786f91a None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:29.699359 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace295d-b2d0-48e7-a6c7-5d1a1786f91a None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:29.735908 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5424b02-a583-4c91-916d-a3768ecd7b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:29.736547 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5424b02-a583-4c91-916d-a3768ecd7b01 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:29.736844 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5424b02-a583-4c91-916d-a3768ecd7b01 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:29.737117 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5424b02-a583-4c91-916d-a3768ecd7b01 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:29.747872 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5424b02-a583-4c91-916d-a3768ecd7b01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:29.753250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-f5424b02-a583-4c91-916d-a3768ecd7b01 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 15:46:29.753250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:29.753250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:29.753250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:29.753250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:29.753250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:29.753250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:29.753250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:29.753250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:29.753250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:29.753250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:29.753250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:29.753250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:29.753250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:29.753250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:29.753250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:29.754136 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:29.754136 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:29.754136 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:29.754136 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:29.754136 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:29.754136 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:29.754136 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:29.754136 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:29.754136 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:29.754136 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:29.754136 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:29.754136 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:29.754136 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:29.754136 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:29.754136 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:29.754136 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:29.754906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:29.754906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:29.754906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:29.754906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:29.754906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:29.754906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:29.754906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:29.754906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:29.754906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:29.754906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:29.754906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 15:46:29.754906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:29.754906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 239/483] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 30 15:46:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:29.760422 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e1b13-9f74-4573-a38b-85c19248bb3c None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:29.807704 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fe2b5-0632-4754-82f7-6a54a5c43d72 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:29.808329 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fe2b5-0632-4754-82f7-6a54a5c43d72 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:29.808861 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fe2b5-0632-4754-82f7-6a54a5c43d72 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:29.811553 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 240/484] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:29.816881 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426b990-0547-48a7-b8e1-5df9aef232ba None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:29.817442 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426b990-0547-48a7-b8e1-5df9aef232ba None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:29.817933 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426b990-0547-48a7-b8e1-5df9aef232ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:29.835459 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:29.845699 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-b426b990-0547-48a7-b8e1-5df9aef232ba None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:29.846826 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-b426b990-0547-48a7-b8e1-5df9aef232ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:29.890694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e1b13-9f74-4573-a38b-85c19248bb3c None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:29.894429 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:29.928964 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310784b-c708-4638-a247-915efba3f2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:29.929930 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310784b-c708-4638-a247-915efba3f2bb None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:29.930452 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310784b-c708-4638-a247-915efba3f2bb None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:29.930919 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310784b-c708-4638-a247-915efba3f2bb None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:29.931788 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310784b-c708-4638-a247-915efba3f2bb None admin] RBAC: Adding query filter params (name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:29.932315 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310784b-c708-4638-a247-915efba3f2bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:29.934153 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310784b-c708-4638-a247-915efba3f2bb None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:29.943545 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 245/485] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Aug 30 15:46:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:29.949037 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310784b-c708-4638-a247-915efba3f2bb None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:30.014682 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 241/486] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:46:30.015948 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe36dd1-a235-4630-b943-9c98fb2d5997 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:30.016234 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe36dd1-a235-4630-b943-9c98fb2d5997 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:30.016504 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe36dd1-a235-4630-b943-9c98fb2d5997 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:30.018265 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 242/487] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:30.024088 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f8727-69bb-49e8-9812-94d53c22ce98 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:30.024370 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f8727-69bb-49e8-9812-94d53c22ce98 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:30.024645 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f8727-69bb-49e8-9812-94d53c22ce98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:30.053788 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-631f8727-69bb-49e8-9812-94d53c22ce98 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:30.054985 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-631f8727-69bb-49e8-9812-94d53c22ce98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:30.101830 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310784b-c708-4638-a247-915efba3f2bb None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:30.147040 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1b2c8-3929-4ab7-9279-32f2966ffdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:30.148478 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1b2c8-3929-4ab7-9279-32f2966ffdde None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:30.149006 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1b2c8-3929-4ab7-9279-32f2966ffdde None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:30.149487 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1b2c8-3929-4ab7-9279-32f2966ffdde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:30.164225 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 243/488] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 15:46:30.166862 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b1b2c8-3929-4ab7-9279-32f2966ffdde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:30.168325 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b1b2c8-3929-4ab7-9279-32f2966ffdde None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:30.191165 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-02b1b2c8-3929-4ab7-9279-32f2966ffdde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:30.191165 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:30.191165 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:30.191165 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:30.191165 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:30.191165 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:30.191165 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:30.191165 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:30.191165 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:30.191165 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:30.191165 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:30.191165 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:30.191165 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:30.191165 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:30.191165 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:30.191165 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:30.192077 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:30.192077 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:30.192077 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:30.192077 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:30.192077 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:30.192077 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:30.192077 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:30.192077 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:30.192077 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:30.192077 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:30.192077 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:30.192077 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:30.192077 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:30.192077 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:30.192077 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:30.192077 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:30.192077 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:30.192950 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:30.192950 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:30.192950 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:30.192950 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 246/489] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 15:46:30.198254 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f8727-69bb-49e8-9812-94d53c22ce98 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:30.280422 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:30.318865 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f8727-69bb-49e8-9812-94d53c22ce98 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:30.320893 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1b2c8-3929-4ab7-9279-32f2966ffdde None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:30.340483 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:30.357257 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c018f-4406-449e-aed8-a9fb3158d2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:30.357804 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c018f-4406-449e-aed8-a9fb3158d2e0 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:30.358083 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c018f-4406-449e-aed8-a9fb3158d2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:30.358370 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c018f-4406-449e-aed8-a9fb3158d2e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:30.359081 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c018f-4406-449e-aed8-a9fb3158d2e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:30.359386 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c018f-4406-449e-aed8-a9fb3158d2e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:30.360814 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c018f-4406-449e-aed8-a9fb3158d2e0 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:30.373520 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 244/490] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:30.374774 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6508a-f05b-41db-8cb4-63443bf964d7 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:30.375058 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6508a-f05b-41db-8cb4-63443bf964d7 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:30.375335 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6508a-f05b-41db-8cb4-63443bf964d7 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:30.376547 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 245/491] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:30.384271 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6508a-f05b-41db-8cb4-63443bf964d7 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:30.437397 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1b2c8-3929-4ab7-9279-32f2966ffdde None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:30.486749 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8e9bf-d439-47c0-aaf0-fe1858ce0cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:30.487405 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8e9bf-d439-47c0-aaf0-fe1858ce0cf6 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:30.487690 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8e9bf-d439-47c0-aaf0-fe1858ce0cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:30.488228 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8e9bf-d439-47c0-aaf0-fe1858ce0cf6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:30.503493 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf8e9bf-d439-47c0-aaf0-fe1858ce0cf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:30.505678 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6508a-f05b-41db-8cb4-63443bf964d7 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:30.510059 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-ddf8e9bf-d439-47c0-aaf0-fe1858ce0cf6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 15:46:30.510059 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:30.510059 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:30.510059 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:30.510059 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:30.510059 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:30.510059 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:30.510059 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:30.510059 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:30.510059 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:30.510059 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:30.510059 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:30.510059 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:30.510059 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:30.510059 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:30.510059 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:30.510949 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:30.510949 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:30.510949 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:30.510949 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:30.510949 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:30.510949 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:30.510949 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:30.510949 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:30.510949 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:30.510949 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:30.510949 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:30.510949 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:30.510949 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:30.510949 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:30.510949 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:30.510949 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:30.511815 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:30.511815 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:30.511815 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:30.511815 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:30.511815 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:30.511815 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:30.511815 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:30.511815 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:30.511815 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:30.511815 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:30.511815 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 15:46:30.511815 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:30.511815 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 247/492] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 30 15:46:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:30.513022 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8ff76-316d-46c0-96f9-184c2a3802a7 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:30.517646 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8ff76-316d-46c0-96f9-184c2a3802a7 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:30.517646 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8ff76-316d-46c0-96f9-184c2a3802a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:30.535016 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:30.535315 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-4ba8ff76-316d-46c0-96f9-184c2a3802a7 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:30.536592 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-4ba8ff76-316d-46c0-96f9-184c2a3802a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:30.545555 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8648103-a847-4052-ab8a-11d5acbe5328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:30.546186 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8648103-a847-4052-ab8a-11d5acbe5328 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:30.546460 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8648103-a847-4052-ab8a-11d5acbe5328 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:30.546723 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8648103-a847-4052-ab8a-11d5acbe5328 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:30.554321 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8648103-a847-4052-ab8a-11d5acbe5328 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:30.555868 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8648103-a847-4052-ab8a-11d5acbe5328 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:30.569331 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-f8648103-a847-4052-ab8a-11d5acbe5328 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 15:46:30.569331 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:30.569331 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:30.569331 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:30.569331 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:30.569331 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:30.569331 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:30.569331 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:30.569331 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:30.569331 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:30.569331 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:30.569331 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:30.569331 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 15:46:30.569331 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 15:46:30.569331 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 15:46:30.569331 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 15:46:30.570377 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:30.570377 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:30.570377 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 15:46:30.570377 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:46:30.570377 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 15:46:30.570377 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:46:30.570377 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:30.570377 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:30.570377 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:30.570377 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:30.570377 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:30.570377 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:30.570377 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:30.570377 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:30.570377 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:30.570377 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:30.570377 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:30.570377 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:30.571285 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:30.571285 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:30.571285 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 15:46:30.571285 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 15:46:30.571285 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 15:46:30.571285 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 15:46:30.571285 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 15:46:30.571285 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 15:46:30.571285 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 15:46:30.571285 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:30.571285 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 246/493] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Aug 30 15:46:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:30.571844 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8648103-a847-4052-ab8a-11d5acbe5328 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:30.620883 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 248/494] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:46:30.620883 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8ff76-316d-46c0-96f9-184c2a3802a7 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:30.629233 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:30.689652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8648103-a847-4052-ab8a-11d5acbe5328 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:30.730651 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc68444-ac16-4e69-8c55-52b355870f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:30.731570 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc68444-ac16-4e69-8c55-52b355870f34 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:30.731858 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc68444-ac16-4e69-8c55-52b355870f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:30.732124 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc68444-ac16-4e69-8c55-52b355870f34 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:30.732998 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc68444-ac16-4e69-8c55-52b355870f34 None admin] RBAC: Adding query filter params (name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:30.733397 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc68444-ac16-4e69-8c55-52b355870f34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:30.735165 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc68444-ac16-4e69-8c55-52b355870f34 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:30.746623 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 247/495] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Aug 30 15:46:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:30.748525 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc68444-ac16-4e69-8c55-52b355870f34 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:30.749912 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8ff76-316d-46c0-96f9-184c2a3802a7 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:30.795197 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47214b-1886-4a00-b835-1c4527b2d80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:30.795846 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47214b-1886-4a00-b835-1c4527b2d80b None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:30.796178 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47214b-1886-4a00-b835-1c4527b2d80b None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:30.796457 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47214b-1886-4a00-b835-1c4527b2d80b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:30.810338 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e47214b-1886-4a00-b835-1c4527b2d80b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:30.813940 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:30.816576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-0e47214b-1886-4a00-b835-1c4527b2d80b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 15:46:30.816576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:30.816576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:30.816576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:30.816576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:30.816576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:30.816576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:30.816576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:30.816576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:30.816576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:30.816576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:30.816576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:30.816576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:30.816576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:30.816576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:30.816576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:30.817511 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:30.817511 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:30.817511 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:30.817511 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:30.817511 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:30.817511 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:30.817511 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:30.817511 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:30.817511 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:30.817511 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:30.817511 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:30.817511 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:30.817511 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:30.817511 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:30.817511 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:30.817511 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:30.818963 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:30.818963 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:30.818963 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:30.818963 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:30.818963 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:30.818963 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:30.818963 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:30.818963 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:30.818963 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:30.818963 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:30.818963 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 15:46:30.818963 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:30.823046 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 249/496] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 30 15:46:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:30.823920 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47214b-1886-4a00-b835-1c4527b2d80b None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:30.876907 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc68444-ac16-4e69-8c55-52b355870f34 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:30.908997 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:30.916923 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e2708-4e2b-4cb0-9706-da2cdd62ea20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:30.917541 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e2708-4e2b-4cb0-9706-da2cdd62ea20 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:30.917823 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e2708-4e2b-4cb0-9706-da2cdd62ea20 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:30.918098 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e2708-4e2b-4cb0-9706-da2cdd62ea20 None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:30.919478 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e2708-4e2b-4cb0-9706-da2cdd62ea20 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:30.919797 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e2708-4e2b-4cb0-9706-da2cdd62ea20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:30.921260 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e2708-4e2b-4cb0-9706-da2cdd62ea20 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:30.946279 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47214b-1886-4a00-b835-1c4527b2d80b None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:30.958190 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 248/497] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Aug 30 15:46:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:30.959286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e2708-4e2b-4cb0-9706-da2cdd62ea20 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:30.988226 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4814cf-41b1-4208-8777-31faf30fe015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:30.989159 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4814cf-41b1-4208-8777-31faf30fe015 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:30.989597 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4814cf-41b1-4208-8777-31faf30fe015 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:30.989871 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4814cf-41b1-4208-8777-31faf30fe015 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:31.000662 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4814cf-41b1-4208-8777-31faf30fe015 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:31.002141 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4814cf-41b1-4208-8777-31faf30fe015 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:31.018519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-3f4814cf-41b1-4208-8777-31faf30fe015 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:31.018519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:31.018519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:31.018519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:31.018519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:31.018519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:31.018519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:31.018519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:31.018519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:31.018519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:31.018519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:31.018519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:31.018519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:31.018519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:31.018519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:31.018519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:31.019432 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:31.019432 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:31.019432 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:31.019432 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:31.019432 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:31.019432 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:31.019432 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:31.019432 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:31.019432 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:31.019432 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:31.019432 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:31.019432 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:31.019432 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:31.019432 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:31.019432 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:31.019432 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:31.019432 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:31.020243 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:31.020243 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:31.020243 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:31.024338 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 250/498] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:31.025194 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4814cf-41b1-4208-8777-31faf30fe015 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:31.074799 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e2708-4e2b-4cb0-9706-da2cdd62ea20 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:31.082980 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:31.111563 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71365e34-0e02-4111-ac6c-93bc69dc85b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:31.112180 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71365e34-0e02-4111-ac6c-93bc69dc85b0 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:31.112464 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71365e34-0e02-4111-ac6c-93bc69dc85b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:31.112738 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71365e34-0e02-4111-ac6c-93bc69dc85b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:31.113444 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71365e34-0e02-4111-ac6c-93bc69dc85b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:31.113752 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71365e34-0e02-4111-ac6c-93bc69dc85b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:31.115144 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71365e34-0e02-4111-ac6c-93bc69dc85b0 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:31.127889 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 249/499] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Aug 30 15:46:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:31.127889 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71365e34-0e02-4111-ac6c-93bc69dc85b0 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:31.142538 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4814cf-41b1-4208-8777-31faf30fe015 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:31.161900 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:31.179563 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34525077-88f8-43fe-858d-f0d7381177e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:31.180197 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34525077-88f8-43fe-858d-f0d7381177e3 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:31.180480 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34525077-88f8-43fe-858d-f0d7381177e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:31.180756 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34525077-88f8-43fe-858d-f0d7381177e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:31.191595 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34525077-88f8-43fe-858d-f0d7381177e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:31.197362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-34525077-88f8-43fe-858d-f0d7381177e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 15:46:31.197362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:31.197362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:31.197362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:31.197362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:31.197362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:31.197362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:31.197362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:31.197362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:31.197362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:31.197362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:31.197362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:31.197362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:31.197362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:31.197362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:31.197362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:31.198219 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:31.198219 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:31.198219 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:31.198219 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:31.198219 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:31.198219 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:31.198219 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:31.198219 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:31.198219 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:31.198219 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:31.198219 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:31.198219 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:31.198219 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:31.198219 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:31.198219 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:31.198219 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:31.199131 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:31.199131 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:31.199131 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:31.199131 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:31.199131 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:31.199131 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:31.199131 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:31.199131 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:31.199131 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:31.199131 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:31.199131 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 15:46:31.199131 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:31.199131 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 251/500] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 30 15:46:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:31.199773 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34525077-88f8-43fe-858d-f0d7381177e3 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:31.240028 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71365e34-0e02-4111-ac6c-93bc69dc85b0 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:31.277206 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6eff1-e712-465e-8f5e-cd7a5eea0a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:31.277819 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6eff1-e712-465e-8f5e-cd7a5eea0a25 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:31.278507 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6eff1-e712-465e-8f5e-cd7a5eea0a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:31.278783 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6eff1-e712-465e-8f5e-cd7a5eea0a25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:31.304601 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34525077-88f8-43fe-858d-f0d7381177e3 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:31.315067 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:31.339564 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7301f8-e3fc-4ed4-9bdd-3d29cebdb403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:31.340164 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7301f8-e3fc-4ed4-9bdd-3d29cebdb403 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:31.340963 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7301f8-e3fc-4ed4-9bdd-3d29cebdb403 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:31.341411 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7301f8-e3fc-4ed4-9bdd-3d29cebdb403 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:31.342186 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7301f8-e3fc-4ed4-9bdd-3d29cebdb403 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:31.342489 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7301f8-e3fc-4ed4-9bdd-3d29cebdb403 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:31.343865 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7301f8-e3fc-4ed4-9bdd-3d29cebdb403 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:31.348198 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c6eff1-e712-465e-8f5e-cd7a5eea0a25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:31.349695 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c6eff1-e712-465e-8f5e-cd7a5eea0a25 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:31.355215 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 252/501] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:31.355995 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7301f8-e3fc-4ed4-9bdd-3d29cebdb403 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:31.396632 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:31.450483 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 250/502] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:46:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 15:46:31.451322 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6eff1-e712-465e-8f5e-cd7a5eea0a25 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:31.457359 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7301f8-e3fc-4ed4-9bdd-3d29cebdb403 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:31.492895 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5773fb-aaa9-4ce1-9ecc-dfce975872ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:31.493817 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5773fb-aaa9-4ce1-9ecc-dfce975872ff None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:31.494223 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5773fb-aaa9-4ce1-9ecc-dfce975872ff None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:31.494498 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5773fb-aaa9-4ce1-9ecc-dfce975872ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:31.504559 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5773fb-aaa9-4ce1-9ecc-dfce975872ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:31.506039 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5773fb-aaa9-4ce1-9ecc-dfce975872ff None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:31.516517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:31.521380 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-ec5773fb-aaa9-4ce1-9ecc-dfce975872ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:31.521380 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:31.521380 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:31.521380 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:31.521380 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:31.521380 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:31.521380 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:31.521380 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:31.521380 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:31.521380 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:31.521380 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:31.521380 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:31.521380 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:31.521380 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:31.521380 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:31.521380 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:31.522451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:31.522451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:31.522451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:31.522451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:31.522451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:31.522451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:31.522451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:31.522451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:31.522451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:31.522451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:31.522451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:31.522451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:31.522451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:31.522451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:31.522451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:31.522451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:31.522451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:31.523299 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:31.523299 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:31.523299 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:31.523299 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 253/503] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:31.523885 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09ffc4-bc12-4aff-96e7-5059c4fba085 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:31.524158 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09ffc4-bc12-4aff-96e7-5059c4fba085 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:31.524425 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09ffc4-bc12-4aff-96e7-5059c4fba085 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:31.525657 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 254/504] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:31.526327 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09ffc4-bc12-4aff-96e7-5059c4fba085 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:31.554331 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6eff1-e712-465e-8f5e-cd7a5eea0a25 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:31.588538 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446d9fa-37eb-44e3-9995-9059693632b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:31.589315 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446d9fa-37eb-44e3-9995-9059693632b6 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:31.589689 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446d9fa-37eb-44e3-9995-9059693632b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:31.590065 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446d9fa-37eb-44e3-9995-9059693632b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:31.591527 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446d9fa-37eb-44e3-9995-9059693632b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:31.591828 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446d9fa-37eb-44e3-9995-9059693632b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:31.593252 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446d9fa-37eb-44e3-9995-9059693632b6 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:31.601173 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 251/505] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Aug 30 15:46:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:31.601953 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446d9fa-37eb-44e3-9995-9059693632b6 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:31.622622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:31.633218 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09ffc4-bc12-4aff-96e7-5059c4fba085 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:31.667305 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a965ae-5072-4dd9-8ae8-e8e9155faaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:31.667860 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a965ae-5072-4dd9-8ae8-e8e9155faaa4 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:31.668142 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a965ae-5072-4dd9-8ae8-e8e9155faaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:31.668413 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a965ae-5072-4dd9-8ae8-e8e9155faaa4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:31.676406 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a965ae-5072-4dd9-8ae8-e8e9155faaa4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:31.677899 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a965ae-5072-4dd9-8ae8-e8e9155faaa4 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:31.690593 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-88a965ae-5072-4dd9-8ae8-e8e9155faaa4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 15:46:31.690593 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:31.690593 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:31.690593 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:31.690593 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:31.690593 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:31.690593 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:31.690593 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:31.690593 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:31.690593 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:31.690593 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:31.690593 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:31.690593 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 15:46:31.690593 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 15:46:31.690593 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 15:46:31.690593 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 15:46:31.691669 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:31.691669 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:31.691669 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 15:46:31.691669 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:46:31.691669 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 15:46:31.691669 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:46:31.691669 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:31.691669 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:31.691669 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:31.691669 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:31.691669 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:31.691669 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:31.691669 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:31.691669 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:31.691669 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:31.691669 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:31.691669 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:31.691669 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:31.692560 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:31.692560 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:31.692560 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 15:46:31.692560 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 15:46:31.692560 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 15:46:31.692560 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 15:46:31.692560 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 15:46:31.692560 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 15:46:31.692560 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 15:46:31.692560 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:31.692560 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 255/506] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:46:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:31.692560 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a965ae-5072-4dd9-8ae8-e8e9155faaa4 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:31.704412 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446d9fa-37eb-44e3-9995-9059693632b6 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:31.732727 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:31.738872 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0180d5-61ac-4c98-afed-f16be32d7e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:31.739499 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0180d5-61ac-4c98-afed-f16be32d7e11 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:31.739777 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0180d5-61ac-4c98-afed-f16be32d7e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:31.740048 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0180d5-61ac-4c98-afed-f16be32d7e11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:31.750431 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0180d5-61ac-4c98-afed-f16be32d7e11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:31.751956 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0180d5-61ac-4c98-afed-f16be32d7e11 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:31.766436 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-7a0180d5-61ac-4c98-afed-f16be32d7e11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:31.766436 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:31.766436 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:31.766436 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:31.766436 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:31.766436 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:31.766436 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:31.766436 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:31.766436 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:31.766436 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:31.766436 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:31.766436 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:31.766436 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:31.766436 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:31.766436 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:31.766436 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:31.767276 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:31.767276 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:31.767276 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:31.767276 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:31.767276 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:31.767276 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:31.767276 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:31.767276 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:31.767276 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:31.767276 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:31.767276 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:31.767276 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:31.767276 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:31.767276 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:31.767276 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:31.767276 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:31.767276 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:31.768348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:31.768348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:31.768348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:31.768348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 252/507] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:31.769032 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9f10f-1f11-432d-b839-4c82a827ca1f None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:31.769309 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9f10f-1f11-432d-b839-4c82a827ca1f None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:31.769577 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9f10f-1f11-432d-b839-4c82a827ca1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:31.786824 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-29a9f10f-1f11-432d-b839-4c82a827ca1f None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:31.788037 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-29a9f10f-1f11-432d-b839-4c82a827ca1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:31.806552 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a965ae-5072-4dd9-8ae8-e8e9155faaa4 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:31.841182 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278109b8-5794-4668-b41d-234cef7e7497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:31.841792 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278109b8-5794-4668-b41d-234cef7e7497 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:31.842089 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278109b8-5794-4668-b41d-234cef7e7497 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:31.842351 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278109b8-5794-4668-b41d-234cef7e7497 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:31.842998 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278109b8-5794-4668-b41d-234cef7e7497 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:31.843301 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278109b8-5794-4668-b41d-234cef7e7497 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:31.844678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278109b8-5794-4668-b41d-234cef7e7497 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:31.854142 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 253/508] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:46:31.854952 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9f10f-1f11-432d-b839-4c82a827ca1f None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:31.861543 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 256/509] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:31.861543 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278109b8-5794-4668-b41d-234cef7e7497 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:31.871218 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:31.972757 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9f10f-1f11-432d-b839-4c82a827ca1f None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:31.981314 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278109b8-5794-4668-b41d-234cef7e7497 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:31.986247 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:32.009592 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9eb3a0-0d3a-47d9-a320-98918e858dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:32.010224 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9eb3a0-0d3a-47d9-a320-98918e858dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:32.010500 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9eb3a0-0d3a-47d9-a320-98918e858dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:32.010769 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9eb3a0-0d3a-47d9-a320-98918e858dd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:32.016202 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54784d-15da-4093-9e5f-702bbb400861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:32.016836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54784d-15da-4093-9e5f-702bbb400861 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:32.017116 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54784d-15da-4093-9e5f-702bbb400861 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:32.017386 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54784d-15da-4093-9e5f-702bbb400861 None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:32.018703 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f54784d-15da-4093-9e5f-702bbb400861 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:32.018703 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f54784d-15da-4093-9e5f-702bbb400861 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:32.020070 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f54784d-15da-4093-9e5f-702bbb400861 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:32.022420 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9eb3a0-0d3a-47d9-a320-98918e858dd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:32.023877 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9eb3a0-0d3a-47d9-a320-98918e858dd9 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:32.039305 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-1d9eb3a0-0d3a-47d9-a320-98918e858dd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:32.039305 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:32.039305 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:32.039305 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:32.039305 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:32.039305 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:32.039305 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:32.039305 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:32.039305 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:32.039305 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:32.039305 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:32.039305 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:32.039305 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:32.039305 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:32.039305 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:32.039305 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:32.040224 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:32.040224 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:32.040224 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:32.040224 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:32.040224 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:32.040224 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:32.040224 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:32.040224 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:32.040224 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:32.040224 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:32.040224 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:32.040224 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:32.040224 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:32.040224 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:32.040224 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:32.040224 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:32.040224 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:32.041340 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:32.041340 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:32.041340 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:32.041340 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 254/510] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:32.041666 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9eb3a0-0d3a-47d9-a320-98918e858dd9 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:32.068298 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 257/511] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Aug 30 15:46:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:32.068298 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54784d-15da-4093-9e5f-702bbb400861 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:32.133689 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:32.148432 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9eb3a0-0d3a-47d9-a320-98918e858dd9 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:32.170125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54784d-15da-4093-9e5f-702bbb400861 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:32.181654 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08954469-353a-4e8f-bcc5-482218cafafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:32.182266 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08954469-353a-4e8f-bcc5-482218cafafb None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:32.182540 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08954469-353a-4e8f-bcc5-482218cafafb None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:32.182807 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08954469-353a-4e8f-bcc5-482218cafafb None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:32.183451 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08954469-353a-4e8f-bcc5-482218cafafb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:32.183750 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08954469-353a-4e8f-bcc5-482218cafafb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:32.186020 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08954469-353a-4e8f-bcc5-482218cafafb None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:32.198189 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 255/512] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:32.198885 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08954469-353a-4e8f-bcc5-482218cafafb None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:32.208464 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fff458-4009-4aa4-95e9-a5549c0eed0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:32.209116 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fff458-4009-4aa4-95e9-a5549c0eed0a None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:32.209393 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fff458-4009-4aa4-95e9-a5549c0eed0a None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:32.209661 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fff458-4009-4aa4-95e9-a5549c0eed0a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:32.216634 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fff458-4009-4aa4-95e9-a5549c0eed0a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:32.218092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fff458-4009-4aa4-95e9-a5549c0eed0a None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:32.224126 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:32.229470 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-47fff458-4009-4aa4-95e9-a5549c0eed0a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 15:46:32.229470 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:32.229470 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:32.229470 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:32.229470 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:32.229470 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:32.229470 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:32.229470 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:32.229470 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:32.229470 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:32.229470 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:32.229470 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:32.229470 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 15:46:32.229470 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 15:46:32.229470 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 15:46:32.229470 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 15:46:32.230362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:32.230362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:32.230362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 15:46:32.230362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:46:32.230362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 15:46:32.230362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:46:32.230362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:32.230362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:32.230362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:32.230362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:32.230362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:32.230362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:32.230362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:32.230362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:32.230362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:32.230362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:32.230362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:32.230362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:32.231342 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:32.231342 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:32.231342 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 15:46:32.231342 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 15:46:32.231342 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 15:46:32.231342 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 15:46:32.231342 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 15:46:32.231342 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 15:46:32.231342 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 15:46:32.231342 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:32.231342 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 258/513] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:46:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:32.231894 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fff458-4009-4aa4-95e9-a5549c0eed0a None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:32.306409 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08954469-353a-4e8f-bcc5-482218cafafb None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:32.331261 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fff458-4009-4aa4-95e9-a5549c0eed0a None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:32.340665 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965006a8-e99c-48f1-a0a0-a8f03f3fd43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:32.341370 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965006a8-e99c-48f1-a0a0-a8f03f3fd43b None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:32.341646 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965006a8-e99c-48f1-a0a0-a8f03f3fd43b None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:32.341926 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965006a8-e99c-48f1-a0a0-a8f03f3fd43b None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:32.342563 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965006a8-e99c-48f1-a0a0-a8f03f3fd43b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:32.342861 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965006a8-e99c-48f1-a0a0-a8f03f3fd43b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:32.344229 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965006a8-e99c-48f1-a0a0-a8f03f3fd43b None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:32.355085 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 256/514] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:32.355851 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965006a8-e99c-48f1-a0a0-a8f03f3fd43b None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:32.360146 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:32.365086 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df121e80-1379-4a7b-ab29-82fc36dd7e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:32.365826 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df121e80-1379-4a7b-ab29-82fc36dd7e0c None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:32.366102 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df121e80-1379-4a7b-ab29-82fc36dd7e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:32.366370 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df121e80-1379-4a7b-ab29-82fc36dd7e0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:32.431979 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df121e80-1379-4a7b-ab29-82fc36dd7e0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:32.433471 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df121e80-1379-4a7b-ab29-82fc36dd7e0c None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:32.438808 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:32.455408 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965006a8-e99c-48f1-a0a0-a8f03f3fd43b None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:32.488824 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a99a3e-a9c0-4c64-88ae-d346f174825c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:32.489380 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a99a3e-a9c0-4c64-88ae-d346f174825c None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:32.489653 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a99a3e-a9c0-4c64-88ae-d346f174825c None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:32.489921 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a99a3e-a9c0-4c64-88ae-d346f174825c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:32.500623 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a99a3e-a9c0-4c64-88ae-d346f174825c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:32.502085 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a99a3e-a9c0-4c64-88ae-d346f174825c None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:32.515694 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-21a99a3e-a9c0-4c64-88ae-d346f174825c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:32.515694 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:32.515694 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:32.515694 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:32.515694 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:32.515694 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:32.515694 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:32.515694 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:32.515694 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:32.515694 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:32.515694 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:32.515694 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:32.515694 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:32.515694 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:32.515694 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:32.515694 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:32.516570 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:32.516570 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:32.516570 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:32.516570 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:32.516570 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:32.516570 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:32.516570 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:32.516570 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:32.516570 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:32.516570 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:32.516570 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:32.516570 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:32.516570 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:32.516570 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:32.516570 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:32.516570 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:32.516570 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:32.517445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:32.517445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:32.517445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:32.517445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 257/515] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:32.517673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a99a3e-a9c0-4c64-88ae-d346f174825c None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:32.533954 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 259/516] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:46:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 15:46:32.534788 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df121e80-1379-4a7b-ab29-82fc36dd7e0c None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:32.563933 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:32.618601 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a99a3e-a9c0-4c64-88ae-d346f174825c None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:32.633805 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df121e80-1379-4a7b-ab29-82fc36dd7e0c None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:32.654030 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbfa98-41b7-4e67-8a82-c0a6f62af5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:32.654667 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbfa98-41b7-4e67-8a82-c0a6f62af5e5 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:32.655378 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbfa98-41b7-4e67-8a82-c0a6f62af5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:32.655658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbfa98-41b7-4e67-8a82-c0a6f62af5e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:32.658607 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:32.663738 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbbfa98-41b7-4e67-8a82-c0a6f62af5e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:32.665637 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbbfa98-41b7-4e67-8a82-c0a6f62af5e5 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:32.668388 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b3a56f-c9b0-44e9-a916-fd3815ec3543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:32.669163 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3a56f-c9b0-44e9-a916-fd3815ec3543 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:32.669437 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3a56f-c9b0-44e9-a916-fd3815ec3543 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:32.669703 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3a56f-c9b0-44e9-a916-fd3815ec3543 None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:32.670593 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b3a56f-c9b0-44e9-a916-fd3815ec3543 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:32.670891 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b3a56f-c9b0-44e9-a916-fd3815ec3543 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:32.672540 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b3a56f-c9b0-44e9-a916-fd3815ec3543 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:32.677478 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-9bbbfa98-41b7-4e67-8a82-c0a6f62af5e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:46:32.677478 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:32.677478 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:32.677478 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:32.677478 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:32.677478 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:32.677478 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:32.677478 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:32.677478 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:32.677478 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:32.677478 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:32.677478 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:32.677478 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 15:46:32.677478 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 15:46:32.677478 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 15:46:32.678452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 15:46:32.678452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:32.678452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:32.678452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:32.678452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:32.678452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:32.678452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:32.678452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:32.678452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:32.678452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:32.678452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:32.678452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:32.678452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:32.678452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:32.678452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:32.678452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:32.678452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:32.679287 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 15:46:32.679287 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 15:46:32.679287 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 15:46:32.679287 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 15:46:32.679287 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 15:46:32.679287 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 15:46:32.679287 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:46:32.679287 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:32.679287 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 258/517] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:46:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:32.679841 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbfa98-41b7-4e67-8a82-c0a6f62af5e5 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:32.694519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 260/518] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Aug 30 15:46:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:32.695321 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b3a56f-c9b0-44e9-a916-fd3815ec3543 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:32.779628 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:32.788858 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbfa98-41b7-4e67-8a82-c0a6f62af5e5 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:32.795082 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b3a56f-c9b0-44e9-a916-fd3815ec3543 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:32.821808 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296455f1-70d2-43bd-895d-7391cf9565d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:32.822433 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296455f1-70d2-43bd-895d-7391cf9565d4 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:32.822726 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296455f1-70d2-43bd-895d-7391cf9565d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:32.822985 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296455f1-70d2-43bd-895d-7391cf9565d4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:32.828187 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b2569-a2ee-4370-8156-daac77a725eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:32.828819 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b2569-a2ee-4370-8156-daac77a725eb None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:32.829107 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b2569-a2ee-4370-8156-daac77a725eb None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:32.829382 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b2569-a2ee-4370-8156-daac77a725eb None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:32.830027 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b2569-a2ee-4370-8156-daac77a725eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:32.830328 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b2569-a2ee-4370-8156-daac77a725eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:32.830443 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296455f1-70d2-43bd-895d-7391cf9565d4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:32.831708 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b2569-a2ee-4370-8156-daac77a725eb None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:32.831899 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296455f1-70d2-43bd-895d-7391cf9565d4 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:32.843836 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-296455f1-70d2-43bd-895d-7391cf9565d4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 15:46:32.843836 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:32.843836 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:32.843836 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:32.843836 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:32.843836 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:32.843836 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:32.843836 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:32.843836 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:32.843836 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:32.843836 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:32.843836 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:32.843836 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 15:46:32.843836 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 15:46:32.843836 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 15:46:32.843836 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 15:46:32.849403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:32.849403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:32.849403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 15:46:32.849403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:46:32.849403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 15:46:32.849403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:46:32.849403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:32.849403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:32.849403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:32.849403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:32.849403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:32.849403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:32.849403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:32.849403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:32.849403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:32.849403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:32.849403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:32.849403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:32.850304 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:32.850304 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:32.850304 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 15:46:32.850304 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 15:46:32.850304 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 15:46:32.850304 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 15:46:32.850304 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 15:46:32.850304 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 15:46:32.850304 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 15:46:32.850304 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:32.850797 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 261/519] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:32.850871 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 259/520] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 30 15:46:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:32.850935 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b2569-a2ee-4370-8156-daac77a725eb None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:32.850998 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296455f1-70d2-43bd-895d-7391cf9565d4 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:32.903517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:32.948191 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296455f1-70d2-43bd-895d-7391cf9565d4 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:32.948481 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b2569-a2ee-4370-8156-daac77a725eb None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:32.981746 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca55339-c6ff-4a4d-b816-6f883ddc1b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:32.981916 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76104a7a-636e-43b7-a8a3-38c448bb4eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:32.982436 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca55339-c6ff-4a4d-b816-6f883ddc1b3c None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:32.982544 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76104a7a-636e-43b7-a8a3-38c448bb4eb3 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:32.982712 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca55339-c6ff-4a4d-b816-6f883ddc1b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:32.982806 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76104a7a-636e-43b7-a8a3-38c448bb4eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:32.982980 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca55339-c6ff-4a4d-b816-6f883ddc1b3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:32.983075 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76104a7a-636e-43b7-a8a3-38c448bb4eb3 None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:32.983702 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76104a7a-636e-43b7-a8a3-38c448bb4eb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:32.984005 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76104a7a-636e-43b7-a8a3-38c448bb4eb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:32.985469 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76104a7a-636e-43b7-a8a3-38c448bb4eb3 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:32.993652 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca55339-c6ff-4a4d-b816-6f883ddc1b3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:32.995079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca55339-c6ff-4a4d-b816-6f883ddc1b3c None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:33.001668 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:33.002592 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 260/521] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 30 15:46:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:33.003478 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76104a7a-636e-43b7-a8a3-38c448bb4eb3 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:33.010960 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-aca55339-c6ff-4a4d-b816-6f883ddc1b3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:33.010960 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:33.010960 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:33.010960 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:33.010960 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:33.010960 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:33.010960 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:33.010960 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:33.010960 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:33.010960 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:33.010960 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:33.010960 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:33.010960 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:33.010960 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:33.010960 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:33.010960 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:33.011865 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:33.011865 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:33.011865 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:33.011865 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:33.011865 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:33.011865 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:33.011865 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:33.011865 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:33.011865 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:33.011865 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:33.011865 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:33.011865 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:33.011865 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:33.011865 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:33.011865 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:33.011865 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:33.011865 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:33.013490 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:33.013490 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:33.013490 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:33.013490 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 262/522] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:33.013490 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca55339-c6ff-4a4d-b816-6f883ddc1b3c None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:33.103417 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76104a7a-636e-43b7-a8a3-38c448bb4eb3 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:33.119885 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:33.120321 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca55339-c6ff-4a4d-b816-6f883ddc1b3c None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:33.138406 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01dd19-6266-4718-96b5-ed7dedf5658e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:33.139007 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01dd19-6266-4718-96b5-ed7dedf5658e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:33.139310 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01dd19-6266-4718-96b5-ed7dedf5658e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:33.139576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01dd19-6266-4718-96b5-ed7dedf5658e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:33.154774 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602cfea-ab35-4115-8598-ef629e0ed0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:33.155377 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602cfea-ab35-4115-8598-ef629e0ed0a8 None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:33.155658 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602cfea-ab35-4115-8598-ef629e0ed0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:33.155933 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602cfea-ab35-4115-8598-ef629e0ed0a8 None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:33.156577 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0602cfea-ab35-4115-8598-ef629e0ed0a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:33.158043 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0602cfea-ab35-4115-8598-ef629e0ed0a8 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:33.179116 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 263/523] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Aug 30 15:46:33 2022] POST /identity/v3/users => generated 247 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:46:33.179981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602cfea-ab35-4115-8598-ef629e0ed0a8 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:33.221127 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d01dd19-6266-4718-96b5-ed7dedf5658e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:33.222669 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d01dd19-6266-4718-96b5-ed7dedf5658e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:33.260031 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:33.314932 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602cfea-ab35-4115-8598-ef629e0ed0a8 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:33.341700 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 261/524] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:46:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 15:46:33.342559 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01dd19-6266-4718-96b5-ed7dedf5658e None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:33.353239 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61454b0-9cff-4116-b9e5-9d6f7ddc699b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:33.354166 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61454b0-9cff-4116-b9e5-9d6f7ddc699b None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:33.354383 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61454b0-9cff-4116-b9e5-9d6f7ddc699b None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:33.354658 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61454b0-9cff-4116-b9e5-9d6f7ddc699b None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:33.355398 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61454b0-9cff-4116-b9e5-9d6f7ddc699b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:33.355703 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61454b0-9cff-4116-b9e5-9d6f7ddc699b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:33.357949 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61454b0-9cff-4116-b9e5-9d6f7ddc699b None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:33.368937 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:33.379410 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 264/525] 10.222.0.25 () {56 vars in 1139 bytes} [Tue Aug 30 15:46:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:33.380492 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61454b0-9cff-4116-b9e5-9d6f7ddc699b None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:33.454948 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01dd19-6266-4718-96b5-ed7dedf5658e None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:33.485543 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61454b0-9cff-4116-b9e5-9d6f7ddc699b None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:33.489793 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441ded7-3dc9-4d4b-ac31-2b847c52a8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:33.490395 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441ded7-3dc9-4d4b-ac31-2b847c52a8f6 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:33.490671 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441ded7-3dc9-4d4b-ac31-2b847c52a8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:33.490938 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441ded7-3dc9-4d4b-ac31-2b847c52a8f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:33.491662 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441ded7-3dc9-4d4b-ac31-2b847c52a8f6 None admin] RBAC: Adding query filter params (role.id=c99e31de7c4c47c7b7b2c45c2771ca58, scope.project.id=51f312b4cd8b449aa2971993f68de9af, user.id=ebc80bf891614fb895af33ca1ded6b9d) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:33.491963 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441ded7-3dc9-4d4b-ac31-2b847c52a8f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:33.493476 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441ded7-3dc9-4d4b-ac31-2b847c52a8f6 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:33.499240 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 262/526] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:46:33 2022] GET /identity/v3/role_assignments?user.id=ebc80bf891614fb895af33ca1ded6b9d&scope.project.id=51f312b4cd8b449aa2971993f68de9af&role.id=c99e31de7c4c47c7b7b2c45c2771ca58 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:33.500001 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441ded7-3dc9-4d4b-ac31-2b847c52a8f6 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:33.512055 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:33.541072 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111669ad-a8cd-4d90-9a14-65e629ef528a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:33.542267 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111669ad-a8cd-4d90-9a14-65e629ef528a None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:33.542983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111669ad-a8cd-4d90-9a14-65e629ef528a None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:33.543441 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111669ad-a8cd-4d90-9a14-65e629ef528a None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:33.545612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111669ad-a8cd-4d90-9a14-65e629ef528a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:33.546613 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111669ad-a8cd-4d90-9a14-65e629ef528a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:33.548238 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111669ad-a8cd-4d90-9a14-65e629ef528a None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:33.566703 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 265/527] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:33.566703 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111669ad-a8cd-4d90-9a14-65e629ef528a None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:33.612697 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:33.643365 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441ded7-3dc9-4d4b-ac31-2b847c52a8f6 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:33.688037 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439c0d8-3df5-45fb-b776-103c95eca442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:33.688675 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439c0d8-3df5-45fb-b776-103c95eca442 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:33.688990 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439c0d8-3df5-45fb-b776-103c95eca442 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:33.689264 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439c0d8-3df5-45fb-b776-103c95eca442 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:33.693267 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111669ad-a8cd-4d90-9a14-65e629ef528a None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:33.701680 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439c0d8-3df5-45fb-b776-103c95eca442 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:33.703224 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439c0d8-3df5-45fb-b776-103c95eca442 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:33.722004 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-b439c0d8-3df5-45fb-b776-103c95eca442 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:33.722004 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:33.722004 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:33.722004 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:33.722004 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:33.722004 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:33.722004 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:33.722004 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:33.722004 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:33.722004 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:33.722004 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:33.722004 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:33.722004 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:33.722004 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:33.722004 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:33.722004 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:33.722884 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:33.722884 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:33.722884 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:33.722884 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:33.722884 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:33.722884 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:33.722884 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:33.722884 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:33.722884 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:33.722884 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:33.722884 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:33.722884 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:33.722884 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:33.722884 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:33.722884 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:33.722884 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:33.722884 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:33.723720 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:33.723720 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:33.723720 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:33.725520 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 263/528] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:33.726457 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439c0d8-3df5-45fb-b776-103c95eca442 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:33.741947 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae2b1e-f6e7-4cb2-9773-aed06b58bc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:33.742562 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae2b1e-f6e7-4cb2-9773-aed06b58bc74 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:33.742846 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae2b1e-f6e7-4cb2-9773-aed06b58bc74 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:33.743123 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae2b1e-f6e7-4cb2-9773-aed06b58bc74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:33.793657 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:33.841123 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439c0d8-3df5-45fb-b776-103c95eca442 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:33.845620 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae2b1e-f6e7-4cb2-9773-aed06b58bc74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:33.847123 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae2b1e-f6e7-4cb2-9773-aed06b58bc74 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:33.875516 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:33.882113 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ae8d1-b2f4-466f-8d59-af50c6be3454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:33.883045 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ae8d1-b2f4-466f-8d59-af50c6be3454 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:33.883527 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ae8d1-b2f4-466f-8d59-af50c6be3454 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:33.884002 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ae8d1-b2f4-466f-8d59-af50c6be3454 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:33.892011 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ae8d1-b2f4-466f-8d59-af50c6be3454 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:33.894028 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ae8d1-b2f4-466f-8d59-af50c6be3454 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:33.906397 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-9f5ae8d1-b2f4-466f-8d59-af50c6be3454 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:46:33.906397 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:33.906397 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:33.906397 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:33.906397 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:33.906397 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:33.906397 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:33.906397 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:33.906397 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:33.906397 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:33.906397 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:33.906397 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:33.906397 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 15:46:33.906397 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 15:46:33.906397 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 15:46:33.907244 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 15:46:33.907244 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:33.907244 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:33.907244 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:33.907244 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:33.907244 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:33.907244 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:33.907244 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:33.907244 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:33.907244 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:33.907244 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:33.907244 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:33.907244 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:33.907244 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:33.907244 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:33.907244 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:33.907244 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:33.908088 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 15:46:33.908088 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 15:46:33.908088 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 15:46:33.908088 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 15:46:33.908088 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 15:46:33.908088 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 15:46:33.908088 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:46:33.908088 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:33.910484 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 264/529] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:46:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:33.911607 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ae8d1-b2f4-466f-8d59-af50c6be3454 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:33.981463 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 266/530] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:46:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 15:46:33.982705 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae2b1e-f6e7-4cb2-9773-aed06b58bc74 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:34.019578 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ae8d1-b2f4-466f-8d59-af50c6be3454 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:34.057875 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac3670-461a-4f8c-866f-cc5a23186529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:34.058914 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac3670-461a-4f8c-866f-cc5a23186529 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:34.059628 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac3670-461a-4f8c-866f-cc5a23186529 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:34.060138 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac3670-461a-4f8c-866f-cc5a23186529 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:34.061036 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac3670-461a-4f8c-866f-cc5a23186529 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:34.061643 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac3670-461a-4f8c-866f-cc5a23186529 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:34.062314 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:34.064469 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac3670-461a-4f8c-866f-cc5a23186529 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:34.080350 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 265/531] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:34.081575 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac3670-461a-4f8c-866f-cc5a23186529 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:34.101061 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae2b1e-f6e7-4cb2-9773-aed06b58bc74 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:34.136720 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa3af1-654d-4977-a7d3-619ef70521f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:34.137083 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa3af1-654d-4977-a7d3-619ef70521f8 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:34.137864 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa3af1-654d-4977-a7d3-619ef70521f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:34.138140 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa3af1-654d-4977-a7d3-619ef70521f8 None admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:34.139033 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa3af1-654d-4977-a7d3-619ef70521f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:34.139340 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa3af1-654d-4977-a7d3-619ef70521f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:34.140793 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa3af1-654d-4977-a7d3-619ef70521f8 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:34.160068 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 267/532] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 30 15:46:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:34.161065 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa3af1-654d-4977-a7d3-619ef70521f8 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:34.169154 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:34.197750 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac3670-461a-4f8c-866f-cc5a23186529 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:34.238486 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0cd8f-b4ee-4550-8adc-b2eebeeb08b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:34.239121 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0cd8f-b4ee-4550-8adc-b2eebeeb08b8 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:34.239402 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0cd8f-b4ee-4550-8adc-b2eebeeb08b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:34.239677 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0cd8f-b4ee-4550-8adc-b2eebeeb08b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:34.250402 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0cd8f-b4ee-4550-8adc-b2eebeeb08b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:34.251932 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0cd8f-b4ee-4550-8adc-b2eebeeb08b8 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:34.268372 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-e7b0cd8f-b4ee-4550-8adc-b2eebeeb08b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:34.268372 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:34.268372 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:34.268372 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:34.268372 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:34.268372 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:34.268372 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:34.268372 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:34.268372 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:34.268372 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:34.268372 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:34.268372 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:34.268372 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:34.268372 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:34.268372 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:34.268372 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:34.269350 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:34.269350 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:34.269350 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:34.269350 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:34.269350 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:34.269350 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:34.269350 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:34.269350 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:34.269350 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:34.269350 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:34.269350 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:34.269350 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:34.269350 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:34.269350 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:34.269350 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:34.269350 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:34.269350 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:34.270409 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:34.270409 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:34.270409 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:34.270409 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 266/533] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:34.270787 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0cd8f-b4ee-4550-8adc-b2eebeeb08b8 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:34.291650 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa3af1-654d-4977-a7d3-619ef70521f8 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:34.337886 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:34.348848 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f22a2-42ac-4978-bd2d-3227830ec4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:34.349893 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f22a2-42ac-4978-bd2d-3227830ec4c6 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:34.350360 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f22a2-42ac-4978-bd2d-3227830ec4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:34.350826 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f22a2-42ac-4978-bd2d-3227830ec4c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:34.362104 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f22a2-42ac-4978-bd2d-3227830ec4c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:34.364674 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f22a2-42ac-4978-bd2d-3227830ec4c6 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:34.381869 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-3f3f22a2-42ac-4978-bd2d-3227830ec4c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:46:34.381869 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:34.381869 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:34.381869 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:34.381869 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:34.381869 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:34.381869 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:34.381869 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:34.381869 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:34.381869 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:34.381869 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:34.381869 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:34.381869 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 15:46:34.381869 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 15:46:34.381869 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 15:46:34.382730 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 15:46:34.382730 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:34.382730 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:34.382730 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:34.382730 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:34.382730 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:34.382730 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:34.382730 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:34.382730 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:34.382730 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:34.382730 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:34.382730 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:34.382730 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:34.382730 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:34.382730 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:34.382730 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:34.382730 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:34.383558 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 15:46:34.383558 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 15:46:34.383558 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 15:46:34.383558 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 15:46:34.383558 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 15:46:34.383558 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 15:46:34.383558 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:46:34.383558 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:34.383955 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0cd8f-b4ee-4550-8adc-b2eebeeb08b8 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:34.386615 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:34.389232 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 268/534] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:46:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:34.390327 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f22a2-42ac-4978-bd2d-3227830ec4c6 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:34.435154 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e7d7f-1e0c-4b2e-ab23-17272874a752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:34.436050 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e7d7f-1e0c-4b2e-ab23-17272874a752 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:34.437028 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e7d7f-1e0c-4b2e-ab23-17272874a752 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:34.437457 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e7d7f-1e0c-4b2e-ab23-17272874a752 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:34.438348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e7d7f-1e0c-4b2e-ab23-17272874a752 None admin] RBAC: Adding query filter params (role.id=c99e31de7c4c47c7b7b2c45c2771ca58, scope.project.id=51f312b4cd8b449aa2971993f68de9af, user.id=f9bd815f8fe54d7d99e00a47212ad9ab) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:34.439254 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e7d7f-1e0c-4b2e-ab23-17272874a752 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:34.441564 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e7d7f-1e0c-4b2e-ab23-17272874a752 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:34.449481 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 267/535] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:46:34 2022] GET /identity/v3/role_assignments?user.id=f9bd815f8fe54d7d99e00a47212ad9ab&scope.project.id=51f312b4cd8b449aa2971993f68de9af&role.id=c99e31de7c4c47c7b7b2c45c2771ca58 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:34.450446 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e7d7f-1e0c-4b2e-ab23-17272874a752 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:34.583670 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f22a2-42ac-4978-bd2d-3227830ec4c6 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:34.628523 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66dfd28-541d-4b78-8a26-2d04b6c10101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:34.629276 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66dfd28-541d-4b78-8a26-2d04b6c10101 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:34.629646 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66dfd28-541d-4b78-8a26-2d04b6c10101 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:34.629993 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66dfd28-541d-4b78-8a26-2d04b6c10101 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:34.630712 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66dfd28-541d-4b78-8a26-2d04b6c10101 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:34.631757 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66dfd28-541d-4b78-8a26-2d04b6c10101 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:34.633506 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66dfd28-541d-4b78-8a26-2d04b6c10101 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:34.644287 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e7d7f-1e0c-4b2e-ab23-17272874a752 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:34.649381 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 269/536] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:46:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:34.655075 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66dfd28-541d-4b78-8a26-2d04b6c10101 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:34.701504 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346150ef-fd0b-4bea-bb18-c6236b19a6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:34.702291 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346150ef-fd0b-4bea-bb18-c6236b19a6d3 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:34.702677 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346150ef-fd0b-4bea-bb18-c6236b19a6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:34.703094 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346150ef-fd0b-4bea-bb18-c6236b19a6d3 None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:34.703904 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346150ef-fd0b-4bea-bb18-c6236b19a6d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:34.704341 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346150ef-fd0b-4bea-bb18-c6236b19a6d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:34.705906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346150ef-fd0b-4bea-bb18-c6236b19a6d3 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:34.724389 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:34.726740 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 268/537] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 30 15:46:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:34.741437 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346150ef-fd0b-4bea-bb18-c6236b19a6d3 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:34.788830 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:34.810932 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66dfd28-541d-4b78-8a26-2d04b6c10101 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:34.864712 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39530e-496b-4605-8e4f-9b5b50c3af50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:34.865378 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39530e-496b-4605-8e4f-9b5b50c3af50 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:34.865654 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39530e-496b-4605-8e4f-9b5b50c3af50 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:34.865949 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39530e-496b-4605-8e4f-9b5b50c3af50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:34.873235 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de39530e-496b-4605-8e4f-9b5b50c3af50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:34.874703 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de39530e-496b-4605-8e4f-9b5b50c3af50 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:34.893965 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-de39530e-496b-4605-8e4f-9b5b50c3af50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:46:34.893965 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:34.893965 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:34.893965 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:34.893965 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:34.893965 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:34.893965 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:34.893965 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:34.893965 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:34.893965 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:34.893965 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:34.893965 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:34.893965 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 15:46:34.893965 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 15:46:34.893965 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 15:46:34.894994 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 15:46:34.894994 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:34.894994 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:34.894994 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:34.894994 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:34.894994 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:34.894994 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:34.894994 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:34.894994 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:34.894994 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:34.894994 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:34.894994 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:34.894994 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:34.894994 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:34.894994 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:34.894994 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:34.894994 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:34.895991 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 15:46:34.895991 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 15:46:34.895991 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 15:46:34.895991 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 15:46:34.895991 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 15:46:34.895991 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 15:46:34.895991 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:46:34.895991 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:34.895991 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 270/538] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:46:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:34.900775 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39530e-496b-4605-8e4f-9b5b50c3af50 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:34.912492 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346150ef-fd0b-4bea-bb18-c6236b19a6d3 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:34.983941 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72d0de-89c4-4b04-8cf4-7a536ca8773a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:34.984554 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72d0de-89c4-4b04-8cf4-7a536ca8773a None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:34.984866 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72d0de-89c4-4b04-8cf4-7a536ca8773a None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:34.985143 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72d0de-89c4-4b04-8cf4-7a536ca8773a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:34.985887 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72d0de-89c4-4b04-8cf4-7a536ca8773a None admin] RBAC: Adding query filter params (role.id=c99e31de7c4c47c7b7b2c45c2771ca58, scope.project.id=51f312b4cd8b449aa2971993f68de9af, user.id=130166ecc884456d94dbf6c6905168fc) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:34.986202 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72d0de-89c4-4b04-8cf4-7a536ca8773a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:34.988973 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72d0de-89c4-4b04-8cf4-7a536ca8773a None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:35.008971 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 269/539] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:46:34 2022] GET /identity/v3/role_assignments?user.id=130166ecc884456d94dbf6c6905168fc&scope.project.id=51f312b4cd8b449aa2971993f68de9af&role.id=c99e31de7c4c47c7b7b2c45c2771ca58 => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:46:35.075463 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39530e-496b-4605-8e4f-9b5b50c3af50 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:35.100031 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:35.135637 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ea683-c7b3-4c56-87b7-338ab787d56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:35.136643 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ea683-c7b3-4c56-87b7-338ab787d56e None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:35.137161 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ea683-c7b3-4c56-87b7-338ab787d56e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:35.138501 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ea683-c7b3-4c56-87b7-338ab787d56e None admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:35.139432 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ea683-c7b3-4c56-87b7-338ab787d56e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:35.139966 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ea683-c7b3-4c56-87b7-338ab787d56e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:35.141727 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ea683-c7b3-4c56-87b7-338ab787d56e None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:35.155847 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 271/540] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 30 15:46:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:35.161377 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72d0de-89c4-4b04-8cf4-7a536ca8773a None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:35.297032 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:35.311771 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72d0de-89c4-4b04-8cf4-7a536ca8773a None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:35.358676 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336e5a5-6b62-48bd-985d-f6fd455ab01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:35.359347 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336e5a5-6b62-48bd-985d-f6fd455ab01f None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:35.359633 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336e5a5-6b62-48bd-985d-f6fd455ab01f None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:35.359905 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336e5a5-6b62-48bd-985d-f6fd455ab01f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:35.360652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336e5a5-6b62-48bd-985d-f6fd455ab01f None admin] RBAC: Adding query filter params (role.id=c99e31de7c4c47c7b7b2c45c2771ca58, scope.project.id=51f312b4cd8b449aa2971993f68de9af, user.id=48c49f6751d14526a0954797d9ab6a9a) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:35.360999 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336e5a5-6b62-48bd-985d-f6fd455ab01f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:35.362446 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336e5a5-6b62-48bd-985d-f6fd455ab01f None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:35.367824 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76e28b-8c34-4d51-9550-2b022a4b51bb None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:35.368285 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76e28b-8c34-4d51-9550-2b022a4b51bb None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:35.368383 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76e28b-8c34-4d51-9550-2b022a4b51bb None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:35.370192 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 272/541] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 15:46:35.373908 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 270/542] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:46:35 2022] GET /identity/v3/role_assignments?user.id=48c49f6751d14526a0954797d9ab6a9a&scope.project.id=51f312b4cd8b449aa2971993f68de9af&role.id=c99e31de7c4c47c7b7b2c45c2771ca58 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:35.389156 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ae9e1-ce70-4360-b0e9-d2e1e655e6ca None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:35.389424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ae9e1-ce70-4360-b0e9-d2e1e655e6ca None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:35.389699 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ae9e1-ce70-4360-b0e9-d2e1e655e6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:35.424369 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-dc8ae9e1-ce70-4360-b0e9-d2e1e655e6ca None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:35.425558 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-dc8ae9e1-ce70-4360-b0e9-d2e1e655e6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:35.520034 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 273/543] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 15:46:35.567759 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32644baf-6b40-484d-b149-866cade9a610 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:35.568258 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32644baf-6b40-484d-b149-866cade9a610 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:35.568369 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32644baf-6b40-484d-b149-866cade9a610 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:35.569910 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 271/544] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:35.575687 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf7f7c-7d1c-4332-af1d-b0d33120db60 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:35.575977 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf7f7c-7d1c-4332-af1d-b0d33120db60 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:35.576249 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf7f7c-7d1c-4332-af1d-b0d33120db60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:35.594634 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-b8bf7f7c-7d1c-4332-af1d-b0d33120db60 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:35.595808 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-b8bf7f7c-7d1c-4332-af1d-b0d33120db60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:35.666135 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 274/545] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:46:35.859390 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32644baf-6b40-484d-b149-866cade9a610 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:35.969802 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf7f7c-7d1c-4332-af1d-b0d33120db60 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:36.002836 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32644baf-6b40-484d-b149-866cade9a610 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:36.035394 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:36.077969 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb9a171-1756-4ba0-8756-7fb67f11306f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:36.078639 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9a171-1756-4ba0-8756-7fb67f11306f None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:36.078924 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9a171-1756-4ba0-8756-7fb67f11306f None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:36.079196 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9a171-1756-4ba0-8756-7fb67f11306f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:36.101925 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb9a171-1756-4ba0-8756-7fb67f11306f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:36.106981 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-ecb9a171-1756-4ba0-8756-7fb67f11306f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 15:46:36.106981 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:36.106981 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:36.106981 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:36.106981 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:36.106981 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:36.106981 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:36.106981 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:36.106981 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:36.106981 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:36.106981 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:36.106981 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:36.106981 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:36.106981 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:36.106981 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:36.106981 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:36.107868 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:36.107868 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:36.107868 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:36.107868 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:36.107868 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:36.107868 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:36.107868 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:36.107868 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:36.107868 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:36.107868 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:36.107868 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:36.107868 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:36.107868 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:36.107868 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:36.107868 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:36.107868 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:36.108639 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:36.108639 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:36.108639 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:36.108639 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:36.108639 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:36.108639 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:36.108639 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:36.108639 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:36.108639 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:36.108639 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:36.108639 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 15:46:36.108639 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:36.112939 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 272/546] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 30 15:46:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:36.114168 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb9a171-1756-4ba0-8756-7fb67f11306f None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:36.146929 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf7f7c-7d1c-4332-af1d-b0d33120db60 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:36.162413 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:36.182149 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd390409-cad7-4561-af91-c8cba9494600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:36.182783 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd390409-cad7-4561-af91-c8cba9494600 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:36.183060 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd390409-cad7-4561-af91-c8cba9494600 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:36.183328 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd390409-cad7-4561-af91-c8cba9494600 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:36.195058 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd390409-cad7-4561-af91-c8cba9494600 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:36.200518 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-fd390409-cad7-4561-af91-c8cba9494600 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 15:46:36.200518 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:36.200518 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:36.200518 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:36.200518 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:36.200518 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:36.200518 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:36.200518 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:36.200518 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:36.200518 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:36.200518 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:36.200518 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:36.200518 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:36.200518 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:36.200518 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:36.200518 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:36.201638 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:36.201638 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:36.201638 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:36.201638 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:36.201638 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:36.201638 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:36.201638 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:36.201638 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:36.201638 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:36.201638 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:36.201638 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:36.201638 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:36.201638 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:36.201638 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:36.201638 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:36.201638 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:36.202779 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:36.202779 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:36.202779 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:36.202779 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:36.202779 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:36.202779 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:36.202779 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:36.202779 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:36.202779 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:36.202779 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:36.202779 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 15:46:36.202779 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:36.202779 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 275/547] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 30 15:46:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:36.207650 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd390409-cad7-4561-af91-c8cba9494600 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:36.286415 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb9a171-1756-4ba0-8756-7fb67f11306f None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:36.321593 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c138cbb-8d32-4303-a251-1835112c839a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:36.322276 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c138cbb-8d32-4303-a251-1835112c839a None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:36.322559 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c138cbb-8d32-4303-a251-1835112c839a None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:36.322833 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c138cbb-8d32-4303-a251-1835112c839a None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:36.323515 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c138cbb-8d32-4303-a251-1835112c839a None admin] RBAC: Adding query filter params (name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:36.323819 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c138cbb-8d32-4303-a251-1835112c839a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:36.326079 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c138cbb-8d32-4303-a251-1835112c839a None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:36.334816 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 273/548] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Aug 30 15:46:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:46:36.342743 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:36.345755 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c138cbb-8d32-4303-a251-1835112c839a None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:36.346791 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd390409-cad7-4561-af91-c8cba9494600 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:36.409613 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c61809-b935-4121-87a5-217e97d10972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:36.410264 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c61809-b935-4121-87a5-217e97d10972 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:36.410474 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c61809-b935-4121-87a5-217e97d10972 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:36.410738 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c61809-b935-4121-87a5-217e97d10972 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:36.411407 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c61809-b935-4121-87a5-217e97d10972 None admin] RBAC: Adding query filter params (name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:36.411723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c61809-b935-4121-87a5-217e97d10972 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:36.413095 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c61809-b935-4121-87a5-217e97d10972 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:36.421948 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 276/549] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Aug 30 15:46:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:36.427273 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c61809-b935-4121-87a5-217e97d10972 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:36.529453 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c61809-b935-4121-87a5-217e97d10972 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:36.559551 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:36.568055 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3150f3-ad54-49c6-8f8f-eca775af9b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:36.568802 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3150f3-ad54-49c6-8f8f-eca775af9b20 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:36.569087 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3150f3-ad54-49c6-8f8f-eca775af9b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:36.569453 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3150f3-ad54-49c6-8f8f-eca775af9b20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:36.581756 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3150f3-ad54-49c6-8f8f-eca775af9b20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:36.583207 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3150f3-ad54-49c6-8f8f-eca775af9b20 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:36.597864 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-0c3150f3-ad54-49c6-8f8f-eca775af9b20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:36.597864 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:36.597864 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:36.597864 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:36.597864 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:36.597864 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:36.597864 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:36.597864 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:36.597864 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:36.597864 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:36.597864 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:36.597864 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:36.597864 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:36.597864 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:36.597864 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:36.597864 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:36.599324 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:36.599324 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:36.599324 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:36.599324 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:36.599324 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:36.599324 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:36.599324 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:36.599324 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:36.599324 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:36.599324 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:36.599324 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:36.599324 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:36.599324 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:36.599324 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:36.599324 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:36.599324 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:36.599324 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:36.600757 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:36.600757 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:36.600757 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:36.600757 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 277/550] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 15:46:36.604880 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3150f3-ad54-49c6-8f8f-eca775af9b20 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:36.605016 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c138cbb-8d32-4303-a251-1835112c839a None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:36.623793 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:36.710889 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f13424-7e5c-4657-a284-1579ef83aa00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:36.711542 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f13424-7e5c-4657-a284-1579ef83aa00 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:36.711818 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f13424-7e5c-4657-a284-1579ef83aa00 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:36.712086 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f13424-7e5c-4657-a284-1579ef83aa00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:36.712934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3150f3-ad54-49c6-8f8f-eca775af9b20 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:36.746239 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f13424-7e5c-4657-a284-1579ef83aa00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:36.748412 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f13424-7e5c-4657-a284-1579ef83aa00 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:36.761499 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005eb00-8219-411e-bdba-97f83b08fd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:36.762271 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005eb00-8219-411e-bdba-97f83b08fd36 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:36.763146 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005eb00-8219-411e-bdba-97f83b08fd36 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:36.763428 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005eb00-8219-411e-bdba-97f83b08fd36 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:36.764105 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005eb00-8219-411e-bdba-97f83b08fd36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:36.764411 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005eb00-8219-411e-bdba-97f83b08fd36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:36.764573 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-c3f13424-7e5c-4657-a284-1579ef83aa00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:36.764573 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:36.764573 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:36.764573 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:36.764573 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:36.764573 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:36.764573 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:36.764573 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:36.764573 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:36.764573 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:36.764573 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:36.764573 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:36.764573 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:36.764573 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:36.764573 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:36.764573 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:36.766555 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:36.766555 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:36.766555 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:36.766555 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:36.766555 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:36.766555 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:36.766555 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:36.766555 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:36.766555 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:36.766555 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:36.766555 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:36.766555 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:36.766555 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:36.766555 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:36.766555 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:36.766555 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:36.766555 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:36.767710 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:36.767710 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:36.767710 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:36.768180 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005eb00-8219-411e-bdba-97f83b08fd36 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:36.768261 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 274/551] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 421 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:36.773955 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f13424-7e5c-4657-a284-1579ef83aa00 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:36.787556 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 278/552] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:36.792902 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005eb00-8219-411e-bdba-97f83b08fd36 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:36.921207 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:36.951616 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f13424-7e5c-4657-a284-1579ef83aa00 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:36.961493 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005eb00-8219-411e-bdba-97f83b08fd36 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:36.991729 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ceab5-351c-48c4-96f5-86a5b56bd662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:36.992369 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ceab5-351c-48c4-96f5-86a5b56bd662 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:36.992646 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ceab5-351c-48c4-96f5-86a5b56bd662 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:36.992950 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ceab5-351c-48c4-96f5-86a5b56bd662 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:37.001141 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055ceab5-351c-48c4-96f5-86a5b56bd662 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:37.002744 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055ceab5-351c-48c4-96f5-86a5b56bd662 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:37.015333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-055ceab5-351c-48c4-96f5-86a5b56bd662 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 15:46:37.015333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:37.015333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:37.015333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:37.015333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:37.015333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:37.015333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:37.015333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:37.015333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:37.015333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:37.015333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:37.015333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:37.015333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 15:46:37.015333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 15:46:37.015333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 15:46:37.015333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 15:46:37.016247 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:37.016247 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:37.016247 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 15:46:37.016247 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:46:37.016247 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 15:46:37.016247 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:46:37.016247 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:37.016247 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:37.016247 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:37.016247 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:37.016247 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:37.016247 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:37.016247 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:37.016247 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:37.016247 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:37.016247 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:37.016247 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:37.016247 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:37.018141 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:37.018141 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:37.018141 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 15:46:37.018141 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 15:46:37.018141 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 15:46:37.018141 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 15:46:37.018141 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 15:46:37.018141 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 15:46:37.018141 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 15:46:37.018141 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:37.018141 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 279/553] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Aug 30 15:46:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 15:46:37.022420 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ceab5-351c-48c4-96f5-86a5b56bd662 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:37.027809 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:37.041712 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae90a14-29d5-4167-b3bf-c6993fa0f422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:37.042367 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae90a14-29d5-4167-b3bf-c6993fa0f422 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:37.042641 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae90a14-29d5-4167-b3bf-c6993fa0f422 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:37.042906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae90a14-29d5-4167-b3bf-c6993fa0f422 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:37.044406 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae90a14-29d5-4167-b3bf-c6993fa0f422 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:37.044914 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae90a14-29d5-4167-b3bf-c6993fa0f422 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:37.046296 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae90a14-29d5-4167-b3bf-c6993fa0f422 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:37.065734 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 275/554] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:37.067584 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f5e4c-32b8-41ed-84cb-8864d209409b None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:37.068182 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f5e4c-32b8-41ed-84cb-8864d209409b None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:37.068462 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f5e4c-32b8-41ed-84cb-8864d209409b None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:37.072939 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 276/555] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:37.074422 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f5e4c-32b8-41ed-84cb-8864d209409b None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:37.151104 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ceab5-351c-48c4-96f5-86a5b56bd662 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:37.180562 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:37.191824 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17aa34-4079-4eb5-9fd4-72a27a6f347a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:37.192775 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17aa34-4079-4eb5-9fd4-72a27a6f347a None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:37.193361 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17aa34-4079-4eb5-9fd4-72a27a6f347a None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:37.193855 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17aa34-4079-4eb5-9fd4-72a27a6f347a None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:37.194794 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17aa34-4079-4eb5-9fd4-72a27a6f347a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:37.195299 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17aa34-4079-4eb5-9fd4-72a27a6f347a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:37.196989 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17aa34-4079-4eb5-9fd4-72a27a6f347a None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:37.215761 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 280/556] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Aug 30 15:46:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:37.217483 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f54f9-c6e7-41a9-8aa3-132f4faca754 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:37.218010 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f54f9-c6e7-41a9-8aa3-132f4faca754 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:37.218486 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f54f9-c6e7-41a9-8aa3-132f4faca754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:37.221353 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f5e4c-32b8-41ed-84cb-8864d209409b None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:37.239112 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-175f54f9-c6e7-41a9-8aa3-132f4faca754 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:37.240830 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-175f54f9-c6e7-41a9-8aa3-132f4faca754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:37.267229 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ec786-48cd-4cc4-8622-7c088bb7a46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:37.268126 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ec786-48cd-4cc4-8622-7c088bb7a46b None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:37.268404 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ec786-48cd-4cc4-8622-7c088bb7a46b None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:37.268676 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ec786-48cd-4cc4-8622-7c088bb7a46b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:37.278661 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ec786-48cd-4cc4-8622-7c088bb7a46b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:37.280102 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ec786-48cd-4cc4-8622-7c088bb7a46b None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:37.295598 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-004ec786-48cd-4cc4-8622-7c088bb7a46b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 15:46:37.295598 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:37.295598 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:37.295598 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:37.295598 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:37.295598 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:37.295598 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:37.295598 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:37.295598 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:37.295598 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:37.295598 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:37.295598 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:37.295598 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 15:46:37.295598 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 15:46:37.295598 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 15:46:37.295598 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 15:46:37.297083 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:37.297083 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:37.297083 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 15:46:37.297083 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:46:37.297083 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 15:46:37.297083 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:46:37.297083 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:37.297083 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:37.297083 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:37.297083 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:37.297083 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:37.297083 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:37.297083 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:37.297083 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:37.297083 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:37.297083 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:37.297083 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:37.297083 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:37.298515 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:37.298515 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:37.298515 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 15:46:37.298515 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 15:46:37.298515 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 15:46:37.298515 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 15:46:37.298515 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 15:46:37.298515 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 15:46:37.298515 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 15:46:37.298515 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:37.300914 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 277/557] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 30 15:46:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:37.302264 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ec786-48cd-4cc4-8622-7c088bb7a46b None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:37.325948 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 281/558] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:46:37.326892 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f54f9-c6e7-41a9-8aa3-132f4faca754 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:37.372158 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:37.427678 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ec786-48cd-4cc4-8622-7c088bb7a46b None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:37.449804 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f54f9-c6e7-41a9-8aa3-132f4faca754 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:37.463795 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe5ec4-98ad-430b-9802-2c32f86d6f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:37.464448 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe5ec4-98ad-430b-9802-2c32f86d6f49 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:37.464727 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe5ec4-98ad-430b-9802-2c32f86d6f49 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:37.465045 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe5ec4-98ad-430b-9802-2c32f86d6f49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:37.466628 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:37.479928 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe5ec4-98ad-430b-9802-2c32f86d6f49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:37.482125 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe5ec4-98ad-430b-9802-2c32f86d6f49 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:37.488738 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7acc5-1412-413b-b3c0-8c02e84804bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:37.489695 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7acc5-1412-413b-b3c0-8c02e84804bc None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:37.490170 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7acc5-1412-413b-b3c0-8c02e84804bc None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:37.490634 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7acc5-1412-413b-b3c0-8c02e84804bc None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:37.491552 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7acc5-1412-413b-b3c0-8c02e84804bc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:37.492188 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7acc5-1412-413b-b3c0-8c02e84804bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:37.493826 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7acc5-1412-413b-b3c0-8c02e84804bc None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:37.497777 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-3dfe5ec4-98ad-430b-9802-2c32f86d6f49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:37.497777 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:37.497777 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:37.497777 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:37.497777 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:37.497777 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:37.497777 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:37.497777 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:37.497777 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:37.497777 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:37.497777 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:37.497777 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:37.497777 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:37.497777 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:37.497777 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:37.497777 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:37.498670 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:37.498670 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:37.498670 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:37.498670 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:37.498670 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:37.498670 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:37.498670 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:37.498670 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:37.498670 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:37.498670 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:37.498670 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:37.498670 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:37.498670 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:37.498670 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:37.498670 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:37.498670 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:37.498670 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:37.499511 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:37.499511 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:37.499511 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:37.503642 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 278/559] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:37.505038 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11b396-433e-4f90-87b3-8b90744a290c None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:37.505327 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11b396-433e-4f90-87b3-8b90744a290c None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:37.505605 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11b396-433e-4f90-87b3-8b90744a290c None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:37.507718 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 279/560] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:37.508540 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11b396-433e-4f90-87b3-8b90744a290c None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:37.515877 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 282/561] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Aug 30 15:46:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:37.521933 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa2248-8abf-41cb-929b-b639ed88407b None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:37.522487 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa2248-8abf-41cb-929b-b639ed88407b None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:37.522957 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa2248-8abf-41cb-929b-b639ed88407b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:37.543120 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-02aa2248-8abf-41cb-929b-b639ed88407b None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:37.544803 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-02aa2248-8abf-41cb-929b-b639ed88407b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:37.617283 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 283/562] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:46:37.618227 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa2248-8abf-41cb-929b-b639ed88407b None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:37.641658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11b396-433e-4f90-87b3-8b90744a290c None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:37.664992 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:37.693403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0439b1-cf44-463c-928a-20aa10f699cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:37.693744 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0439b1-cf44-463c-928a-20aa10f699cb None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:37.694027 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0439b1-cf44-463c-928a-20aa10f699cb None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:37.694302 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0439b1-cf44-463c-928a-20aa10f699cb None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:37.694954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0439b1-cf44-463c-928a-20aa10f699cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:37.695254 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0439b1-cf44-463c-928a-20aa10f699cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:37.696651 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0439b1-cf44-463c-928a-20aa10f699cb None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:37.709176 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 280/563] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:46:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:37.709913 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0439b1-cf44-463c-928a-20aa10f699cb None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:37.730171 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa2248-8abf-41cb-929b-b639ed88407b None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:37.732483 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:37.769787 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29b50c-1051-4e3f-aa63-1081ec2150f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:37.770474 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29b50c-1051-4e3f-aa63-1081ec2150f7 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:37.770664 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29b50c-1051-4e3f-aa63-1081ec2150f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:37.770934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29b50c-1051-4e3f-aa63-1081ec2150f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:37.816127 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0439b1-cf44-463c-928a-20aa10f699cb None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:37.842462 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29b50c-1051-4e3f-aa63-1081ec2150f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:37.844405 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29b50c-1051-4e3f-aa63-1081ec2150f7 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:37.853288 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d67482-db71-4274-8172-12834d7d81cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:37.853922 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d67482-db71-4274-8172-12834d7d81cc None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:37.854203 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d67482-db71-4274-8172-12834d7d81cc None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:37.854477 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d67482-db71-4274-8172-12834d7d81cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:37.865827 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d67482-db71-4274-8172-12834d7d81cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:37.870638 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-53d67482-db71-4274-8172-12834d7d81cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 15:46:37.870638 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:37.870638 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:37.870638 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:37.870638 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:37.870638 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:37.870638 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:37.870638 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:37.870638 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:37.870638 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:37.870638 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:37.870638 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:37.870638 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:37.870638 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:37.870638 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:37.870638 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:37.872441 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:37.872441 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:37.872441 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:37.872441 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:37.872441 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:37.872441 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:37.872441 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:37.872441 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:37.872441 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:37.872441 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:37.872441 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:37.872441 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:37.872441 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:37.872441 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:37.872441 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:37.872441 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:37.873324 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:37.873324 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:37.873324 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:37.873324 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:37.873324 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:37.873324 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:37.873324 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:37.873324 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:37.873324 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:37.873324 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:37.873324 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 15:46:37.873324 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:37.873324 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 281/564] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 30 15:46:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:37.873998 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b893ca-777c-428e-8fce-848c9e18a55e None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:37.873998 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b893ca-777c-428e-8fce-848c9e18a55e None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:37.874123 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b893ca-777c-428e-8fce-848c9e18a55e None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:37.875421 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 282/565] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:37.875953 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b893ca-777c-428e-8fce-848c9e18a55e None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:37.902528 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:37.957092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 284/566] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:46:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 15:46:37.957975 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29b50c-1051-4e3f-aa63-1081ec2150f7 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:37.961811 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:37.981421 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b893ca-777c-428e-8fce-848c9e18a55e None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:38.015080 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51934adf-8067-44e6-bf81-b764c7af6193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:38.015942 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51934adf-8067-44e6-bf81-b764c7af6193 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:38.016226 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51934adf-8067-44e6-bf81-b764c7af6193 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:38.016508 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51934adf-8067-44e6-bf81-b764c7af6193 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:38.023491 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51934adf-8067-44e6-bf81-b764c7af6193 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:38.024963 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51934adf-8067-44e6-bf81-b764c7af6193 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:38.036696 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-51934adf-8067-44e6-bf81-b764c7af6193 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:46:38.036696 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:38.036696 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:38.036696 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:38.036696 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:38.036696 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:38.036696 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:38.036696 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:38.036696 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:38.036696 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:38.036696 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:38.036696 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:38.036696 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 15:46:38.036696 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 15:46:38.036696 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 15:46:38.037615 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 15:46:38.037615 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:38.037615 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:38.037615 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:38.037615 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:38.037615 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:38.037615 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:38.037615 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:38.037615 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:38.037615 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:38.037615 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:38.037615 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:38.037615 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:38.037615 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:38.037615 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:38.037615 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:38.037615 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:38.038486 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 15:46:38.038486 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 15:46:38.038486 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 15:46:38.038486 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 15:46:38.038486 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 15:46:38.038486 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 15:46:38.038486 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:46:38.038486 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:38.038486 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 283/567] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:46:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:38.038957 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f7de8-f06e-4c91-baa9-c43e3299ddee None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:38.039194 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f7de8-f06e-4c91-baa9-c43e3299ddee None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:38.039466 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f7de8-f06e-4c91-baa9-c43e3299ddee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:38.056563 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-931f7de8-f06e-4c91-baa9-c43e3299ddee None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:38.057817 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-931f7de8-f06e-4c91-baa9-c43e3299ddee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:38.062089 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29b50c-1051-4e3f-aa63-1081ec2150f7 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:38.096055 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712265e-ff5c-4597-9a6b-aea51c7d81ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:38.096689 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712265e-ff5c-4597-9a6b-aea51c7d81ec None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:38.096998 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712265e-ff5c-4597-9a6b-aea51c7d81ec None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:38.097270 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712265e-ff5c-4597-9a6b-aea51c7d81ec None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:38.097936 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3712265e-ff5c-4597-9a6b-aea51c7d81ec None admin] RBAC: Adding query filter params (name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:38.098242 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3712265e-ff5c-4597-9a6b-aea51c7d81ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:38.099617 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3712265e-ff5c-4597-9a6b-aea51c7d81ec None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:38.107443 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 285/568] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Aug 30 15:46:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:38.108222 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712265e-ff5c-4597-9a6b-aea51c7d81ec None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:38.130588 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 284/569] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:46:38.130588 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f7de8-f06e-4c91-baa9-c43e3299ddee None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:38.156523 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:38.174054 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:38.214566 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712265e-ff5c-4597-9a6b-aea51c7d81ec None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:38.248147 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77464682-c315-47ee-bed1-4241c803b860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:38.248773 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77464682-c315-47ee-bed1-4241c803b860 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:38.248925 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f7de8-f06e-4c91-baa9-c43e3299ddee None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:38.249092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77464682-c315-47ee-bed1-4241c803b860 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:38.249341 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77464682-c315-47ee-bed1-4241c803b860 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:38.260985 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77464682-c315-47ee-bed1-4241c803b860 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:38.266902 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-77464682-c315-47ee-bed1-4241c803b860 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 15:46:38.266902 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:38.266902 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:38.266902 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:38.266902 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:38.266902 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:38.266902 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:38.266902 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:38.266902 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:38.266902 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:38.266902 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:38.266902 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:38.266902 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:38.266902 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:38.266902 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:38.266902 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:38.268092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:38.268092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:38.268092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:38.268092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:38.268092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:38.268092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:38.268092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:38.268092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:38.268092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:38.268092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:38.268092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:38.268092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:38.268092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:38.268092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:38.268092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:38.268092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:38.268973 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:38.268973 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:38.268973 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:38.268973 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:38.268973 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:38.268973 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:38.268973 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:38.268973 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:38.268973 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:38.268973 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:38.268973 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 15:46:38.268973 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:38.268973 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 286/570] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 30 15:46:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:38.270094 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77464682-c315-47ee-bed1-4241c803b860 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:38.289421 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec2445-3d4c-4ab5-b679-21f236623866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:38.290055 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec2445-3d4c-4ab5-b679-21f236623866 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:38.290333 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec2445-3d4c-4ab5-b679-21f236623866 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:38.290604 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec2445-3d4c-4ab5-b679-21f236623866 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:38.300816 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec2445-3d4c-4ab5-b679-21f236623866 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:38.302301 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec2445-3d4c-4ab5-b679-21f236623866 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:38.317286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-0eec2445-3d4c-4ab5-b679-21f236623866 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:38.317286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:38.317286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:38.317286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:38.317286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:38.317286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:38.317286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:38.317286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:38.317286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:38.317286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:38.317286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:38.317286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:38.317286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:38.317286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:38.317286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:38.317286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:38.318235 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:38.318235 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:38.318235 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:38.318235 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:38.318235 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:38.318235 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:38.318235 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:38.318235 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:38.318235 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:38.318235 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:38.318235 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:38.318235 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:38.318235 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:38.318235 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:38.318235 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:38.318235 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:38.318235 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:38.319192 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:38.319192 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:38.319192 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:38.323015 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 285/571] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:38.323661 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec2445-3d4c-4ab5-b679-21f236623866 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:38.383174 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77464682-c315-47ee-bed1-4241c803b860 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:38.392687 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:38.413241 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:38.432207 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10d751-66c6-4eb4-be4f-201515cef2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:38.433309 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10d751-66c6-4eb4-be4f-201515cef2c4 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:38.434557 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10d751-66c6-4eb4-be4f-201515cef2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:38.434988 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10d751-66c6-4eb4-be4f-201515cef2c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:38.435869 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10d751-66c6-4eb4-be4f-201515cef2c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:38.436337 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10d751-66c6-4eb4-be4f-201515cef2c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:38.438690 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10d751-66c6-4eb4-be4f-201515cef2c4 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:38.452259 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec2445-3d4c-4ab5-b679-21f236623866 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:38.453915 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 287/572] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 30 15:46:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:38.459677 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10d751-66c6-4eb4-be4f-201515cef2c4 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:38.490072 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9e36b-9e62-47d3-b892-95dba8a333cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:38.490740 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9e36b-9e62-47d3-b892-95dba8a333cf None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:38.491092 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9e36b-9e62-47d3-b892-95dba8a333cf None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:38.491431 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9e36b-9e62-47d3-b892-95dba8a333cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:38.503438 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f9e36b-9e62-47d3-b892-95dba8a333cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:38.505028 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f9e36b-9e62-47d3-b892-95dba8a333cf None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:38.520693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-c5f9e36b-9e62-47d3-b892-95dba8a333cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:38.520693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:38.520693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:38.520693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:38.520693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:38.520693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:38.520693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:38.520693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:38.520693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:38.520693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:38.520693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:38.520693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:38.520693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:38.520693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:38.520693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:38.520693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:38.521652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:38.521652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:38.521652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:38.521652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:38.521652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:38.521652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:38.521652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:38.521652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:38.521652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:38.521652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:38.521652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:38.521652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:38.521652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:38.521652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:38.521652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:38.521652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:38.521652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:38.522515 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:38.522515 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:38.522515 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:38.522515 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 286/573] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:38.522741 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9e36b-9e62-47d3-b892-95dba8a333cf None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:38.564462 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10d751-66c6-4eb4-be4f-201515cef2c4 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:38.599358 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ab7ea-a66e-4575-80a4-d37d5b0e8a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:38.599972 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ab7ea-a66e-4575-80a4-d37d5b0e8a37 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:38.600252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ab7ea-a66e-4575-80a4-d37d5b0e8a37 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:38.600526 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ab7ea-a66e-4575-80a4-d37d5b0e8a37 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:38.601229 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ab7ea-a66e-4575-80a4-d37d5b0e8a37 None admin] RBAC: Adding query filter params (name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:38.601533 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ab7ea-a66e-4575-80a4-d37d5b0e8a37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:38.602911 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ab7ea-a66e-4575-80a4-d37d5b0e8a37 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:38.611636 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 288/574] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Aug 30 15:46:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:38.612171 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ab7ea-a66e-4575-80a4-d37d5b0e8a37 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:38.633746 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9e36b-9e62-47d3-b892-95dba8a333cf None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:38.650882 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:38.670075 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752aa192-3633-4f0c-ad6f-2c6c7c2745c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:38.670719 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752aa192-3633-4f0c-ad6f-2c6c7c2745c2 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:38.670972 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752aa192-3633-4f0c-ad6f-2c6c7c2745c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:38.671075 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:38.671251 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752aa192-3633-4f0c-ad6f-2c6c7c2745c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:38.671913 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752aa192-3633-4f0c-ad6f-2c6c7c2745c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:38.672241 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752aa192-3633-4f0c-ad6f-2c6c7c2745c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:38.673951 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752aa192-3633-4f0c-ad6f-2c6c7c2745c2 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:38.688471 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 287/575] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:46:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:38.689459 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752aa192-3633-4f0c-ad6f-2c6c7c2745c2 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:38.729348 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ab7ea-a66e-4575-80a4-d37d5b0e8a37 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:38.765905 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40118702-0af2-4669-842e-de81604243f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:38.766470 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40118702-0af2-4669-842e-de81604243f0 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:38.766751 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40118702-0af2-4669-842e-de81604243f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:38.767027 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40118702-0af2-4669-842e-de81604243f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:38.778963 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40118702-0af2-4669-842e-de81604243f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:38.784222 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-40118702-0af2-4669-842e-de81604243f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 15:46:38.784222 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:38.784222 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:38.784222 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:38.784222 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:38.784222 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:38.784222 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:38.784222 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:38.784222 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:38.784222 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:38.784222 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:38.784222 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:38.784222 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:38.784222 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:38.784222 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:38.784222 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:38.785313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:38.785313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:38.785313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:38.785313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:38.785313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:38.785313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:38.785313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:38.785313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:38.785313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:38.785313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:38.785313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:38.785313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:38.785313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:38.785313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:38.785313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:38.785313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:38.786305 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:38.786305 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:38.786305 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:38.786305 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:38.786305 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:38.786305 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:38.786305 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:38.786305 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:38.786305 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:38.786305 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:38.786305 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 15:46:38.786305 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:38.786305 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 289/576] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 30 15:46:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:38.786305 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40118702-0af2-4669-842e-de81604243f0 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:38.803163 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752aa192-3633-4f0c-ad6f-2c6c7c2745c2 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:38.836597 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a5135-52ea-49ec-a21b-e4651a5b4937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:38.837283 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a5135-52ea-49ec-a21b-e4651a5b4937 None admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:38.837564 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a5135-52ea-49ec-a21b-e4651a5b4937 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:38.837839 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a5135-52ea-49ec-a21b-e4651a5b4937 None admin] PATH_INFO: `/v3/projects/51f312b4cd8b449aa2971993f68de9af/users/ebc80bf891614fb895af33ca1ded6b9d/roles/c99e31de7c4c47c7b7b2c45c2771ca58` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:38.852871 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a5135-52ea-49ec-a21b-e4651a5b4937 None admin] RBAC: Authorizing `identity:create_grant(project_id=51f312b4cd8b449aa2971993f68de9af, user_id=ebc80bf891614fb895af33ca1ded6b9d, role_id=c99e31de7c4c47c7b7b2c45c2771ca58)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:38.854397 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a5135-52ea-49ec-a21b-e4651a5b4937 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:38.867273 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 288/577] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 30 15:46:38 2022] PUT /identity/v3/projects/51f312b4cd8b449aa2971993f68de9af/users/ebc80bf891614fb895af33ca1ded6b9d/roles/c99e31de7c4c47c7b7b2c45c2771ca58 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:46:38.868059 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a5135-52ea-49ec-a21b-e4651a5b4937 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:38.890449 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40118702-0af2-4669-842e-de81604243f0 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:38.898704 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:38.909700 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:38.940624 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbc8b9-69bb-4ed0-90bc-08c163d48db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:38.941284 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbc8b9-69bb-4ed0-90bc-08c163d48db8 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:38.941565 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbc8b9-69bb-4ed0-90bc-08c163d48db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:38.941836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbc8b9-69bb-4ed0-90bc-08c163d48db8 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:38.942913 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bbc8b9-69bb-4ed0-90bc-08c163d48db8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:38.942913 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bbc8b9-69bb-4ed0-90bc-08c163d48db8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:38.944181 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bbc8b9-69bb-4ed0-90bc-08c163d48db8 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:38.958229 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 290/578] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:46:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:38.959435 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbc8b9-69bb-4ed0-90bc-08c163d48db8 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:39.003571 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a5135-52ea-49ec-a21b-e4651a5b4937 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:39.047906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd91ed5-a6f1-4292-9cc7-22a188de8e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:39.048879 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd91ed5-a6f1-4292-9cc7-22a188de8e88 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:39.049309 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd91ed5-a6f1-4292-9cc7-22a188de8e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:39.049817 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd91ed5-a6f1-4292-9cc7-22a188de8e88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:39.061308 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd91ed5-a6f1-4292-9cc7-22a188de8e88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:39.063175 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd91ed5-a6f1-4292-9cc7-22a188de8e88 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:39.071582 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbc8b9-69bb-4ed0-90bc-08c163d48db8 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:39.081182 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-1bd91ed5-a6f1-4292-9cc7-22a188de8e88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:39.081182 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:39.081182 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:39.081182 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:39.081182 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:39.081182 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:39.081182 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:39.081182 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:39.081182 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:39.081182 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:39.081182 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:39.081182 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:39.081182 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:39.081182 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:39.081182 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:39.081182 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:39.082317 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:39.082317 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:39.082317 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:39.082317 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:39.082317 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:39.082317 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:39.082317 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:39.082317 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:39.082317 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:39.082317 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:39.082317 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:39.082317 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:39.082317 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:39.082317 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:39.082317 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:39.082317 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:39.082317 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:39.083419 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:39.083419 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:39.083419 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:39.084923 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 289/579] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:39.085837 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd91ed5-a6f1-4292-9cc7-22a188de8e88 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:39.112763 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768032cb-8cbc-42a9-b6b6-56375845294e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:39.113429 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768032cb-8cbc-42a9-b6b6-56375845294e None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:39.113710 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768032cb-8cbc-42a9-b6b6-56375845294e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:39.113983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768032cb-8cbc-42a9-b6b6-56375845294e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:39.121228 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768032cb-8cbc-42a9-b6b6-56375845294e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:39.123224 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768032cb-8cbc-42a9-b6b6-56375845294e None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:39.134447 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-768032cb-8cbc-42a9-b6b6-56375845294e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:46:39.134447 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:39.134447 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:39.134447 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:39.134447 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:39.134447 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:39.134447 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:39.134447 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:39.134447 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:39.134447 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:39.134447 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:39.134447 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:39.134447 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 15:46:39.134447 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 15:46:39.134447 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 15:46:39.135570 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 15:46:39.135570 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:39.135570 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:39.135570 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:39.135570 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:39.135570 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:39.135570 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:39.135570 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:39.135570 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:39.135570 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:39.135570 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:39.135570 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:39.135570 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:39.135570 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:39.135570 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:39.135570 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:39.135570 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:39.136454 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 15:46:39.136454 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 15:46:39.136454 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 15:46:39.136454 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 15:46:39.136454 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 15:46:39.136454 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 15:46:39.136454 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:46:39.136454 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:39.136454 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 291/580] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:46:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:39.136454 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768032cb-8cbc-42a9-b6b6-56375845294e None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:39.166272 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:39.182265 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:39.205917 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd91ed5-a6f1-4292-9cc7-22a188de8e88 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:39.241312 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a2fab-5428-4bc0-bb6b-7e9aab585aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:39.242011 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a2fab-5428-4bc0-bb6b-7e9aab585aed None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:39.242366 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a2fab-5428-4bc0-bb6b-7e9aab585aed None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:39.242709 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a2fab-5428-4bc0-bb6b-7e9aab585aed None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:39.243453 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a2fab-5428-4bc0-bb6b-7e9aab585aed None admin] RBAC: Adding query filter params (name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:39.243833 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a2fab-5428-4bc0-bb6b-7e9aab585aed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:39.245318 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a2fab-5428-4bc0-bb6b-7e9aab585aed None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:39.247175 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768032cb-8cbc-42a9-b6b6-56375845294e None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:39.254236 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 290/581] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Aug 30 15:46:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:39.255388 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a2fab-5428-4bc0-bb6b-7e9aab585aed None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:39.287744 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01ac25-eaf4-4a6b-86b8-ec768126cfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:39.288481 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01ac25-eaf4-4a6b-86b8-ec768126cfec None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:39.288853 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01ac25-eaf4-4a6b-86b8-ec768126cfec None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:39.289198 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01ac25-eaf4-4a6b-86b8-ec768126cfec None admin] PATH_INFO: `/v3/users/glance` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:39.297690 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c01ac25-eaf4-4a6b-86b8-ec768126cfec None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:39.299278 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c01ac25-eaf4-4a6b-86b8-ec768126cfec None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:39.311636 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-0c01ac25-eaf4-4a6b-86b8-ec768126cfec None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 15:46:39.311636 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:39.311636 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:39.311636 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:39.311636 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:39.311636 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:39.311636 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:39.311636 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:39.311636 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:39.311636 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:39.311636 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:39.311636 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:39.311636 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 15:46:39.311636 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 15:46:39.311636 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 15:46:39.311636 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 15:46:39.312766 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:39.312766 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:39.312766 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 15:46:39.312766 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:46:39.312766 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 15:46:39.312766 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:46:39.312766 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:39.312766 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:39.312766 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:39.312766 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:39.312766 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:39.312766 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:39.312766 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:39.312766 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:39.312766 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:39.312766 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:39.312766 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:39.312766 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:39.313788 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:39.313788 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:39.313788 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 15:46:39.313788 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 15:46:39.313788 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 15:46:39.313788 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 15:46:39.313788 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 15:46:39.313788 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 15:46:39.313788 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 15:46:39.313788 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:39.313788 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 292/582] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:46:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:39.314376 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01ac25-eaf4-4a6b-86b8-ec768126cfec None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:39.373168 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a2fab-5428-4bc0-bb6b-7e9aab585aed None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:39.407181 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:39.408144 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f86dca-da9a-4b08-8a18-38bc6b8eacb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:39.408833 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f86dca-da9a-4b08-8a18-38bc6b8eacb6 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:39.409074 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f86dca-da9a-4b08-8a18-38bc6b8eacb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:39.409344 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f86dca-da9a-4b08-8a18-38bc6b8eacb6 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:39.410224 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f86dca-da9a-4b08-8a18-38bc6b8eacb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:39.410528 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f86dca-da9a-4b08-8a18-38bc6b8eacb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:39.411963 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f86dca-da9a-4b08-8a18-38bc6b8eacb6 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:39.421816 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:39.424452 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01ac25-eaf4-4a6b-86b8-ec768126cfec None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:39.428935 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 291/583] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:39.430000 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f86dca-da9a-4b08-8a18-38bc6b8eacb6 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:39.463803 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b148da-044d-4e6f-b7b8-221d34d7a80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:39.465381 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b148da-044d-4e6f-b7b8-221d34d7a80b None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:39.465874 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b148da-044d-4e6f-b7b8-221d34d7a80b None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:39.466426 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b148da-044d-4e6f-b7b8-221d34d7a80b None admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:39.467267 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b148da-044d-4e6f-b7b8-221d34d7a80b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:39.467586 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b148da-044d-4e6f-b7b8-221d34d7a80b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:39.469052 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b148da-044d-4e6f-b7b8-221d34d7a80b None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:39.488390 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 293/584] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 30 15:46:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:39.488390 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b148da-044d-4e6f-b7b8-221d34d7a80b None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:39.542302 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f86dca-da9a-4b08-8a18-38bc6b8eacb6 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:39.580281 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc37e6e3-38d0-4578-b67e-2c8bf0e763c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:39.581067 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37e6e3-38d0-4578-b67e-2c8bf0e763c2 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:39.581350 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37e6e3-38d0-4578-b67e-2c8bf0e763c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:39.581625 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37e6e3-38d0-4578-b67e-2c8bf0e763c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:39.586616 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b148da-044d-4e6f-b7b8-221d34d7a80b None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:39.592628 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc37e6e3-38d0-4578-b67e-2c8bf0e763c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:39.594144 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc37e6e3-38d0-4578-b67e-2c8bf0e763c2 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:39.612506 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-bc37e6e3-38d0-4578-b67e-2c8bf0e763c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:39.612506 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:39.612506 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:39.612506 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:39.612506 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:39.612506 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:39.612506 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:39.612506 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:39.612506 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:39.612506 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:39.612506 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:39.612506 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:39.612506 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:39.612506 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:39.612506 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:39.612506 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:39.613673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:39.613673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:39.613673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:39.613673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:39.613673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:39.613673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:39.613673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:39.613673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:39.613673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:39.613673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:39.613673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:39.613673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:39.613673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:39.613673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:39.613673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:39.613673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:39.613673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:39.614557 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:39.614557 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:39.614557 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:39.614557 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 292/585] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:39.614557 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc37e6e3-38d0-4578-b67e-2c8bf0e763c2 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:39.626635 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c861084-16a9-4e2c-a872-3f3091c86512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:39.627256 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c861084-16a9-4e2c-a872-3f3091c86512 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:39.627632 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c861084-16a9-4e2c-a872-3f3091c86512 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:39.627987 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c861084-16a9-4e2c-a872-3f3091c86512 None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:39.628634 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c861084-16a9-4e2c-a872-3f3091c86512 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:39.628971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c861084-16a9-4e2c-a872-3f3091c86512 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:39.630380 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c861084-16a9-4e2c-a872-3f3091c86512 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:39.649040 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 294/586] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Aug 30 15:46:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:39.654552 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c861084-16a9-4e2c-a872-3f3091c86512 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:39.659111 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:39.671481 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:39.722877 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc37e6e3-38d0-4578-b67e-2c8bf0e763c2 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:39.761942 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2c57d-ffc3-435c-a88e-d7c6e499718e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:39.763407 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2c57d-ffc3-435c-a88e-d7c6e499718e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:39.763776 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2c57d-ffc3-435c-a88e-d7c6e499718e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:39.764056 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2c57d-ffc3-435c-a88e-d7c6e499718e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:39.773353 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2c57d-ffc3-435c-a88e-d7c6e499718e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:39.774822 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2c57d-ffc3-435c-a88e-d7c6e499718e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:39.777538 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c861084-16a9-4e2c-a872-3f3091c86512 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:39.789232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-77f2c57d-ffc3-435c-a88e-d7c6e499718e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 15:46:39.789232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:39.789232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:39.789232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:39.789232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:39.789232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:39.789232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:39.789232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:39.789232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:39.789232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:39.789232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:39.789232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:39.789232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 15:46:39.789232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 15:46:39.789232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 15:46:39.789232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 15:46:39.790232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:39.790232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:39.790232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 15:46:39.790232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:46:39.790232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 15:46:39.790232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:46:39.790232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:39.790232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:39.790232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:39.790232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:39.790232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:39.790232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:39.790232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:39.790232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:39.790232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:39.790232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:39.790232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:39.790232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:39.791190 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:39.791190 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:39.791190 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 15:46:39.791190 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 15:46:39.791190 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 15:46:39.791190 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 15:46:39.791190 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 15:46:39.791190 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 15:46:39.791190 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 15:46:39.791190 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:39.791190 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 293/587] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:46:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:39.791190 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2c57d-ffc3-435c-a88e-d7c6e499718e None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:39.820466 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe3b461-850a-49e0-8d1e-777baf793016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:39.821100 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3b461-850a-49e0-8d1e-777baf793016 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:39.821383 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3b461-850a-49e0-8d1e-777baf793016 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:39.821657 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3b461-850a-49e0-8d1e-777baf793016 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:39.822394 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe3b461-850a-49e0-8d1e-777baf793016 None admin] RBAC: Adding query filter params (role.id=c99e31de7c4c47c7b7b2c45c2771ca58, scope.project.id=51f312b4cd8b449aa2971993f68de9af, user.id=94765f224c734beabe83b4dc0c5e511f) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:39.822702 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe3b461-850a-49e0-8d1e-777baf793016 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:39.824159 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe3b461-850a-49e0-8d1e-777baf793016 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:39.830879 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 295/588] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:46:39 2022] GET /identity/v3/role_assignments?user.id=94765f224c734beabe83b4dc0c5e511f&scope.project.id=51f312b4cd8b449aa2971993f68de9af&role.id=c99e31de7c4c47c7b7b2c45c2771ca58 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:39.831607 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe3b461-850a-49e0-8d1e-777baf793016 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:39.920062 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:39.943746 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2c57d-ffc3-435c-a88e-d7c6e499718e None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:39.961318 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe3b461-850a-49e0-8d1e-777baf793016 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:39.963499 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:39.997574 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f10a9-fa50-4ed5-b086-ffec40d0f07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:39.998487 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f10a9-fa50-4ed5-b086-ffec40d0f07a None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:39.998916 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f10a9-fa50-4ed5-b086-ffec40d0f07a None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:39.999335 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f10a9-fa50-4ed5-b086-ffec40d0f07a None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:40.000143 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f10a9-fa50-4ed5-b086-ffec40d0f07a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:40.000593 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f10a9-fa50-4ed5-b086-ffec40d0f07a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:40.001855 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78a51d-ff48-44fd-ad27-afe56d39656a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:40.002392 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f10a9-fa50-4ed5-b086-ffec40d0f07a None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:40.002784 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78a51d-ff48-44fd-ad27-afe56d39656a None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:40.003167 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78a51d-ff48-44fd-ad27-afe56d39656a None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:40.003545 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78a51d-ff48-44fd-ad27-afe56d39656a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:40.016254 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78a51d-ff48-44fd-ad27-afe56d39656a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:40.018181 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78a51d-ff48-44fd-ad27-afe56d39656a None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:40.019061 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 294/589] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:40.020058 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f10a9-fa50-4ed5-b086-ffec40d0f07a None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:40.034731 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-3c78a51d-ff48-44fd-ad27-afe56d39656a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:40.034731 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:40.034731 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:40.034731 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:40.034731 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:40.034731 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:40.034731 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:40.034731 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:40.034731 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:40.034731 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:40.034731 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:40.034731 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:40.034731 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:40.034731 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:40.034731 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:40.034731 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:40.035926 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:40.035926 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:40.035926 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:40.035926 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:40.035926 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:40.035926 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:40.035926 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:40.035926 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:40.035926 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:40.035926 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:40.035926 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:40.035926 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:40.035926 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:40.035926 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:40.035926 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:40.035926 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:40.035926 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:40.037073 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:40.037073 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:40.037073 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:40.038294 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 296/590] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:40.039213 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78a51d-ff48-44fd-ad27-afe56d39656a None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:40.143370 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f10a9-fa50-4ed5-b086-ffec40d0f07a None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:40.164689 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78a51d-ff48-44fd-ad27-afe56d39656a None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:40.186617 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:40.191650 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1090a2-1e14-4bea-a818-14253e06fd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:40.192723 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1090a2-1e14-4bea-a818-14253e06fd76 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:40.193206 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1090a2-1e14-4bea-a818-14253e06fd76 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:40.193641 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1090a2-1e14-4bea-a818-14253e06fd76 None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:40.195075 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1090a2-1e14-4bea-a818-14253e06fd76 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:40.195626 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1090a2-1e14-4bea-a818-14253e06fd76 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:40.197787 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1090a2-1e14-4bea-a818-14253e06fd76 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:40.204009 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8dcc1-5541-4504-bc15-ba7c8f3c440f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:40.204808 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8dcc1-5541-4504-bc15-ba7c8f3c440f None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:40.205200 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8dcc1-5541-4504-bc15-ba7c8f3c440f None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:40.205576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8dcc1-5541-4504-bc15-ba7c8f3c440f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:40.213893 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee8dcc1-5541-4504-bc15-ba7c8f3c440f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:40.216113 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee8dcc1-5541-4504-bc15-ba7c8f3c440f None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:40.221529 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 295/591] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Aug 30 15:46:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:40.222558 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1090a2-1e14-4bea-a818-14253e06fd76 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:40.233851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-8ee8dcc1-5541-4504-bc15-ba7c8f3c440f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 15:46:40.233851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:40.233851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:40.233851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:40.233851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:40.233851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:40.233851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:40.233851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:40.233851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:40.233851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:40.233851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:40.233851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:40.233851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 15:46:40.233851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 15:46:40.233851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 15:46:40.233851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 15:46:40.235042 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:40.235042 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:40.235042 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 15:46:40.235042 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:46:40.235042 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 15:46:40.235042 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:46:40.235042 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:40.235042 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:40.235042 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:40.235042 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:40.235042 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:40.235042 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:40.235042 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:40.235042 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:40.235042 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:40.235042 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:40.235042 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:40.235042 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:40.236188 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:40.236188 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:40.236188 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 15:46:40.236188 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 15:46:40.236188 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 15:46:40.236188 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 15:46:40.236188 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 15:46:40.236188 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 15:46:40.236188 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 15:46:40.236188 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:40.238117 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 297/592] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 30 15:46:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:40.239236 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8dcc1-5541-4504-bc15-ba7c8f3c440f None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:40.265227 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:40.357771 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1090a2-1e14-4bea-a818-14253e06fd76 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:40.366890 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8dcc1-5541-4504-bc15-ba7c8f3c440f None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:40.396596 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe4d64-5ddc-49bc-af66-a2181e68b466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:40.397441 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe4d64-5ddc-49bc-af66-a2181e68b466 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:40.397728 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe4d64-5ddc-49bc-af66-a2181e68b466 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:40.398053 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe4d64-5ddc-49bc-af66-a2181e68b466 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:40.398781 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe4d64-5ddc-49bc-af66-a2181e68b466 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:40.399092 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe4d64-5ddc-49bc-af66-a2181e68b466 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:40.400992 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe4d64-5ddc-49bc-af66-a2181e68b466 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:40.416699 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 296/593] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:46:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:40.417714 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe4d64-5ddc-49bc-af66-a2181e68b466 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:40.418015 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f1b30-cac7-4f0b-954c-d6b6ada3c022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:40.419551 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f1b30-cac7-4f0b-954c-d6b6ada3c022 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:40.420037 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f1b30-cac7-4f0b-954c-d6b6ada3c022 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:40.420545 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f1b30-cac7-4f0b-954c-d6b6ada3c022 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:40.434973 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f1b30-cac7-4f0b-954c-d6b6ada3c022 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:40.437565 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f1b30-cac7-4f0b-954c-d6b6ada3c022 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:40.456354 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-048f1b30-cac7-4f0b-954c-d6b6ada3c022 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:40.456354 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:40.456354 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:40.456354 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:40.456354 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:40.456354 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:40.456354 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:40.456354 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:40.456354 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:40.456354 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:40.456354 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:40.456354 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:40.456354 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:40.456354 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:40.456354 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:40.456354 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:40.457426 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:40.457426 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:40.457426 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:40.457426 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:40.457426 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:40.457426 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:40.457426 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:40.457426 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:40.457426 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:40.457426 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:40.457426 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:40.457426 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:40.457426 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:40.457426 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:40.457426 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:40.457426 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:40.457426 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:40.458540 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:40.458540 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:40.458540 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:40.460436 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 298/594] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:40.461415 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f1b30-cac7-4f0b-954c-d6b6ada3c022 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:40.495934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:40.538249 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:40.555952 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe4d64-5ddc-49bc-af66-a2181e68b466 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:40.582840 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f1b30-cac7-4f0b-954c-d6b6ada3c022 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:40.594008 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc380d-67cb-4925-b211-d98e11d7480d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:40.594956 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc380d-67cb-4925-b211-d98e11d7480d None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:40.595422 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc380d-67cb-4925-b211-d98e11d7480d None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:40.595927 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc380d-67cb-4925-b211-d98e11d7480d None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:40.597000 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc380d-67cb-4925-b211-d98e11d7480d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:40.597598 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc380d-67cb-4925-b211-d98e11d7480d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:40.599422 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc380d-67cb-4925-b211-d98e11d7480d None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:40.619334 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 297/595] 10.222.0.25 () {56 vars in 1139 bytes} [Tue Aug 30 15:46:40 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:40.620503 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc380d-67cb-4925-b211-d98e11d7480d None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:40.626636 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a343a53-3eba-4be7-b3c9-7543b6ce09c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:40.627354 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a343a53-3eba-4be7-b3c9-7543b6ce09c2 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:40.627703 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a343a53-3eba-4be7-b3c9-7543b6ce09c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:40.628050 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a343a53-3eba-4be7-b3c9-7543b6ce09c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:40.637069 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a343a53-3eba-4be7-b3c9-7543b6ce09c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:40.639385 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a343a53-3eba-4be7-b3c9-7543b6ce09c2 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:40.656240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-3a343a53-3eba-4be7-b3c9-7543b6ce09c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:46:40.656240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:40.656240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:40.656240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:40.656240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:40.656240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:40.656240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:40.656240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:40.656240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:40.656240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:40.656240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:40.656240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:40.656240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 15:46:40.656240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 15:46:40.656240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 15:46:40.657333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 15:46:40.657333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:40.657333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:40.657333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:40.657333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:40.657333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:40.657333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:40.657333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:40.657333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:40.657333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:40.657333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:40.657333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:40.657333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:40.657333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:40.657333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:40.657333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:40.657333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:40.658447 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 15:46:40.658447 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 15:46:40.658447 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 15:46:40.658447 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 15:46:40.658447 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 15:46:40.658447 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 15:46:40.658447 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:46:40.658447 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:40.661804 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 299/596] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:46:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:40.662721 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a343a53-3eba-4be7-b3c9-7543b6ce09c2 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:40.752261 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc380d-67cb-4925-b211-d98e11d7480d None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:40.790939 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8321162b-0706-4f03-b4dd-1fc1cca17065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:40.791550 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321162b-0706-4f03-b4dd-1fc1cca17065 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:40.791828 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321162b-0706-4f03-b4dd-1fc1cca17065 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:40.792458 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321162b-0706-4f03-b4dd-1fc1cca17065 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:40.792763 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8321162b-0706-4f03-b4dd-1fc1cca17065 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:40.793094 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8321162b-0706-4f03-b4dd-1fc1cca17065 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:40.795115 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8321162b-0706-4f03-b4dd-1fc1cca17065 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:40.797308 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:40.806991 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 298/597] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:46:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:40.807643 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8321162b-0706-4f03-b4dd-1fc1cca17065 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:40.810067 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a343a53-3eba-4be7-b3c9-7543b6ce09c2 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:40.819060 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:40.848195 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a734c85-6eb0-421e-93af-bffb7ff8697e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:40.848854 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a734c85-6eb0-421e-93af-bffb7ff8697e None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:40.849139 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a734c85-6eb0-421e-93af-bffb7ff8697e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:40.849406 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a734c85-6eb0-421e-93af-bffb7ff8697e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:40.860632 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a734c85-6eb0-421e-93af-bffb7ff8697e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:40.862120 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a734c85-6eb0-421e-93af-bffb7ff8697e None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:40.876946 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-5a734c85-6eb0-421e-93af-bffb7ff8697e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:40.876946 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:40.876946 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:40.876946 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:40.876946 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:40.876946 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:40.876946 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:40.876946 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:40.876946 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:40.876946 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:40.876946 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:40.876946 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:40.876946 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:40.876946 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:40.876946 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:40.876946 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:40.877909 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:40.877909 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:40.877909 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:40.877909 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:40.877909 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:40.877909 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:40.877909 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:40.877909 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:40.877909 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:40.877909 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:40.877909 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:40.877909 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:40.877909 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:40.877909 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:40.877909 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:40.877909 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:40.877909 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:40.878763 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:40.878763 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:40.878763 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:40.878763 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 300/598] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:40.879718 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed45bb4-dcdb-41eb-ad90-641f4064ad5f None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:40.879718 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed45bb4-dcdb-41eb-ad90-641f4064ad5f None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:40.879718 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed45bb4-dcdb-41eb-ad90-641f4064ad5f None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:40.884811 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 301/599] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:40.885581 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed45bb4-dcdb-41eb-ad90-641f4064ad5f None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:40.928129 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8321162b-0706-4f03-b4dd-1fc1cca17065 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:40.963726 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc0762-0cc9-44e2-aa1a-e4e6f5a4ef80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:40.964341 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc0762-0cc9-44e2-aa1a-e4e6f5a4ef80 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:40.964620 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc0762-0cc9-44e2-aa1a-e4e6f5a4ef80 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:40.964920 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc0762-0cc9-44e2-aa1a-e4e6f5a4ef80 None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:40.966496 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc0762-0cc9-44e2-aa1a-e4e6f5a4ef80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:40.966798 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc0762-0cc9-44e2-aa1a-e4e6f5a4ef80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:40.968280 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc0762-0cc9-44e2-aa1a-e4e6f5a4ef80 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:40.982262 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 299/600] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 30 15:46:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:40.983128 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc0762-0cc9-44e2-aa1a-e4e6f5a4ef80 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:40.995612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed45bb4-dcdb-41eb-ad90-641f4064ad5f None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:41.032088 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a8005-ae17-4d09-924b-e50252cc33f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:41.032714 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a8005-ae17-4d09-924b-e50252cc33f8 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:41.033057 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a8005-ae17-4d09-924b-e50252cc33f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:41.033287 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a8005-ae17-4d09-924b-e50252cc33f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:41.040329 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a8005-ae17-4d09-924b-e50252cc33f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:41.041725 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a8005-ae17-4d09-924b-e50252cc33f8 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:41.052823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-100a8005-ae17-4d09-924b-e50252cc33f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:46:41.052823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:41.052823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:41.052823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:41.052823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:41.052823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:41.052823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:41.052823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:41.052823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:41.052823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:41.052823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:41.052823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:41.052823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 15:46:41.052823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 15:46:41.052823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 15:46:41.053684 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 15:46:41.053684 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:41.053684 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:41.053684 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:41.053684 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:41.053684 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:41.053684 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:41.053684 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:41.053684 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:41.053684 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:41.053684 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:41.053684 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:41.053684 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:41.053684 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:41.053684 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:41.053684 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:41.053684 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:41.054537 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 15:46:41.054537 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 15:46:41.054537 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 15:46:41.054537 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 15:46:41.054537 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 15:46:41.054537 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 15:46:41.054537 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:46:41.054537 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:41.054537 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 302/601] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:46:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:41.055673 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb38d9f-0edc-4c08-96f8-372a254ab5a5 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:41.055673 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb38d9f-0edc-4c08-96f8-372a254ab5a5 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:41.055673 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb38d9f-0edc-4c08-96f8-372a254ab5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:41.060840 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:41.064709 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:41.078595 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-7fb38d9f-0edc-4c08-96f8-372a254ab5a5 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:41.079795 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7fb38d9f-0edc-4c08-96f8-372a254ab5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:41.099230 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc0762-0cc9-44e2-aa1a-e4e6f5a4ef80 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:41.135998 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8399a90-bb38-43de-883a-59c70bdac80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:41.136612 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8399a90-bb38-43de-883a-59c70bdac80c None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:41.136958 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8399a90-bb38-43de-883a-59c70bdac80c None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:41.137379 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8399a90-bb38-43de-883a-59c70bdac80c None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:41.138080 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8399a90-bb38-43de-883a-59c70bdac80c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:41.138360 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8399a90-bb38-43de-883a-59c70bdac80c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:41.139634 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8399a90-bb38-43de-883a-59c70bdac80c None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:41.156320 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 303/602] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:46:41.156320 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb38d9f-0edc-4c08-96f8-372a254ab5a5 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:41.156751 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 300/603] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:46:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:41.157631 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8399a90-bb38-43de-883a-59c70bdac80c None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:41.268912 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb38d9f-0edc-4c08-96f8-372a254ab5a5 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:41.281347 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8399a90-bb38-43de-883a-59c70bdac80c None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:41.309720 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3a616-588d-46a3-9df7-a737336e34f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:41.310702 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3a616-588d-46a3-9df7-a737336e34f1 None admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:41.311149 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:41.311266 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3a616-588d-46a3-9df7-a737336e34f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:41.311652 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3a616-588d-46a3-9df7-a737336e34f1 None admin] PATH_INFO: `/v3/projects/51f312b4cd8b449aa2971993f68de9af/users/f9bd815f8fe54d7d99e00a47212ad9ab/roles/c99e31de7c4c47c7b7b2c45c2771ca58` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:41.314790 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:41.322910 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3925aab-82f4-4de0-b123-20bdeaf4108a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:41.323523 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3925aab-82f4-4de0-b123-20bdeaf4108a None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:41.323800 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3925aab-82f4-4de0-b123-20bdeaf4108a None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:41.324066 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3925aab-82f4-4de0-b123-20bdeaf4108a None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:41.325576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3925aab-82f4-4de0-b123-20bdeaf4108a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:41.325880 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3925aab-82f4-4de0-b123-20bdeaf4108a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:41.327429 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3925aab-82f4-4de0-b123-20bdeaf4108a None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:41.331526 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c3a616-588d-46a3-9df7-a737336e34f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=51f312b4cd8b449aa2971993f68de9af, user_id=f9bd815f8fe54d7d99e00a47212ad9ab, role_id=c99e31de7c4c47c7b7b2c45c2771ca58)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:41.333236 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c3a616-588d-46a3-9df7-a737336e34f1 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:41.344997 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 301/604] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 30 15:46:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:41.344997 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3925aab-82f4-4de0-b123-20bdeaf4108a None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:41.356852 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 304/605] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 30 15:46:41 2022] PUT /identity/v3/projects/51f312b4cd8b449aa2971993f68de9af/users/f9bd815f8fe54d7d99e00a47212ad9ab/roles/c99e31de7c4c47c7b7b2c45c2771ca58 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:46:41.357907 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3a616-588d-46a3-9df7-a737336e34f1 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:41.526307 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3925aab-82f4-4de0-b123-20bdeaf4108a None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:41.528720 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3a616-588d-46a3-9df7-a737336e34f1 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:41.571178 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9818504-3991-43f1-bd1e-29e4f41c8a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:41.571844 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9818504-3991-43f1-bd1e-29e4f41c8a42 None admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:41.572118 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9818504-3991-43f1-bd1e-29e4f41c8a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:41.572383 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9818504-3991-43f1-bd1e-29e4f41c8a42 None admin] PATH_INFO: `/v3/projects/51f312b4cd8b449aa2971993f68de9af/users/130166ecc884456d94dbf6c6905168fc/roles/c99e31de7c4c47c7b7b2c45c2771ca58` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:41.581613 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c10ce-124e-43b8-ba21-ae555824e4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:41.582271 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c10ce-124e-43b8-ba21-ae555824e4b0 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:41.582553 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c10ce-124e-43b8-ba21-ae555824e4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:41.582830 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c10ce-124e-43b8-ba21-ae555824e4b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:41.592828 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c10ce-124e-43b8-ba21-ae555824e4b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:41.593363 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9818504-3991-43f1-bd1e-29e4f41c8a42 None admin] RBAC: Authorizing `identity:create_grant(project_id=51f312b4cd8b449aa2971993f68de9af, user_id=130166ecc884456d94dbf6c6905168fc, role_id=c99e31de7c4c47c7b7b2c45c2771ca58)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:41.594394 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c10ce-124e-43b8-ba21-ae555824e4b0 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:41.594860 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9818504-3991-43f1-bd1e-29e4f41c8a42 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:41.611548 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 305/606] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 30 15:46:41 2022] PUT /identity/v3/projects/51f312b4cd8b449aa2971993f68de9af/users/130166ecc884456d94dbf6c6905168fc/roles/c99e31de7c4c47c7b7b2c45c2771ca58 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:46:41.612262 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-fb2c10ce-124e-43b8-ba21-ae555824e4b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:46:41.612262 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:41.612262 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:41.612262 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:41.612262 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:41.612262 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:41.612262 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:41.612262 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:41.612262 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:41.612262 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:41.612262 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:41.612262 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:41.612262 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 15:46:41.612262 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 15:46:41.612262 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 15:46:41.613183 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 15:46:41.613183 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:41.613183 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:41.613183 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:41.613183 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:41.613183 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:41.613183 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:41.613183 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:41.613183 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:41.613183 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:41.613183 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:41.613183 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:41.613183 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:41.613183 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:41.613183 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:41.613183 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:41.613183 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:41.614051 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 15:46:41.614051 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 15:46:41.614051 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 15:46:41.614051 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 15:46:41.614051 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 15:46:41.614051 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 15:46:41.614051 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:46:41.614051 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:41.614469 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9818504-3991-43f1-bd1e-29e4f41c8a42 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:41.618367 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 302/607] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:46:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:41.619969 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c10ce-124e-43b8-ba21-ae555824e4b0 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:41.695291 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:41.723925 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:41.796956 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c10ce-124e-43b8-ba21-ae555824e4b0 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:41.839239 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9818504-3991-43f1-bd1e-29e4f41c8a42 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:41.843181 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465c30b-4129-4802-bb99-a13115eabd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:41.843855 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465c30b-4129-4802-bb99-a13115eabd92 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:41.844133 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465c30b-4129-4802-bb99-a13115eabd92 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:41.844404 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465c30b-4129-4802-bb99-a13115eabd92 None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:41.845133 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465c30b-4129-4802-bb99-a13115eabd92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:41.845439 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465c30b-4129-4802-bb99-a13115eabd92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:41.846945 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465c30b-4129-4802-bb99-a13115eabd92 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:41.860511 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 303/608] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 30 15:46:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:41.866155 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a1144-f2fe-4792-9a81-c433145113b2 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:41.866715 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a1144-f2fe-4792-9a81-c433145113b2 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:41.867073 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a1144-f2fe-4792-9a81-c433145113b2 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:41.868909 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 304/609] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:41.869684 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a1144-f2fe-4792-9a81-c433145113b2 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:41.886392 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abd4c6-4b5f-483a-ba90-81d45b92329a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:41.886597 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abd4c6-4b5f-483a-ba90-81d45b92329a None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:41.887226 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abd4c6-4b5f-483a-ba90-81d45b92329a None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:41.887548 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abd4c6-4b5f-483a-ba90-81d45b92329a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:41.902169 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23abd4c6-4b5f-483a-ba90-81d45b92329a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:41.908869 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-23abd4c6-4b5f-483a-ba90-81d45b92329a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 15:46:41.908869 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:41.908869 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:41.908869 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:41.908869 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:41.908869 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:41.908869 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:41.908869 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:41.908869 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:41.908869 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:41.908869 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:41.908869 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:41.908869 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:41.908869 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:41.908869 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:41.908869 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:41.909824 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:41.909824 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:41.909824 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:41.909824 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:41.909824 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:41.909824 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:41.909824 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:41.909824 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:41.909824 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:41.909824 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:41.909824 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:41.909824 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:41.909824 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:41.909824 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:41.909824 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:41.909824 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:41.910632 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:41.910632 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:41.910632 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:41.910632 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:41.910632 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:41.910632 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:41.910632 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:41.910632 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:41.910632 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:41.910632 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:41.910632 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 15:46:41.910632 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:41.910632 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 306/610] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 30 15:46:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:41.914027 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611173e-4dc4-49df-bbfd-df2a10a0fc58 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:41.914243 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611173e-4dc4-49df-bbfd-df2a10a0fc58 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:41.916798 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611173e-4dc4-49df-bbfd-df2a10a0fc58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:41.937262 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-3611173e-4dc4-49df-bbfd-df2a10a0fc58 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:41.938589 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-3611173e-4dc4-49df-bbfd-df2a10a0fc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:42.006615 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a1144-f2fe-4792-9a81-c433145113b2 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:42.019397 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:42.019616 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 307/611] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:46:42.025892 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611173e-4dc4-49df-bbfd-df2a10a0fc58 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:42.073997 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4910f1-73ea-40b6-aa30-22fdfc903c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:42.075897 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4910f1-73ea-40b6-aa30-22fdfc903c9a None admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:42.075897 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4910f1-73ea-40b6-aa30-22fdfc903c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:42.076282 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4910f1-73ea-40b6-aa30-22fdfc903c9a None admin] PATH_INFO: `/v3/projects/51f312b4cd8b449aa2971993f68de9af/users/48c49f6751d14526a0954797d9ab6a9a/roles/c99e31de7c4c47c7b7b2c45c2771ca58` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:42.078475 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:42.109613 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4910f1-73ea-40b6-aa30-22fdfc903c9a None admin] RBAC: Authorizing `identity:create_grant(project_id=51f312b4cd8b449aa2971993f68de9af, user_id=48c49f6751d14526a0954797d9ab6a9a, role_id=c99e31de7c4c47c7b7b2c45c2771ca58)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:42.114084 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4910f1-73ea-40b6-aa30-22fdfc903c9a None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:42.136857 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 305/612] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 30 15:46:41 2022] PUT /identity/v3/projects/51f312b4cd8b449aa2971993f68de9af/users/48c49f6751d14526a0954797d9ab6a9a/roles/c99e31de7c4c47c7b7b2c45c2771ca58 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:46:42.208201 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611173e-4dc4-49df-bbfd-df2a10a0fc58 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:42.246354 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efd5cd-2888-4368-bcf8-9971b9469d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:42.248340 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efd5cd-2888-4368-bcf8-9971b9469d67 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:42.248885 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efd5cd-2888-4368-bcf8-9971b9469d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:42.249355 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efd5cd-2888-4368-bcf8-9971b9469d67 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:42.250349 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96efd5cd-2888-4368-bcf8-9971b9469d67 None admin] RBAC: Adding query filter params (name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:42.250848 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96efd5cd-2888-4368-bcf8-9971b9469d67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:42.252516 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96efd5cd-2888-4368-bcf8-9971b9469d67 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:42.262299 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 308/613] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Aug 30 15:46:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:42.268875 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4910f1-73ea-40b6-aa30-22fdfc903c9a None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:42.397793 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4910f1-73ea-40b6-aa30-22fdfc903c9a None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:42.409312 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efd5cd-2888-4368-bcf8-9971b9469d67 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:42.437428 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f74bd1-c44f-4b83-8298-cbbe95d6b68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:42.438074 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f74bd1-c44f-4b83-8298-cbbe95d6b68c None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:42.438355 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f74bd1-c44f-4b83-8298-cbbe95d6b68c None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:42.438733 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f74bd1-c44f-4b83-8298-cbbe95d6b68c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:42.450595 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f74bd1-c44f-4b83-8298-cbbe95d6b68c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:42.452251 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f74bd1-c44f-4b83-8298-cbbe95d6b68c None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:42.469205 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-a4f74bd1-c44f-4b83-8298-cbbe95d6b68c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:42.469205 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:42.469205 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:42.469205 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:42.469205 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:42.469205 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:42.469205 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:42.469205 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:42.469205 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:42.469205 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:42.469205 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:42.469205 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:42.469205 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:42.469205 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:42.469205 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:42.469205 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:42.470170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:42.470170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:42.470170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:42.470170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:42.470170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:42.470170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:42.470170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:42.470170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:42.470170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:42.470170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:42.470170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:42.470170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:42.470170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:42.470170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:42.470170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:42.470170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:42.470170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:42.471033 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:42.471033 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:42.471033 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:42.473193 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 306/614] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:42.482208 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f74bd1-c44f-4b83-8298-cbbe95d6b68c None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:42.502266 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:42.520221 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:42.552814 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efd5cd-2888-4368-bcf8-9971b9469d67 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:42.613219 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7d63e-86bf-41b3-8594-d41f4f3a4331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:42.613888 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7d63e-86bf-41b3-8594-d41f4f3a4331 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:42.614163 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7d63e-86bf-41b3-8594-d41f4f3a4331 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:42.614431 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7d63e-86bf-41b3-8594-d41f4f3a4331 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:42.638540 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7d63e-86bf-41b3-8594-d41f4f3a4331 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:42.649430 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-37e7d63e-86bf-41b3-8594-d41f4f3a4331 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 15:46:42.649430 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:42.649430 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:42.649430 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:42.649430 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:42.649430 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:42.649430 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:42.649430 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:42.649430 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:42.649430 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:42.649430 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:42.649430 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:42.649430 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:42.649430 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:42.649430 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:42.649430 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:42.650368 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:42.650368 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:42.650368 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:42.650368 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:42.650368 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:42.650368 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:42.650368 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:42.650368 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:42.650368 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:42.650368 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:42.650368 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:42.650368 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:42.650368 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:42.650368 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:42.650368 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:42.650368 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:42.651189 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:42.651189 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:42.651189 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:42.651189 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:42.651189 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:42.651189 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:42.651189 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:42.651189 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:42.651189 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:42.651189 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:42.651189 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 15:46:42.651189 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:42.651819 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 309/615] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 30 15:46:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 15:46:42.665128 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7d63e-86bf-41b3-8594-d41f4f3a4331 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:42.670423 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f74bd1-c44f-4b83-8298-cbbe95d6b68c None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:42.716398 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f729250-802b-48e4-8efa-3979ec2fcc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:42.717036 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f729250-802b-48e4-8efa-3979ec2fcc76 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:42.717429 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f729250-802b-48e4-8efa-3979ec2fcc76 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:42.717698 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f729250-802b-48e4-8efa-3979ec2fcc76 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:42.718353 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f729250-802b-48e4-8efa-3979ec2fcc76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:42.718750 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f729250-802b-48e4-8efa-3979ec2fcc76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:42.720141 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f729250-802b-48e4-8efa-3979ec2fcc76 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:42.734448 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 307/616] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:46:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:42.739873 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f729250-802b-48e4-8efa-3979ec2fcc76 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:42.793162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7d63e-86bf-41b3-8594-d41f4f3a4331 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:42.818638 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:42.851316 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d5c640-a1de-4005-bbad-ac22ee37c719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:42.852259 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5c640-a1de-4005-bbad-ac22ee37c719 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:42.852714 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5c640-a1de-4005-bbad-ac22ee37c719 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:42.853179 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5c640-a1de-4005-bbad-ac22ee37c719 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:42.853542 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f729250-802b-48e4-8efa-3979ec2fcc76 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:42.854212 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d5c640-a1de-4005-bbad-ac22ee37c719 None admin] RBAC: Adding query filter params (name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:42.854700 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d5c640-a1de-4005-bbad-ac22ee37c719 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:42.857140 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d5c640-a1de-4005-bbad-ac22ee37c719 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:42.873082 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 310/617] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Aug 30 15:46:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:46:42.878946 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d5c640-a1de-4005-bbad-ac22ee37c719 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:42.890251 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de50f5-3484-4cf7-8d34-93c6435e80ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:42.896829 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de50f5-3484-4cf7-8d34-93c6435e80ea None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:42.896829 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de50f5-3484-4cf7-8d34-93c6435e80ea None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:42.896829 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de50f5-3484-4cf7-8d34-93c6435e80ea None admin] PATH_INFO: `/v3/users/nova` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:42.899235 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:42.900348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95de50f5-3484-4cf7-8d34-93c6435e80ea None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:42.902129 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95de50f5-3484-4cf7-8d34-93c6435e80ea None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:42.916473 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-95de50f5-3484-4cf7-8d34-93c6435e80ea None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 15:46:42.916473 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:42.916473 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:42.916473 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:42.916473 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:42.916473 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:42.916473 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:42.916473 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:42.916473 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:42.916473 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:42.916473 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:42.916473 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:42.916473 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 15:46:42.916473 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 15:46:42.916473 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 15:46:42.916473 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 15:46:42.917518 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:42.917518 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:42.917518 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 15:46:42.917518 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:46:42.917518 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 15:46:42.917518 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:46:42.917518 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:42.917518 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:42.917518 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:42.917518 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:42.917518 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:42.917518 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:42.917518 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:42.917518 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:42.917518 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:42.917518 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:42.917518 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:42.917518 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:42.919196 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:42.919196 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:42.919196 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 15:46:42.919196 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 15:46:42.919196 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 15:46:42.919196 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 15:46:42.919196 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 15:46:42.919196 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 15:46:42.919196 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 15:46:42.919196 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:42.921355 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 308/618] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Aug 30 15:46:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:42.927013 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de50f5-3484-4cf7-8d34-93c6435e80ea None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:43.045987 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de50f5-3484-4cf7-8d34-93c6435e80ea None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:43.078299 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:43.086490 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d2217-f731-4a63-b171-d683d9629ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:43.087302 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d2217-f731-4a63-b171-d683d9629ea8 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:43.087723 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d2217-f731-4a63-b171-d683d9629ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:43.088304 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d2217-f731-4a63-b171-d683d9629ea8 None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:43.090156 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93d2217-f731-4a63-b171-d683d9629ea8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:43.092715 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93d2217-f731-4a63-b171-d683d9629ea8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:43.095729 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93d2217-f731-4a63-b171-d683d9629ea8 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:43.110978 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d5c640-a1de-4005-bbad-ac22ee37c719 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:43.136332 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 309/619] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Aug 30 15:46:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:46:43.143312 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d2217-f731-4a63-b171-d683d9629ea8 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:43.217139 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce759e-c92d-4cdc-8c01-5e44427ca132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:43.217709 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce759e-c92d-4cdc-8c01-5e44427ca132 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:43.218318 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce759e-c92d-4cdc-8c01-5e44427ca132 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:43.218318 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce759e-c92d-4cdc-8c01-5e44427ca132 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:43.245657 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce759e-c92d-4cdc-8c01-5e44427ca132 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:43.247108 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce759e-c92d-4cdc-8c01-5e44427ca132 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:43.254344 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d2217-f731-4a63-b171-d683d9629ea8 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:43.282941 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-a6ce759e-c92d-4cdc-8c01-5e44427ca132 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:43.282941 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:43.282941 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:43.282941 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:43.282941 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:43.282941 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:43.282941 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:43.282941 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:43.282941 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:43.282941 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:43.282941 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:43.282941 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:43.282941 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:43.282941 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:43.282941 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:43.282941 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:43.284148 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:43.284148 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:43.284148 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:43.284148 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:43.284148 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:43.284148 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:43.284148 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:43.284148 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:43.284148 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:43.284148 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:43.284148 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:43.284148 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:43.284148 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:43.284148 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:43.284148 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:43.284148 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:43.284148 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:43.285257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:43.285257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:43.285257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:43.286096 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 311/620] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 15:46:43.292557 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce759e-c92d-4cdc-8c01-5e44427ca132 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:43.295386 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3e01c-e769-4749-8542-a74f676a41c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:43.296537 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3e01c-e769-4749-8542-a74f676a41c2 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:43.297057 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3e01c-e769-4749-8542-a74f676a41c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:43.297478 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3e01c-e769-4749-8542-a74f676a41c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:43.371851 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3e01c-e769-4749-8542-a74f676a41c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:43.373971 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3e01c-e769-4749-8542-a74f676a41c2 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:43.393342 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:43.436312 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:43.490873 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 310/621] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:46:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 15:46:43.498186 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3e01c-e769-4749-8542-a74f676a41c2 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:43.523645 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce759e-c92d-4cdc-8c01-5e44427ca132 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:43.597406 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866470af-cb68-4ae7-8b76-73405108c1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:43.598779 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866470af-cb68-4ae7-8b76-73405108c1a1 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:43.599200 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866470af-cb68-4ae7-8b76-73405108c1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:43.599612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866470af-cb68-4ae7-8b76-73405108c1a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:43.600407 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866470af-cb68-4ae7-8b76-73405108c1a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:43.600867 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866470af-cb68-4ae7-8b76-73405108c1a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:43.602364 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866470af-cb68-4ae7-8b76-73405108c1a1 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:43.633523 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 312/622] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:43.636217 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866470af-cb68-4ae7-8b76-73405108c1a1 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:43.673160 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:43.695471 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3e01c-e769-4749-8542-a74f676a41c2 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:43.731921 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb522c0e-922c-4acd-b628-7efee3e40a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:43.732561 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb522c0e-922c-4acd-b628-7efee3e40a57 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:43.732859 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb522c0e-922c-4acd-b628-7efee3e40a57 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:43.733129 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb522c0e-922c-4acd-b628-7efee3e40a57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:43.743509 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb522c0e-922c-4acd-b628-7efee3e40a57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:43.744970 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb522c0e-922c-4acd-b628-7efee3e40a57 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:43.760217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-bb522c0e-922c-4acd-b628-7efee3e40a57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:43.760217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:43.760217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:43.760217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:43.760217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:43.760217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:43.760217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:43.760217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:43.760217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:43.760217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:43.760217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:43.760217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:43.760217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:43.760217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:43.760217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:43.760217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:43.761217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:43.761217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:43.761217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:43.761217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:43.761217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:43.761217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:43.761217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:43.761217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:43.761217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:43.761217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:43.761217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:43.761217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:43.761217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:43.761217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:43.761217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:43.761217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:43.761217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:43.762127 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:43.762127 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:43.762127 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:43.762127 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 311/623] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:43.762899 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f467f-cf04-486e-aa4f-d3fa08d2bea2 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:43.768141 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f467f-cf04-486e-aa4f-d3fa08d2bea2 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:43.768420 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f467f-cf04-486e-aa4f-d3fa08d2bea2 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:43.770042 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 312/624] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:43.770755 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f467f-cf04-486e-aa4f-d3fa08d2bea2 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:43.774883 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866470af-cb68-4ae7-8b76-73405108c1a1 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:43.797230 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:43.812719 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcd848-ef5e-4313-947f-ecf5af7fb861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:43.813517 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcd848-ef5e-4313-947f-ecf5af7fb861 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:43.813891 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcd848-ef5e-4313-947f-ecf5af7fb861 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:43.814401 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcd848-ef5e-4313-947f-ecf5af7fb861 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:43.822217 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fcd848-ef5e-4313-947f-ecf5af7fb861 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:43.823769 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fcd848-ef5e-4313-947f-ecf5af7fb861 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:43.836504 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-12fcd848-ef5e-4313-947f-ecf5af7fb861 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 15:46:43.836504 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:43.836504 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:43.836504 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:43.836504 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:43.836504 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:43.836504 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:43.836504 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:43.836504 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:43.836504 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:43.836504 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:43.836504 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:43.836504 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 15:46:43.836504 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 15:46:43.836504 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 15:46:43.836504 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 15:46:43.837723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:43.837723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:43.837723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 15:46:43.837723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:46:43.837723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 15:46:43.837723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:46:43.837723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:43.837723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:43.837723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:43.837723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:43.837723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:43.837723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:43.837723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:43.837723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:43.837723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:43.837723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:43.837723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:43.837723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:43.839495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:43.839495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:43.839495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 15:46:43.839495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 15:46:43.839495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 15:46:43.839495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 15:46:43.839495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 15:46:43.839495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 15:46:43.839495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 15:46:43.839495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:43.840807 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 313/625] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 30 15:46:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:43.848807 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877567be-6821-4ed3-aa18-d23d51988dc8 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:43.848807 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877567be-6821-4ed3-aa18-d23d51988dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:43.848807 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877567be-6821-4ed3-aa18-d23d51988dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:43.860915 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-877567be-6821-4ed3-aa18-d23d51988dc8 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:43.862098 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-877567be-6821-4ed3-aa18-d23d51988dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:43.899417 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f467f-cf04-486e-aa4f-d3fa08d2bea2 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:43.935162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 314/626] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:46:43.936240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877567be-6821-4ed3-aa18-d23d51988dc8 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:43.956392 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af8468-956b-4490-87f1-db41ceeb6259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:43.957067 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af8468-956b-4490-87f1-db41ceeb6259 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:43.957346 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af8468-956b-4490-87f1-db41ceeb6259 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:43.957613 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af8468-956b-4490-87f1-db41ceeb6259 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:43.958267 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97af8468-956b-4490-87f1-db41ceeb6259 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:43.958568 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97af8468-956b-4490-87f1-db41ceeb6259 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:43.959942 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97af8468-956b-4490-87f1-db41ceeb6259 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:43.981251 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:43.986326 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 313/627] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:43.993201 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af8468-956b-4490-87f1-db41ceeb6259 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:44.053510 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877567be-6821-4ed3-aa18-d23d51988dc8 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:44.065187 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:44.092722 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a2274-dcc2-47ee-b248-86a5b22e3a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:44.093419 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a2274-dcc2-47ee-b248-86a5b22e3a0d None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:44.093748 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a2274-dcc2-47ee-b248-86a5b22e3a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:44.094019 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a2274-dcc2-47ee-b248-86a5b22e3a0d None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:44.094802 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a2274-dcc2-47ee-b248-86a5b22e3a0d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:44.095107 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a2274-dcc2-47ee-b248-86a5b22e3a0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:44.096530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a2274-dcc2-47ee-b248-86a5b22e3a0d None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:44.099172 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af8468-956b-4490-87f1-db41ceeb6259 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:44.114648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 315/628] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Aug 30 15:46:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:44.116267 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcbe1b-60f9-42a0-9bff-9c197d2db1a8 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:44.116553 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcbe1b-60f9-42a0-9bff-9c197d2db1a8 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:44.116841 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcbe1b-60f9-42a0-9bff-9c197d2db1a8 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:44.120822 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 316/629] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:44.120822 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcbe1b-60f9-42a0-9bff-9c197d2db1a8 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:44.141543 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea77fa9-3d3d-423f-946a-b87baf308b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:44.142303 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea77fa9-3d3d-423f-946a-b87baf308b01 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:44.142945 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea77fa9-3d3d-423f-946a-b87baf308b01 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:44.143320 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea77fa9-3d3d-423f-946a-b87baf308b01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:44.150672 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea77fa9-3d3d-423f-946a-b87baf308b01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:44.152357 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea77fa9-3d3d-423f-946a-b87baf308b01 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:44.164231 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-0ea77fa9-3d3d-423f-946a-b87baf308b01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:46:44.164231 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:44.164231 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:44.164231 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:44.164231 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:44.164231 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:44.164231 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:44.164231 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:44.164231 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:44.164231 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:44.164231 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:44.164231 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:44.164231 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 15:46:44.164231 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 15:46:44.164231 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 15:46:44.165369 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 15:46:44.165369 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:44.165369 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:44.165369 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:44.165369 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:44.165369 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:44.165369 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:44.165369 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:44.165369 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:44.165369 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:44.165369 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:44.165369 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:44.165369 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:44.165369 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:44.165369 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:44.165369 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:44.165369 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:44.166437 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 15:46:44.166437 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 15:46:44.166437 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 15:46:44.166437 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 15:46:44.166437 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 15:46:44.166437 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 15:46:44.166437 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:46:44.166437 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:44.172738 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 314/630] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:46:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 15:46:44.174254 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b6551-4009-43f1-bb88-acb8924d0317 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:44.174599 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b6551-4009-43f1-bb88-acb8924d0317 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:44.174967 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b6551-4009-43f1-bb88-acb8924d0317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:44.193985 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-cc9b6551-4009-43f1-bb88-acb8924d0317 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:44.195306 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-cc9b6551-4009-43f1-bb88-acb8924d0317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:44.233454 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcbe1b-60f9-42a0-9bff-9c197d2db1a8 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:44.259348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:44.273489 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 315/631] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:46:44.274368 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d956a9-807c-4062-9803-1df256f4735d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:44.274942 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b6551-4009-43f1-bb88-acb8924d0317 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:44.275082 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d956a9-807c-4062-9803-1df256f4735d None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:44.275271 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d956a9-807c-4062-9803-1df256f4735d None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:44.275539 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d956a9-807c-4062-9803-1df256f4735d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:44.289261 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d956a9-807c-4062-9803-1df256f4735d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:44.290976 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d956a9-807c-4062-9803-1df256f4735d None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:44.311296 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-f6d956a9-807c-4062-9803-1df256f4735d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:44.311296 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:44.311296 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:44.311296 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:44.311296 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:44.311296 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:44.311296 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:44.311296 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:44.311296 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:44.311296 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:44.311296 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:44.311296 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:44.311296 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:44.311296 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:44.311296 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:44.311296 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:44.312252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:44.312252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:44.312252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:44.312252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:44.312252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:44.312252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:44.312252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:44.312252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:44.312252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:44.312252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:44.312252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:44.312252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:44.312252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:44.312252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:44.312252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:44.312252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:44.312252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:44.313196 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:44.313196 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:44.313196 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:44.318502 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 317/632] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:44.318502 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d956a9-807c-4062-9803-1df256f4735d None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:44.341457 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:44.396215 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b6551-4009-43f1-bb88-acb8924d0317 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:44.432507 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef968911-237f-47d7-8ee2-05582476d3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:44.433209 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef968911-237f-47d7-8ee2-05582476d3bb None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:44.433616 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef968911-237f-47d7-8ee2-05582476d3bb None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:44.434417 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d956a9-807c-4062-9803-1df256f4735d None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:44.434539 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef968911-237f-47d7-8ee2-05582476d3bb None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:44.435141 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef968911-237f-47d7-8ee2-05582476d3bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:44.435444 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef968911-237f-47d7-8ee2-05582476d3bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:44.436959 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef968911-237f-47d7-8ee2-05582476d3bb None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:44.454234 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 316/633] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 30 15:46:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:44.454234 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef968911-237f-47d7-8ee2-05582476d3bb None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:44.477574 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0215cfc-3e05-4837-98cb-4283fba2bbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:44.478322 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0215cfc-3e05-4837-98cb-4283fba2bbe8 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:44.478602 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0215cfc-3e05-4837-98cb-4283fba2bbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:44.478873 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0215cfc-3e05-4837-98cb-4283fba2bbe8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:44.491423 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0215cfc-3e05-4837-98cb-4283fba2bbe8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:44.497946 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-a0215cfc-3e05-4837-98cb-4283fba2bbe8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 15:46:44.497946 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:44.497946 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:44.497946 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:44.497946 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:44.497946 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:44.497946 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:44.497946 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:44.497946 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:44.497946 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:44.497946 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:44.497946 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:44.497946 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:44.497946 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:44.497946 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:44.497946 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:44.499067 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:44.499067 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:44.499067 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:44.499067 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:44.499067 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:44.499067 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:44.499067 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:44.499067 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:44.499067 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:44.499067 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:44.499067 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:44.499067 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:44.499067 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:44.499067 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:44.499067 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:44.499067 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:44.500238 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:44.500238 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:44.500238 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:44.500238 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:44.500238 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:44.500238 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:44.500238 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:44.500238 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:44.500238 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:44.500238 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:44.500238 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 15:46:44.500238 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:44.500238 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 318/634] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 30 15:46:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:44.500976 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225ce9c-841f-4174-b773-17be2f6acd65 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:44.500976 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225ce9c-841f-4174-b773-17be2f6acd65 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:44.501107 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225ce9c-841f-4174-b773-17be2f6acd65 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:44.505072 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 319/635] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:44.506826 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225ce9c-841f-4174-b773-17be2f6acd65 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:44.510152 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:44.566578 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef968911-237f-47d7-8ee2-05582476d3bb None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:44.590370 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:44.599927 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeac7cc-f024-4340-9089-19b266618318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:44.600528 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeac7cc-f024-4340-9089-19b266618318 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:44.600821 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeac7cc-f024-4340-9089-19b266618318 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:44.601093 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeac7cc-f024-4340-9089-19b266618318 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:44.601731 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeac7cc-f024-4340-9089-19b266618318 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:44.602035 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeac7cc-f024-4340-9089-19b266618318 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:44.603392 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeac7cc-f024-4340-9089-19b266618318 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:44.610786 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225ce9c-841f-4174-b773-17be2f6acd65 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:44.615420 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 317/636] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:44.616245 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeac7cc-f024-4340-9089-19b266618318 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:44.644576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca52fb0-6298-4561-80ee-49cc6cba6383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:44.645227 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca52fb0-6298-4561-80ee-49cc6cba6383 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:44.645507 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca52fb0-6298-4561-80ee-49cc6cba6383 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:44.645779 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca52fb0-6298-4561-80ee-49cc6cba6383 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:44.646500 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca52fb0-6298-4561-80ee-49cc6cba6383 None admin] RBAC: Adding query filter params (role.id=c99e31de7c4c47c7b7b2c45c2771ca58, scope.project.id=51f312b4cd8b449aa2971993f68de9af, user.id=ebc80bf891614fb895af33ca1ded6b9d) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:44.646807 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca52fb0-6298-4561-80ee-49cc6cba6383 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:44.648240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca52fb0-6298-4561-80ee-49cc6cba6383 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:44.654135 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 320/637] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:46:44 2022] GET /identity/v3/role_assignments?user.id=ebc80bf891614fb895af33ca1ded6b9d&scope.project.id=51f312b4cd8b449aa2971993f68de9af&role.id=c99e31de7c4c47c7b7b2c45c2771ca58 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:44.655291 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc129a1-d4c1-4bc6-b10f-b6c28f15ac29 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:44.655577 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc129a1-d4c1-4bc6-b10f-b6c28f15ac29 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:44.655860 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc129a1-d4c1-4bc6-b10f-b6c28f15ac29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:44.675388 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-7cc129a1-d4c1-4bc6-b10f-b6c28f15ac29 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:44.676611 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7cc129a1-d4c1-4bc6-b10f-b6c28f15ac29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:44.750214 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeac7cc-f024-4340-9089-19b266618318 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:44.760828 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 321/638] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:46:44.760828 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc129a1-d4c1-4bc6-b10f-b6c28f15ac29 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:44.772013 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:44.813414 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299d25a-cc57-41bd-b621-c89cd386a38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:44.814031 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299d25a-cc57-41bd-b621-c89cd386a38d None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:44.814362 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299d25a-cc57-41bd-b621-c89cd386a38d None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:44.814642 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299d25a-cc57-41bd-b621-c89cd386a38d None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:44.815338 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0299d25a-cc57-41bd-b621-c89cd386a38d None admin] RBAC: Adding query filter params (name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:44.815640 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0299d25a-cc57-41bd-b621-c89cd386a38d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:44.817407 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0299d25a-cc57-41bd-b621-c89cd386a38d None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:44.825781 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 318/639] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Aug 30 15:46:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:44.826604 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299d25a-cc57-41bd-b621-c89cd386a38d None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:44.847900 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:44.876986 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc129a1-d4c1-4bc6-b10f-b6c28f15ac29 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:44.918634 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3464bce-660d-464d-b4ce-9e5ff635466a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:44.919891 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3464bce-660d-464d-b4ce-9e5ff635466a None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:44.920374 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3464bce-660d-464d-b4ce-9e5ff635466a None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:44.920867 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3464bce-660d-464d-b4ce-9e5ff635466a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:44.933302 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3464bce-660d-464d-b4ce-9e5ff635466a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:44.939764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-c3464bce-660d-464d-b4ce-9e5ff635466a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 15:46:44.939764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:44.939764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:44.939764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:44.939764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:44.939764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:44.939764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:44.939764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:44.939764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:44.939764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:44.939764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:44.939764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:44.939764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:44.939764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:44.939764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:44.939764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:44.940938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:44.940938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:44.940938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:44.940938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:44.940938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:44.940938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:44.940938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:44.940938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:44.940938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:44.940938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:44.940938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:44.940938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:44.940938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:44.940938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:44.940938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:44.940938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:44.941936 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:44.941936 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:44.941936 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:44.941936 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:44.941936 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:44.941936 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:44.941936 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:44.941936 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:44.941936 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:44.941936 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:44.941936 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 15:46:44.941936 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:44.941936 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 322/640] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 30 15:46:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:44.942758 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3464bce-660d-464d-b4ce-9e5ff635466a None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:44.955909 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299d25a-cc57-41bd-b621-c89cd386a38d None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:44.991217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf4703-fe47-476f-9900-c3a1b4ec80e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:44.992091 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf4703-fe47-476f-9900-c3a1b4ec80e9 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:44.992553 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf4703-fe47-476f-9900-c3a1b4ec80e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:44.993050 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf4703-fe47-476f-9900-c3a1b4ec80e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:45.000166 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf4703-fe47-476f-9900-c3a1b4ec80e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:45.001862 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf4703-fe47-476f-9900-c3a1b4ec80e9 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:45.013495 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-4ccf4703-fe47-476f-9900-c3a1b4ec80e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:46:45.013495 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:45.013495 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:45.013495 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:45.013495 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:45.013495 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:45.013495 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:45.013495 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:45.013495 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:45.013495 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:45.013495 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:45.013495 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:45.013495 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 15:46:45.013495 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 15:46:45.013495 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 15:46:45.014378 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 15:46:45.014378 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:45.014378 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:45.014378 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:45.014378 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:45.014378 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:45.014378 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:45.014378 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:45.014378 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:45.014378 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:45.014378 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:45.014378 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:45.014378 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:45.014378 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:45.014378 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:45.014378 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:45.014378 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:45.015218 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 15:46:45.015218 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 15:46:45.015218 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 15:46:45.015218 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 15:46:45.015218 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 15:46:45.015218 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 15:46:45.015218 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:46:45.015218 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:45.017953 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 319/641] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:46:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:45.018903 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf4703-fe47-476f-9900-c3a1b4ec80e9 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:45.051605 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:45.053123 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3464bce-660d-464d-b4ce-9e5ff635466a None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:45.088472 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad4bd1-8388-4922-abbc-7363c3f92069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:45.089114 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad4bd1-8388-4922-abbc-7363c3f92069 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:45.089345 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad4bd1-8388-4922-abbc-7363c3f92069 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:45.089685 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad4bd1-8388-4922-abbc-7363c3f92069 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:45.092405 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:45.102647 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad4bd1-8388-4922-abbc-7363c3f92069 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:45.104102 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad4bd1-8388-4922-abbc-7363c3f92069 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:45.119900 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-33ad4bd1-8388-4922-abbc-7363c3f92069 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:45.119900 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:45.119900 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:45.119900 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:45.119900 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:45.119900 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:45.119900 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:45.119900 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:45.119900 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:45.119900 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:45.119900 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:45.119900 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:45.119900 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:45.119900 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:45.119900 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:45.119900 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:45.121011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:45.121011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:45.121011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:45.121011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:45.121011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:45.121011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:45.121011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:45.121011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:45.121011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:45.121011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:45.121011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:45.121011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:45.121011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:45.121011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:45.121011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:45.121011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:45.121011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:45.121976 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:45.121976 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:45.121976 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:45.121976 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 323/642] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:45.121976 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad4bd1-8388-4922-abbc-7363c3f92069 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:45.137623 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf4703-fe47-476f-9900-c3a1b4ec80e9 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:45.176744 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e016df3-ef73-4bc7-80e6-1da76823a9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:45.177730 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e016df3-ef73-4bc7-80e6-1da76823a9c2 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:45.178072 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e016df3-ef73-4bc7-80e6-1da76823a9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:45.178415 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e016df3-ef73-4bc7-80e6-1da76823a9c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:45.179211 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e016df3-ef73-4bc7-80e6-1da76823a9c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:45.179831 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e016df3-ef73-4bc7-80e6-1da76823a9c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:45.181660 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e016df3-ef73-4bc7-80e6-1da76823a9c2 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:45.197260 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 320/643] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Aug 30 15:46:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:45.198134 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e016df3-ef73-4bc7-80e6-1da76823a9c2 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:45.226485 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad4bd1-8388-4922-abbc-7363c3f92069 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:45.265226 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc7253-434e-4220-bad3-664f9a78daa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:45.266172 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc7253-434e-4220-bad3-664f9a78daa0 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:45.266445 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc7253-434e-4220-bad3-664f9a78daa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:45.266721 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc7253-434e-4220-bad3-664f9a78daa0 None admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:45.267411 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc7253-434e-4220-bad3-664f9a78daa0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:45.267954 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc7253-434e-4220-bad3-664f9a78daa0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:45.269710 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc7253-434e-4220-bad3-664f9a78daa0 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:45.287202 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 324/644] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 30 15:46:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:45.287202 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc7253-434e-4220-bad3-664f9a78daa0 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:45.306259 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:45.316127 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e016df3-ef73-4bc7-80e6-1da76823a9c2 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:45.335099 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:45.352379 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515484c-280c-4b16-a23b-52941fc8634a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:45.352982 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515484c-280c-4b16-a23b-52941fc8634a None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:45.353264 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515484c-280c-4b16-a23b-52941fc8634a None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:45.353543 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515484c-280c-4b16-a23b-52941fc8634a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:45.366430 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515484c-280c-4b16-a23b-52941fc8634a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:45.373527 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-8515484c-280c-4b16-a23b-52941fc8634a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 15:46:45.373527 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:45.373527 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:45.373527 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:45.373527 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:45.373527 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:45.373527 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:45.373527 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:45.373527 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:45.373527 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:45.373527 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:45.373527 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:45.373527 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:45.373527 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:45.373527 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:45.373527 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:45.374409 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:45.374409 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:45.374409 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:45.374409 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:45.374409 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:45.374409 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:45.374409 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:45.374409 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:45.374409 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:45.374409 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:45.374409 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:45.374409 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:45.374409 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:45.374409 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:45.374409 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:45.374409 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:45.375360 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:45.375360 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:45.375360 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:45.375360 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:45.375360 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:45.375360 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:45.375360 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:45.375360 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:45.375360 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:45.375360 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:45.375360 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 15:46:45.375360 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:45.375360 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 321/645] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 30 15:46:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:45.375360 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515484c-280c-4b16-a23b-52941fc8634a None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:45.396437 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc7253-434e-4220-bad3-664f9a78daa0 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:45.434911 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0aadd-5a01-4044-aa5c-416f4ff1ed0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:45.435563 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0aadd-5a01-4044-aa5c-416f4ff1ed0b None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:45.435838 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0aadd-5a01-4044-aa5c-416f4ff1ed0b None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:45.436110 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0aadd-5a01-4044-aa5c-416f4ff1ed0b None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:45.436747 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e0aadd-5a01-4044-aa5c-416f4ff1ed0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:45.437068 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e0aadd-5a01-4044-aa5c-416f4ff1ed0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:45.438414 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e0aadd-5a01-4044-aa5c-416f4ff1ed0b None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:45.450469 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 325/646] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:45.451253 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0aadd-5a01-4044-aa5c-416f4ff1ed0b None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:45.482023 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515484c-280c-4b16-a23b-52941fc8634a None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:45.518033 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c01bd9-c246-42e0-add7-e8cc0984ab59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:45.518665 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c01bd9-c246-42e0-add7-e8cc0984ab59 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:45.518947 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c01bd9-c246-42e0-add7-e8cc0984ab59 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:45.519245 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c01bd9-c246-42e0-add7-e8cc0984ab59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:45.530901 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c01bd9-c246-42e0-add7-e8cc0984ab59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:45.532363 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c01bd9-c246-42e0-add7-e8cc0984ab59 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:45.547287 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-08c01bd9-c246-42e0-add7-e8cc0984ab59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:45.547287 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:45.547287 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:45.547287 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:45.547287 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:45.547287 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:45.547287 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:45.547287 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:45.547287 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:45.547287 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:45.547287 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:45.547287 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:45.547287 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:45.547287 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:45.547287 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:45.547287 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:45.548223 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:45.548223 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:45.548223 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:45.548223 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:45.548223 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:45.548223 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:45.548223 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:45.548223 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:45.548223 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:45.548223 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:45.548223 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:45.548223 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:45.548223 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:45.548223 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:45.548223 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:45.548223 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:45.548223 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:45.549380 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:45.549380 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:45.549380 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:45.549380 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 322/647] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:45.549380 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c01bd9-c246-42e0-add7-e8cc0984ab59 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:45.559975 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:45.569037 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0aadd-5a01-4044-aa5c-416f4ff1ed0b None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:45.576952 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:45.608177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564372d-a729-45d6-9e74-036e53ba77fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:45.608757 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564372d-a729-45d6-9e74-036e53ba77fb None admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:45.609061 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564372d-a729-45d6-9e74-036e53ba77fb None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:45.609331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564372d-a729-45d6-9e74-036e53ba77fb None admin] PATH_INFO: `/v3/projects/51f312b4cd8b449aa2971993f68de9af/users/94765f224c734beabe83b4dc0c5e511f/roles/c99e31de7c4c47c7b7b2c45c2771ca58` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:45.624449 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9564372d-a729-45d6-9e74-036e53ba77fb None admin] RBAC: Authorizing `identity:create_grant(project_id=51f312b4cd8b449aa2971993f68de9af, user_id=94765f224c734beabe83b4dc0c5e511f, role_id=c99e31de7c4c47c7b7b2c45c2771ca58)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:45.625925 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9564372d-a729-45d6-9e74-036e53ba77fb None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:45.648813 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 326/648] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 30 15:46:45 2022] PUT /identity/v3/projects/51f312b4cd8b449aa2971993f68de9af/users/94765f224c734beabe83b4dc0c5e511f/roles/c99e31de7c4c47c7b7b2c45c2771ca58 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:46:45.648813 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564372d-a729-45d6-9e74-036e53ba77fb None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:45.665892 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c01bd9-c246-42e0-add7-e8cc0984ab59 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:45.708627 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789ca92-945a-4d4c-9ece-2ac7f84533dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:45.709629 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789ca92-945a-4d4c-9ece-2ac7f84533dd None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:45.709995 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789ca92-945a-4d4c-9ece-2ac7f84533dd None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:45.710342 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789ca92-945a-4d4c-9ece-2ac7f84533dd None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:45.711171 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789ca92-945a-4d4c-9ece-2ac7f84533dd None admin] RBAC: Adding query filter params (name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:45.712161 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789ca92-945a-4d4c-9ece-2ac7f84533dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:45.713320 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789ca92-945a-4d4c-9ece-2ac7f84533dd None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:45.740475 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 323/649] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Aug 30 15:46:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:45.741816 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789ca92-945a-4d4c-9ece-2ac7f84533dd None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:45.795145 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564372d-a729-45d6-9e74-036e53ba77fb None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:45.827838 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:45.835455 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8042ec5-7e19-401a-a17e-b97f34b4599b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:45.836366 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8042ec5-7e19-401a-a17e-b97f34b4599b None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:45.836874 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8042ec5-7e19-401a-a17e-b97f34b4599b None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:45.837372 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8042ec5-7e19-401a-a17e-b97f34b4599b None admin] PATH_INFO: `/v3/users/glance` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:45.847855 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8042ec5-7e19-401a-a17e-b97f34b4599b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:45.849376 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8042ec5-7e19-401a-a17e-b97f34b4599b None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:45.862780 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-b8042ec5-7e19-401a-a17e-b97f34b4599b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 15:46:45.862780 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:45.862780 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:45.862780 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:45.862780 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:45.862780 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:45.862780 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:45.862780 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:45.862780 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:45.862780 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:45.862780 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:45.862780 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:45.862780 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 15:46:45.862780 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 15:46:45.862780 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 15:46:45.862780 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 15:46:45.863701 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:45.863701 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:45.863701 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 15:46:45.863701 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:46:45.863701 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 15:46:45.863701 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:46:45.863701 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:45.863701 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:45.863701 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:45.863701 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:45.863701 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:45.863701 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:45.863701 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:45.863701 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:45.863701 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:45.863701 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:45.863701 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:45.863701 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:45.864606 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:45.864606 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:45.864606 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 15:46:45.864606 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 15:46:45.864606 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 15:46:45.864606 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 15:46:45.864606 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 15:46:45.864606 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 15:46:45.864606 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 15:46:45.864606 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:45.864606 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 327/650] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:46:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:45.865227 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8042ec5-7e19-401a-a17e-b97f34b4599b None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:45.879947 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789ca92-945a-4d4c-9ece-2ac7f84533dd None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:45.894880 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:45.922767 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94ec11-e84f-4eda-9036-80850524fd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:45.923794 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94ec11-e84f-4eda-9036-80850524fd08 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:45.924302 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94ec11-e84f-4eda-9036-80850524fd08 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:45.924754 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94ec11-e84f-4eda-9036-80850524fd08 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:45.925549 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94ec11-e84f-4eda-9036-80850524fd08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:45.925848 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94ec11-e84f-4eda-9036-80850524fd08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:45.927404 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94ec11-e84f-4eda-9036-80850524fd08 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:45.940200 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 324/651] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:45.941129 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94ec11-e84f-4eda-9036-80850524fd08 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:46.002318 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8042ec5-7e19-401a-a17e-b97f34b4599b None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:46.040289 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d4eb8-a0ad-4be5-b9dc-8b00bdd8d994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:46.040985 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d4eb8-a0ad-4be5-b9dc-8b00bdd8d994 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:46.041259 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d4eb8-a0ad-4be5-b9dc-8b00bdd8d994 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:46.041528 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d4eb8-a0ad-4be5-b9dc-8b00bdd8d994 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:46.056588 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d4eb8-a0ad-4be5-b9dc-8b00bdd8d994 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:46.059190 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d4eb8-a0ad-4be5-b9dc-8b00bdd8d994 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:46.070889 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94ec11-e84f-4eda-9036-80850524fd08 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:46.073983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-dc4d4eb8-a0ad-4be5-b9dc-8b00bdd8d994 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:46.073983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:46.073983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:46.073983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:46.073983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:46.073983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:46.073983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:46.073983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:46.073983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:46.073983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:46.073983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:46.073983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:46.073983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:46.073983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:46.073983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:46.073983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:46.075579 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:46.075579 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:46.075579 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:46.075579 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:46.075579 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:46.075579 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:46.075579 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:46.075579 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:46.075579 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:46.075579 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:46.075579 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:46.075579 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:46.075579 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:46.075579 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:46.075579 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:46.075579 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:46.075579 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:46.076565 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:46.076565 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:46.076565 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:46.080834 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 328/652] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:46.082201 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d4eb8-a0ad-4be5-b9dc-8b00bdd8d994 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:46.110902 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:46.123264 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aefd718-4533-498f-86ad-7b752779f132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:46.124132 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefd718-4533-498f-86ad-7b752779f132 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:46.124597 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefd718-4533-498f-86ad-7b752779f132 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:46.125082 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefd718-4533-498f-86ad-7b752779f132 None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:46.126566 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aefd718-4533-498f-86ad-7b752779f132 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:46.127063 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aefd718-4533-498f-86ad-7b752779f132 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:46.129202 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aefd718-4533-498f-86ad-7b752779f132 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:46.159284 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 325/653] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Aug 30 15:46:45 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:46.159738 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:46.160052 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aefd718-4533-498f-86ad-7b752779f132 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:46.196184 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d4eb8-a0ad-4be5-b9dc-8b00bdd8d994 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:46.233222 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847ee60-481a-4e35-abf8-9ff9facf0765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:46.233864 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847ee60-481a-4e35-abf8-9ff9facf0765 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:46.234159 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847ee60-481a-4e35-abf8-9ff9facf0765 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:46.234417 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847ee60-481a-4e35-abf8-9ff9facf0765 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:46.242549 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a847ee60-481a-4e35-abf8-9ff9facf0765 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:46.243999 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a847ee60-481a-4e35-abf8-9ff9facf0765 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:46.255722 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-a847ee60-481a-4e35-abf8-9ff9facf0765 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 15:46:46.255722 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:46.255722 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:46.255722 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:46.255722 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:46.255722 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:46.255722 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:46.255722 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:46.255722 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:46.255722 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:46.255722 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:46.255722 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:46.255722 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 15:46:46.255722 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 15:46:46.255722 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 15:46:46.255722 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 15:46:46.256679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:46.256679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:46.256679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 15:46:46.256679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:46:46.256679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 15:46:46.256679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:46:46.256679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:46.256679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:46.256679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:46.256679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:46.256679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:46.256679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:46.256679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:46.256679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:46.256679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:46.256679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:46.256679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:46.256679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:46.257656 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:46.257656 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:46.257656 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 15:46:46.257656 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 15:46:46.257656 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 15:46:46.257656 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 15:46:46.257656 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 15:46:46.257656 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 15:46:46.257656 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 15:46:46.257656 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:46.261540 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 329/654] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:46:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:46.263392 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847ee60-481a-4e35-abf8-9ff9facf0765 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:46.276643 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aefd718-4533-498f-86ad-7b752779f132 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:46.316759 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe7b836-8d49-4672-8389-83b9d9fc351b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:46.317752 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7b836-8d49-4672-8389-83b9d9fc351b None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:46.318298 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7b836-8d49-4672-8389-83b9d9fc351b None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:46.318760 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7b836-8d49-4672-8389-83b9d9fc351b None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:46.319751 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe7b836-8d49-4672-8389-83b9d9fc351b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:46.320246 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe7b836-8d49-4672-8389-83b9d9fc351b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:46.321920 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe7b836-8d49-4672-8389-83b9d9fc351b None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:46.335376 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 326/655] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:46:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:46.336708 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe7b836-8d49-4672-8389-83b9d9fc351b None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:46.369678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847ee60-481a-4e35-abf8-9ff9facf0765 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:46.390675 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:46.397685 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:46.407358 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b22e8-c0f2-4bea-bebd-174f33b27908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:46.407984 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b22e8-c0f2-4bea-bebd-174f33b27908 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:46.408266 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b22e8-c0f2-4bea-bebd-174f33b27908 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:46.408538 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b22e8-c0f2-4bea-bebd-174f33b27908 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:46.456408 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe7b836-8d49-4672-8389-83b9d9fc351b None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:46.479576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b22e8-c0f2-4bea-bebd-174f33b27908 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:46.481732 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b22e8-c0f2-4bea-bebd-174f33b27908 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:46.495482 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408da22e-9652-415b-a059-d8bafc01cf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:46.496566 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408da22e-9652-415b-a059-d8bafc01cf9e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:46.497217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408da22e-9652-415b-a059-d8bafc01cf9e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:46.497748 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408da22e-9652-415b-a059-d8bafc01cf9e None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:46.498703 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408da22e-9652-415b-a059-d8bafc01cf9e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:46.499211 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408da22e-9652-415b-a059-d8bafc01cf9e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:46.501101 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408da22e-9652-415b-a059-d8bafc01cf9e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:46.520932 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 327/656] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Aug 30 15:46:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:46.522138 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408da22e-9652-415b-a059-d8bafc01cf9e None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:46.595110 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 330/657] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:46:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 15:46:46.595110 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b22e8-c0f2-4bea-bebd-174f33b27908 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:46.628074 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:46.649147 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408da22e-9652-415b-a059-d8bafc01cf9e None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:46.653447 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:46.699009 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5552a5-8dbd-49c5-ac91-d3b75e65dcfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:46.700925 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5552a5-8dbd-49c5-ac91-d3b75e65dcfa None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:46.701875 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5552a5-8dbd-49c5-ac91-d3b75e65dcfa None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:46.702370 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5552a5-8dbd-49c5-ac91-d3b75e65dcfa None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:46.711349 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5552a5-8dbd-49c5-ac91-d3b75e65dcfa None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:46.712636 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5552a5-8dbd-49c5-ac91-d3b75e65dcfa None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:46.721910 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b22e8-c0f2-4bea-bebd-174f33b27908 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:46.731938 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-ca5552a5-8dbd-49c5-ac91-d3b75e65dcfa None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 15:46:46.731938 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:46.731938 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:46.731938 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:46.731938 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:46.731938 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:46.731938 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:46.731938 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:46.731938 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:46.731938 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:46.731938 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:46.731938 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:46.731938 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 15:46:46.731938 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 15:46:46.731938 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 15:46:46.731938 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 15:46:46.732937 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:46.732937 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:46.732937 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 15:46:46.732937 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:46:46.732937 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 15:46:46.732937 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:46:46.732937 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:46.732937 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:46.732937 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:46.732937 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:46.732937 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:46.732937 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:46.732937 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:46.732937 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:46.732937 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:46.732937 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:46.732937 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:46.732937 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:46.733890 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:46.733890 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:46.733890 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 15:46:46.733890 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 15:46:46.733890 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 15:46:46.733890 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 15:46:46.733890 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 15:46:46.733890 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 15:46:46.733890 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 15:46:46.733890 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:46.733890 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 328/658] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 30 15:46:46 2022] GET /identity/v3/users/neutron => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:46.734498 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5552a5-8dbd-49c5-ac91-d3b75e65dcfa None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:46.765850 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a3b29-0f86-4429-b514-4017c6265921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:46.766477 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a3b29-0f86-4429-b514-4017c6265921 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:46.766757 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a3b29-0f86-4429-b514-4017c6265921 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:46.767028 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a3b29-0f86-4429-b514-4017c6265921 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:46.839257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a3b29-0f86-4429-b514-4017c6265921 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:46.841713 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a3b29-0f86-4429-b514-4017c6265921 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:46.842151 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5552a5-8dbd-49c5-ac91-d3b75e65dcfa None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:46.869824 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:46.877613 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c395a-1667-4028-82b9-be86dea87f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:46.878239 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c395a-1667-4028-82b9-be86dea87f4b None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:46.878522 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c395a-1667-4028-82b9-be86dea87f4b None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:46.878794 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c395a-1667-4028-82b9-be86dea87f4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:46.890430 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c395a-1667-4028-82b9-be86dea87f4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:46.891905 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c395a-1667-4028-82b9-be86dea87f4b None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:46.907103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-db6c395a-1667-4028-82b9-be86dea87f4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:46.907103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:46.907103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:46.907103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:46.907103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:46.907103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:46.907103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:46.907103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:46.907103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:46.907103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:46.907103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:46.907103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:46.907103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:46.907103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:46.907103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:46.907103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:46.908185 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:46.908185 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:46.908185 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:46.908185 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:46.908185 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:46.908185 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:46.908185 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:46.908185 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:46.908185 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:46.908185 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:46.908185 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:46.908185 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:46.908185 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:46.908185 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:46.908185 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:46.908185 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:46.908185 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:46.909319 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:46.909319 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:46.909319 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:46.909319 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 329/659] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:46.909654 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90188634-8405-4af8-91b3-c2d845d7b4ca None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:46.909935 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90188634-8405-4af8-91b3-c2d845d7b4ca None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:46.910204 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90188634-8405-4af8-91b3-c2d845d7b4ca None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:46.915549 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 330/660] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:46.915549 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90188634-8405-4af8-91b3-c2d845d7b4ca None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:46.930860 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:46.961205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 331/661] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:46:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 15:46:46.962042 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a3b29-0f86-4429-b514-4017c6265921 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:47.026206 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90188634-8405-4af8-91b3-c2d845d7b4ca None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:47.062728 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0823df-0d3e-4d43-9ed8-1dea5a4dbe38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:47.063589 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0823df-0d3e-4d43-9ed8-1dea5a4dbe38 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:47.064029 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0823df-0d3e-4d43-9ed8-1dea5a4dbe38 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:47.064298 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0823df-0d3e-4d43-9ed8-1dea5a4dbe38 None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:47.065062 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0823df-0d3e-4d43-9ed8-1dea5a4dbe38 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:47.065364 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0823df-0d3e-4d43-9ed8-1dea5a4dbe38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:47.066809 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0823df-0d3e-4d43-9ed8-1dea5a4dbe38 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:47.069938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a3b29-0f86-4429-b514-4017c6265921 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:47.091858 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 331/662] 10.222.0.25 () {56 vars in 1139 bytes} [Tue Aug 30 15:46:46 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:47.093314 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6644a77-2f78-42dc-9148-19cc271041af None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:47.093603 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6644a77-2f78-42dc-9148-19cc271041af None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:47.093879 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6644a77-2f78-42dc-9148-19cc271041af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:47.100684 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:47.108963 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff54407-e506-447f-a680-4926aa46a490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:47.109682 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff54407-e506-447f-a680-4926aa46a490 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:47.110303 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff54407-e506-447f-a680-4926aa46a490 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:47.110699 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff54407-e506-447f-a680-4926aa46a490 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:47.111406 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff54407-e506-447f-a680-4926aa46a490 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:47.111773 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff54407-e506-447f-a680-4926aa46a490 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:47.113245 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff54407-e506-447f-a680-4926aa46a490 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:47.113559 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-d6644a77-2f78-42dc-9148-19cc271041af None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:47.114829 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-d6644a77-2f78-42dc-9148-19cc271041af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:47.130620 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 332/663] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:46:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:47.131500 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff54407-e506-447f-a680-4926aa46a490 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:47.192492 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 332/664] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:46:47.193590 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6644a77-2f78-42dc-9148-19cc271041af None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:47.196679 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:47.262489 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff54407-e506-447f-a680-4926aa46a490 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:47.306301 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b8c1b-e0ab-4292-84e4-d87f2ab8a5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:47.307046 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b8c1b-e0ab-4292-84e4-d87f2ab8a5c6 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:47.307334 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b8c1b-e0ab-4292-84e4-d87f2ab8a5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:47.307609 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b8c1b-e0ab-4292-84e4-d87f2ab8a5c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:47.312223 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6644a77-2f78-42dc-9148-19cc271041af None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:47.319469 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b8c1b-e0ab-4292-84e4-d87f2ab8a5c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:47.320982 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b8c1b-e0ab-4292-84e4-d87f2ab8a5c6 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:47.337618 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-b36b8c1b-e0ab-4292-84e4-d87f2ab8a5c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:47.337618 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:47.337618 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:47.337618 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:47.337618 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:47.337618 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:47.337618 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:47.337618 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:47.337618 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:47.337618 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:47.337618 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:47.337618 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:47.337618 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:47.337618 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:47.337618 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:47.337618 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:47.338602 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:47.338602 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:47.338602 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:47.338602 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:47.338602 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:47.338602 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:47.338602 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:47.338602 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:47.338602 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:47.338602 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:47.338602 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:47.338602 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:47.338602 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:47.338602 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:47.338602 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:47.338602 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:47.338602 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:47.340604 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:47.340604 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:47.340604 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:47.340604 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 333/665] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:47.340604 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b8c1b-e0ab-4292-84e4-d87f2ab8a5c6 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:47.359881 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5dcf3f-1d73-483a-97d2-57e87f6dec34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:47.360629 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5dcf3f-1d73-483a-97d2-57e87f6dec34 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:47.360981 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5dcf3f-1d73-483a-97d2-57e87f6dec34 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:47.361303 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5dcf3f-1d73-483a-97d2-57e87f6dec34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:47.393854 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:47.445640 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5dcf3f-1d73-483a-97d2-57e87f6dec34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:47.447025 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5dcf3f-1d73-483a-97d2-57e87f6dec34 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:47.450572 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:47.475197 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b8c1b-e0ab-4292-84e4-d87f2ab8a5c6 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:47.511507 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f86d97-ed68-4b3d-95bb-0766d42911a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:47.512961 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f86d97-ed68-4b3d-95bb-0766d42911a3 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:47.513246 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f86d97-ed68-4b3d-95bb-0766d42911a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:47.513753 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f86d97-ed68-4b3d-95bb-0766d42911a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:47.520776 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f86d97-ed68-4b3d-95bb-0766d42911a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:47.522694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f86d97-ed68-4b3d-95bb-0766d42911a3 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:47.534530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-24f86d97-ed68-4b3d-95bb-0766d42911a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:46:47.534530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:47.534530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:47.534530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:47.534530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:47.534530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:47.534530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:47.534530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:47.534530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:47.534530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:47.534530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:47.534530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:47.534530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 15:46:47.534530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 15:46:47.534530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 15:46:47.535427 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 15:46:47.535427 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:47.535427 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:47.535427 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:47.535427 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:47.535427 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:47.535427 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:47.535427 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:47.535427 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:47.535427 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:47.535427 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:47.535427 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:47.535427 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:47.535427 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:47.535427 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:47.535427 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:47.535427 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:47.536318 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 15:46:47.536318 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 15:46:47.536318 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 15:46:47.536318 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 15:46:47.536318 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 15:46:47.536318 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 15:46:47.536318 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:46:47.536318 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:47.536318 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 334/666] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:46:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:47.537424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f86d97-ed68-4b3d-95bb-0766d42911a3 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:47.559305 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 333/667] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:46:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 15:46:47.560547 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5dcf3f-1d73-483a-97d2-57e87f6dec34 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:47.644549 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:47.647566 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f86d97-ed68-4b3d-95bb-0766d42911a3 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:47.667418 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5dcf3f-1d73-483a-97d2-57e87f6dec34 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:47.669834 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:47.683345 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759efb47-5b99-4d6f-a1af-e7f978f4d20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:47.684233 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759efb47-5b99-4d6f-a1af-e7f978f4d20d None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:47.684534 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759efb47-5b99-4d6f-a1af-e7f978f4d20d None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:47.684836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759efb47-5b99-4d6f-a1af-e7f978f4d20d None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:47.685488 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759efb47-5b99-4d6f-a1af-e7f978f4d20d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:47.685793 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759efb47-5b99-4d6f-a1af-e7f978f4d20d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:47.687160 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759efb47-5b99-4d6f-a1af-e7f978f4d20d None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:47.698851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 335/668] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:47.700118 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759efb47-5b99-4d6f-a1af-e7f978f4d20d None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:47.704334 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548b890-1930-4a2c-a642-c4d749c52b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:47.704933 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548b890-1930-4a2c-a642-c4d749c52b78 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:47.705217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548b890-1930-4a2c-a642-c4d749c52b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:47.705483 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548b890-1930-4a2c-a642-c4d749c52b78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:47.716280 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d548b890-1930-4a2c-a642-c4d749c52b78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:47.721159 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-d548b890-1930-4a2c-a642-c4d749c52b78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:46:47.721159 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:47.721159 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:47.721159 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:47.721159 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:47.721159 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:47.721159 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:47.721159 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:47.721159 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:47.721159 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:47.721159 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:47.721159 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:47.721159 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:47.721159 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:47.721159 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:47.721159 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:47.722108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:47.722108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:47.722108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:47.722108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:47.722108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:47.722108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:47.722108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:47.722108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:47.722108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:47.722108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:47.722108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:47.722108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:47.722108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:47.722108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:47.722108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:47.722108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:47.723034 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:47.723034 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:47.723034 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:47.723034 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:47.723034 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:47.723034 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:47.723034 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:47.723034 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:47.723034 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:47.723034 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:47.723034 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:46:47.723034 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:47.723034 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 334/669] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 30 15:46:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:47.723034 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548b890-1930-4a2c-a642-c4d749c52b78 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:47.804860 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759efb47-5b99-4d6f-a1af-e7f978f4d20d None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:47.823020 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548b890-1930-4a2c-a642-c4d749c52b78 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:47.838736 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c349ebb9-2d2d-4743-bbf4-1945701b28c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:47.839342 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349ebb9-2d2d-4743-bbf4-1945701b28c6 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:47.839618 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349ebb9-2d2d-4743-bbf4-1945701b28c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:47.839918 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349ebb9-2d2d-4743-bbf4-1945701b28c6 None admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:47.840599 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c349ebb9-2d2d-4743-bbf4-1945701b28c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:47.840926 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c349ebb9-2d2d-4743-bbf4-1945701b28c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:47.842342 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c349ebb9-2d2d-4743-bbf4-1945701b28c6 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:47.853342 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 336/670] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 30 15:46:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:47.854476 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f980b4-2db1-4680-b1fd-c449d352fd13 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:47.854751 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f980b4-2db1-4680-b1fd-c449d352fd13 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:47.855018 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f980b4-2db1-4680-b1fd-c449d352fd13 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:47.856398 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 337/671] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:47.857104 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f980b4-2db1-4680-b1fd-c449d352fd13 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:47.863375 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e745d2-ac1a-4a7a-b005-5ef5ce53bb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:47.864011 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e745d2-ac1a-4a7a-b005-5ef5ce53bb29 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:47.864292 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e745d2-ac1a-4a7a-b005-5ef5ce53bb29 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:47.864566 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e745d2-ac1a-4a7a-b005-5ef5ce53bb29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:47.875607 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e745d2-ac1a-4a7a-b005-5ef5ce53bb29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:47.877162 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e745d2-ac1a-4a7a-b005-5ef5ce53bb29 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:47.879948 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:47.892136 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-a5e745d2-ac1a-4a7a-b005-5ef5ce53bb29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:47.892136 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:47.892136 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:47.892136 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:47.892136 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:47.892136 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:47.892136 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:47.892136 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:47.892136 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:47.892136 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:47.892136 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:47.892136 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:47.892136 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:47.892136 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:47.892136 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:47.892136 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:47.893580 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:47.893580 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:47.893580 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:47.893580 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:47.893580 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:47.893580 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:47.893580 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:47.893580 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:47.893580 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:47.893580 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:47.893580 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:47.893580 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:47.893580 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:47.893580 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:47.893580 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:47.893580 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:47.893580 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:47.894474 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:47.894474 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:47.894474 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:47.894474 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 335/672] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:47.894695 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e745d2-ac1a-4a7a-b005-5ef5ce53bb29 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:47.911575 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:47.961217 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f980b4-2db1-4680-b1fd-c449d352fd13 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:47.991865 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e745d2-ac1a-4a7a-b005-5ef5ce53bb29 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:47.993675 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf72721-d05c-4c91-a91a-a4bb6132c7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:47.994306 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf72721-d05c-4c91-a91a-a4bb6132c7cd None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:47.994585 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf72721-d05c-4c91-a91a-a4bb6132c7cd None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:47.994855 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf72721-d05c-4c91-a91a-a4bb6132c7cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:48.001963 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf72721-d05c-4c91-a91a-a4bb6132c7cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:48.003435 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf72721-d05c-4c91-a91a-a4bb6132c7cd None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:48.015146 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-bdf72721-d05c-4c91-a91a-a4bb6132c7cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:46:48.015146 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:48.015146 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:48.015146 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:48.015146 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:48.015146 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:48.015146 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:48.015146 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:48.015146 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:48.015146 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:48.015146 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:48.015146 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:48.015146 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 15:46:48.015146 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 15:46:48.015146 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 15:46:48.016208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 15:46:48.016208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:48.016208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:48.016208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:48.016208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:48.016208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:48.016208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:48.016208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:48.016208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:48.016208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:48.016208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:48.016208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:48.016208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:48.016208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:48.016208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:48.016208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:48.016208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:48.017195 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 15:46:48.017195 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 15:46:48.017195 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 15:46:48.017195 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 15:46:48.017195 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 15:46:48.017195 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 15:46:48.017195 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:46:48.017195 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:48.017195 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 338/673] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:46:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:48.017195 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf72721-d05c-4c91-a91a-a4bb6132c7cd None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:48.032102 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd652ea-6708-452a-8552-9637bedd3a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:48.032716 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd652ea-6708-452a-8552-9637bedd3a2c None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:48.033026 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd652ea-6708-452a-8552-9637bedd3a2c None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:48.033326 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd652ea-6708-452a-8552-9637bedd3a2c None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:48.033996 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd652ea-6708-452a-8552-9637bedd3a2c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:48.034294 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd652ea-6708-452a-8552-9637bedd3a2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:48.035650 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd652ea-6708-452a-8552-9637bedd3a2c None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:48.044172 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 336/674] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:46:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:48.045354 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb0ae1-0d67-42c0-838b-d06f7260528e None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:48.045639 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb0ae1-0d67-42c0-838b-d06f7260528e None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:48.045915 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb0ae1-0d67-42c0-838b-d06f7260528e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:48.063833 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-30bb0ae1-0d67-42c0-838b-d06f7260528e None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:48.065043 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-30bb0ae1-0d67-42c0-838b-d06f7260528e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:48.103779 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:48.125890 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf72721-d05c-4c91-a91a-a4bb6132c7cd None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:48.132482 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 337/675] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:46:48.133424 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb0ae1-0d67-42c0-838b-d06f7260528e None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:48.143937 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:48.167733 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0326f-c73a-4316-8bcb-4764d235848e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:48.168857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0326f-c73a-4316-8bcb-4764d235848e None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:48.169306 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0326f-c73a-4316-8bcb-4764d235848e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:48.169744 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0326f-c73a-4316-8bcb-4764d235848e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:48.170508 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa0326f-c73a-4316-8bcb-4764d235848e None admin] RBAC: Adding query filter params (role.id=c99e31de7c4c47c7b7b2c45c2771ca58, scope.project.id=51f312b4cd8b449aa2971993f68de9af, user.id=f9bd815f8fe54d7d99e00a47212ad9ab) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:48.170815 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa0326f-c73a-4316-8bcb-4764d235848e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:48.172239 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa0326f-c73a-4316-8bcb-4764d235848e None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:48.178199 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 339/676] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:46:48 2022] GET /identity/v3/role_assignments?user.id=f9bd815f8fe54d7d99e00a47212ad9ab&scope.project.id=51f312b4cd8b449aa2971993f68de9af&role.id=c99e31de7c4c47c7b7b2c45c2771ca58 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:48.178922 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0326f-c73a-4316-8bcb-4764d235848e None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:48.258075 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb0ae1-0d67-42c0-838b-d06f7260528e None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:48.294457 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0326f-c73a-4316-8bcb-4764d235848e None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:48.298764 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107b5fc-ed77-4880-b8d3-3a04ff384afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:48.299716 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107b5fc-ed77-4880-b8d3-3a04ff384afe None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:48.300208 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107b5fc-ed77-4880-b8d3-3a04ff384afe None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:48.300677 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107b5fc-ed77-4880-b8d3-3a04ff384afe None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:48.301669 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107b5fc-ed77-4880-b8d3-3a04ff384afe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:48.302177 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107b5fc-ed77-4880-b8d3-3a04ff384afe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:48.303874 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107b5fc-ed77-4880-b8d3-3a04ff384afe None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:48.318337 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 338/677] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:46:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:48.319638 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107b5fc-ed77-4880-b8d3-3a04ff384afe None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:48.334930 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5ece0-6c7d-41b8-9eb3-eb836c7304e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:48.335550 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5ece0-6c7d-41b8-9eb3-eb836c7304e5 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:48.335826 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5ece0-6c7d-41b8-9eb3-eb836c7304e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:48.336100 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5ece0-6c7d-41b8-9eb3-eb836c7304e5 None admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:48.336892 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5ece0-6c7d-41b8-9eb3-eb836c7304e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:48.337196 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5ece0-6c7d-41b8-9eb3-eb836c7304e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:48.338690 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5ece0-6c7d-41b8-9eb3-eb836c7304e5 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:48.358535 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 340/678] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 30 15:46:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:48.359208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5ece0-6c7d-41b8-9eb3-eb836c7304e5 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:48.363585 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:48.414540 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:48.454034 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107b5fc-ed77-4880-b8d3-3a04ff384afe None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:48.477901 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5ece0-6c7d-41b8-9eb3-eb836c7304e5 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:48.492211 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8e256-dca2-4968-b498-fe082f11205a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:48.492878 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8e256-dca2-4968-b498-fe082f11205a None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:48.493166 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8e256-dca2-4968-b498-fe082f11205a None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:48.493437 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8e256-dca2-4968-b498-fe082f11205a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:48.505757 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8e256-dca2-4968-b498-fe082f11205a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:48.507359 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8e256-dca2-4968-b498-fe082f11205a None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:48.516720 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50c0ea-9b63-4069-b198-2c552f781e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:48.517341 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50c0ea-9b63-4069-b198-2c552f781e98 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:48.517618 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50c0ea-9b63-4069-b198-2c552f781e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:48.518143 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50c0ea-9b63-4069-b198-2c552f781e98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:48.522661 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-5df8e256-dca2-4968-b498-fe082f11205a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:48.522661 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:48.522661 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:48.522661 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:48.522661 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:48.522661 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:48.522661 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:48.522661 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:48.522661 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:48.522661 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:48.522661 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:48.522661 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:48.522661 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:48.522661 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:48.522661 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:48.522661 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:48.523566 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:48.523566 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:48.523566 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:48.523566 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:48.523566 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:48.523566 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:48.523566 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:48.523566 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:48.523566 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:48.523566 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:48.523566 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:48.523566 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:48.523566 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:48.523566 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:48.523566 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:48.523566 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:48.523566 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:48.524478 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:48.524478 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:48.524478 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:48.526042 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50c0ea-9b63-4069-b198-2c552f781e98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:48.527530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50c0ea-9b63-4069-b198-2c552f781e98 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:48.528748 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 339/679] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:48.529597 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8e256-dca2-4968-b498-fe082f11205a None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:48.542038 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-bb50c0ea-9b63-4069-b198-2c552f781e98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:46:48.542038 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:48.542038 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:48.542038 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:48.542038 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:48.542038 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:48.542038 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:48.542038 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:48.542038 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:48.542038 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:48.542038 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:48.542038 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:48.542038 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 15:46:48.542038 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 15:46:48.542038 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 15:46:48.543611 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 15:46:48.543611 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:48.543611 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:48.543611 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:48.543611 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:48.543611 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:48.543611 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:48.543611 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:48.543611 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:48.543611 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:48.543611 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:48.543611 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:48.543611 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:48.543611 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:48.543611 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:48.543611 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:48.543611 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:48.544932 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 15:46:48.544932 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 15:46:48.544932 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 15:46:48.544932 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 15:46:48.544932 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 15:46:48.544932 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 15:46:48.544932 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:46:48.544932 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:48.545801 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 341/680] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:46:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:48.546429 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50c0ea-9b63-4069-b198-2c552f781e98 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:48.623594 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:48.650954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8e256-dca2-4968-b498-fe082f11205a None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:48.672726 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:48.673143 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50c0ea-9b63-4069-b198-2c552f781e98 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:48.688409 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615cf189-09eb-4abb-8d9b-20dbeab10057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:48.689042 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cf189-09eb-4abb-8d9b-20dbeab10057 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:48.689314 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cf189-09eb-4abb-8d9b-20dbeab10057 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:48.689578 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cf189-09eb-4abb-8d9b-20dbeab10057 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:48.690313 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615cf189-09eb-4abb-8d9b-20dbeab10057 None admin] RBAC: Adding query filter params (role.id=c99e31de7c4c47c7b7b2c45c2771ca58, scope.project.id=51f312b4cd8b449aa2971993f68de9af, user.id=130166ecc884456d94dbf6c6905168fc) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:48.690612 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615cf189-09eb-4abb-8d9b-20dbeab10057 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:48.692031 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615cf189-09eb-4abb-8d9b-20dbeab10057 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:48.698033 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 340/681] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:46:48 2022] GET /identity/v3/role_assignments?user.id=130166ecc884456d94dbf6c6905168fc&scope.project.id=51f312b4cd8b449aa2971993f68de9af&role.id=c99e31de7c4c47c7b7b2c45c2771ca58 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:48.698608 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615cf189-09eb-4abb-8d9b-20dbeab10057 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:48.736845 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1193a-e203-44aa-9e74-603f56ab37f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:48.737666 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1193a-e203-44aa-9e74-603f56ab37f1 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:48.738042 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1193a-e203-44aa-9e74-603f56ab37f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:48.738414 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1193a-e203-44aa-9e74-603f56ab37f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:48.759005 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1193a-e203-44aa-9e74-603f56ab37f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:48.767194 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-51e1193a-e203-44aa-9e74-603f56ab37f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 15:46:48.767194 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:48.767194 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:48.767194 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:48.767194 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:48.767194 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:48.767194 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:48.767194 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:48.767194 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:48.767194 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:48.767194 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:48.767194 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:48.767194 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:48.767194 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:48.767194 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:48.767194 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:48.768682 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:48.768682 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:48.768682 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:48.768682 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:48.768682 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:48.768682 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:48.768682 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:48.768682 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:48.768682 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:48.768682 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:48.768682 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:48.768682 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:48.768682 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:48.768682 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:48.768682 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:48.768682 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:48.769783 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:48.769783 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:48.769783 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:48.769783 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:48.769783 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:48.769783 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:48.769783 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:48.769783 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:48.769783 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:48.769783 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:48.769783 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 15:46:48.769783 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:48.773174 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 342/682] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 30 15:46:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:48.773174 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1193a-e203-44aa-9e74-603f56ab37f1 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:48.837111 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615cf189-09eb-4abb-8d9b-20dbeab10057 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:48.891795 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25c772-bc0b-4f13-85fb-271d3deacefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:48.892572 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25c772-bc0b-4f13-85fb-271d3deacefd None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:48.893313 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25c772-bc0b-4f13-85fb-271d3deacefd None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:48.893588 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25c772-bc0b-4f13-85fb-271d3deacefd None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:48.894338 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc25c772-bc0b-4f13-85fb-271d3deacefd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:48.894739 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc25c772-bc0b-4f13-85fb-271d3deacefd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:48.896235 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc25c772-bc0b-4f13-85fb-271d3deacefd None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:48.903869 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1193a-e203-44aa-9e74-603f56ab37f1 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:48.911737 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 341/683] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:46:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:48.912665 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25c772-bc0b-4f13-85fb-271d3deacefd None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:48.930730 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:48.946629 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c8f05-0d6f-463f-9cf4-9689c6b6c07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:48.947338 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c8f05-0d6f-463f-9cf4-9689c6b6c07b None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:48.947688 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c8f05-0d6f-463f-9cf4-9689c6b6c07b None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:48.948029 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c8f05-0d6f-463f-9cf4-9689c6b6c07b None admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:48.948846 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c8f05-0d6f-463f-9cf4-9689c6b6c07b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:48.949755 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c8f05-0d6f-463f-9cf4-9689c6b6c07b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:48.951446 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c8f05-0d6f-463f-9cf4-9689c6b6c07b None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:48.969413 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 343/684] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 30 15:46:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:48.969413 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c8f05-0d6f-463f-9cf4-9689c6b6c07b None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:48.981455 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:49.050869 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25c772-bc0b-4f13-85fb-271d3deacefd None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:49.094953 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1127773-2acc-487f-b842-d976ca136a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:49.095746 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1127773-2acc-487f-b842-d976ca136a4a None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:49.096029 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1127773-2acc-487f-b842-d976ca136a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:49.096302 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1127773-2acc-487f-b842-d976ca136a4a None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:49.097333 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1127773-2acc-487f-b842-d976ca136a4a None admin] RBAC: Adding query filter params (name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:49.097637 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1127773-2acc-487f-b842-d976ca136a4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:49.099535 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1127773-2acc-487f-b842-d976ca136a4a None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:49.103615 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c8f05-0d6f-463f-9cf4-9689c6b6c07b None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:49.110530 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 342/685] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Aug 30 15:46:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:49.111442 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1127773-2acc-487f-b842-d976ca136a4a None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:49.149949 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111dd1cf-8188-445f-b7f0-ec2bc40bd557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:49.151579 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111dd1cf-8188-445f-b7f0-ec2bc40bd557 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:49.152016 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111dd1cf-8188-445f-b7f0-ec2bc40bd557 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:49.154102 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111dd1cf-8188-445f-b7f0-ec2bc40bd557 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:49.163754 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111dd1cf-8188-445f-b7f0-ec2bc40bd557 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:49.165921 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111dd1cf-8188-445f-b7f0-ec2bc40bd557 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:49.182384 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-111dd1cf-8188-445f-b7f0-ec2bc40bd557 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 15:46:49.182384 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:49.182384 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:49.182384 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:49.182384 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:49.182384 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:49.182384 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:49.182384 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:49.182384 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:49.182384 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:49.182384 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:49.182384 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:49.182384 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 15:46:49.182384 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 15:46:49.182384 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 15:46:49.182384 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 15:46:49.184125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:49.184125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:49.184125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 15:46:49.184125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:46:49.184125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 15:46:49.184125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:46:49.184125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:49.184125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:49.184125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:49.184125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:49.184125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:49.184125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:49.184125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:49.184125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:49.184125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:49.184125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:49.184125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:49.184125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:49.185329 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:49.185329 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:49.185329 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 15:46:49.185329 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 15:46:49.185329 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 15:46:49.185329 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 15:46:49.185329 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 15:46:49.185329 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 15:46:49.185329 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 15:46:49.185329 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:49.190587 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 344/686] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Aug 30 15:46:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:49.191563 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111dd1cf-8188-445f-b7f0-ec2bc40bd557 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:49.234978 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1127773-2acc-487f-b842-d976ca136a4a None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:49.239116 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:49.245558 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:49.277165 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1627c1-13d4-4d0e-bf5c-3f20adf4804b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:49.278102 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1627c1-13d4-4d0e-bf5c-3f20adf4804b None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:49.278532 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1627c1-13d4-4d0e-bf5c-3f20adf4804b None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:49.278956 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1627c1-13d4-4d0e-bf5c-3f20adf4804b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:49.279925 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1627c1-13d4-4d0e-bf5c-3f20adf4804b None admin] RBAC: Adding query filter params (role.id=c99e31de7c4c47c7b7b2c45c2771ca58, scope.project.id=51f312b4cd8b449aa2971993f68de9af, user.id=48c49f6751d14526a0954797d9ab6a9a) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:49.280484 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1627c1-13d4-4d0e-bf5c-3f20adf4804b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:49.282094 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1627c1-13d4-4d0e-bf5c-3f20adf4804b None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:49.297205 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 343/687] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:46:49 2022] GET /identity/v3/role_assignments?user.id=48c49f6751d14526a0954797d9ab6a9a&scope.project.id=51f312b4cd8b449aa2971993f68de9af&role.id=c99e31de7c4c47c7b7b2c45c2771ca58 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:49.298526 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1627c1-13d4-4d0e-bf5c-3f20adf4804b None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:49.300599 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111dd1cf-8188-445f-b7f0-ec2bc40bd557 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:49.365856 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c87eed-fa52-48a6-acf6-e75882120f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:49.366631 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c87eed-fa52-48a6-acf6-e75882120f34 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:49.367206 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c87eed-fa52-48a6-acf6-e75882120f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:49.367368 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c87eed-fa52-48a6-acf6-e75882120f34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:49.393355 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c87eed-fa52-48a6-acf6-e75882120f34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:49.394931 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c87eed-fa52-48a6-acf6-e75882120f34 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:49.415156 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1627c1-13d4-4d0e-bf5c-3f20adf4804b None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:49.419999 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-42c87eed-fa52-48a6-acf6-e75882120f34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:49.419999 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:49.419999 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:49.419999 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:49.419999 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:49.419999 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:49.419999 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:49.419999 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:49.419999 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:49.419999 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:49.419999 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:49.419999 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:49.419999 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:49.419999 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:49.419999 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:49.419999 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:49.421150 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:49.421150 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:49.421150 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:49.421150 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:49.421150 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:49.421150 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:49.421150 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:49.421150 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:49.421150 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:49.421150 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:49.421150 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:49.421150 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:49.421150 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:49.421150 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:49.421150 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:49.421150 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:49.421150 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:49.422233 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:49.422233 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:49.422233 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:49.426801 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 345/688] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:49.428809 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c87eed-fa52-48a6-acf6-e75882120f34 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:49.460095 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174a068-17dc-4723-9901-9418bfb8df4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:49.461018 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174a068-17dc-4723-9901-9418bfb8df4a None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:49.461459 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174a068-17dc-4723-9901-9418bfb8df4a None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:49.461930 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174a068-17dc-4723-9901-9418bfb8df4a None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:49.462913 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174a068-17dc-4723-9901-9418bfb8df4a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:49.463359 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174a068-17dc-4723-9901-9418bfb8df4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:49.465012 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174a068-17dc-4723-9901-9418bfb8df4a None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:49.484846 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 344/689] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Aug 30 15:46:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:49.498257 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174a068-17dc-4723-9901-9418bfb8df4a None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:49.554592 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:49.557967 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:49.565093 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c87eed-fa52-48a6-acf6-e75882120f34 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:49.603665 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf17a55-0460-475d-99e3-a546a12b83d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:49.608255 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf17a55-0460-475d-99e3-a546a12b83d3 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:49.608834 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf17a55-0460-475d-99e3-a546a12b83d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:49.609306 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf17a55-0460-475d-99e3-a546a12b83d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:49.610159 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf17a55-0460-475d-99e3-a546a12b83d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:49.610655 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf17a55-0460-475d-99e3-a546a12b83d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:49.612227 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf17a55-0460-475d-99e3-a546a12b83d3 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:49.629853 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 346/690] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:46:49.636487 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf17a55-0460-475d-99e3-a546a12b83d3 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:49.681698 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174a068-17dc-4723-9901-9418bfb8df4a None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:49.723517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d5e71-3521-40f8-a1ba-1f98f6dea4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:49.724447 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d5e71-3521-40f8-a1ba-1f98f6dea4d9 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:49.724940 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d5e71-3521-40f8-a1ba-1f98f6dea4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:49.725414 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d5e71-3521-40f8-a1ba-1f98f6dea4d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:49.756038 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf17a55-0460-475d-99e3-a546a12b83d3 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:49.800057 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae633f7-87d1-41bd-9cc8-711880e4cd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:49.800057 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae633f7-87d1-41bd-9cc8-711880e4cd31 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:49.800375 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae633f7-87d1-41bd-9cc8-711880e4cd31 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:49.800631 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae633f7-87d1-41bd-9cc8-711880e4cd31 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:49.810464 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d5e71-3521-40f8-a1ba-1f98f6dea4d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:49.812293 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d5e71-3521-40f8-a1ba-1f98f6dea4d9 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:49.815929 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae633f7-87d1-41bd-9cc8-711880e4cd31 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:49.817443 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae633f7-87d1-41bd-9cc8-711880e4cd31 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:49.833270 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-7ae633f7-87d1-41bd-9cc8-711880e4cd31 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 15:46:49.833270 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:49.833270 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:49.833270 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:49.833270 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:49.833270 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:49.833270 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:49.833270 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:49.833270 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:49.833270 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:49.833270 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:49.833270 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:49.833270 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 15:46:49.833270 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 15:46:49.833270 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 15:46:49.833270 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 15:46:49.834291 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:49.834291 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:49.834291 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 15:46:49.834291 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:46:49.834291 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 15:46:49.834291 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:46:49.834291 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:49.834291 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:49.834291 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:49.834291 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:49.834291 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:49.834291 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:49.834291 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:49.834291 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:49.834291 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:49.834291 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:49.834291 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:49.834291 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:49.835688 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:49.835688 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:49.835688 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 15:46:49.835688 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 15:46:49.835688 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 15:46:49.835688 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 15:46:49.835688 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 15:46:49.835688 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 15:46:49.835688 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 15:46:49.835688 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:49.835688 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 347/691] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 30 15:46:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:49.845844 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae633f7-87d1-41bd-9cc8-711880e4cd31 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:49.850671 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:49.871638 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:49.942175 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 345/692] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:46:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 15:46:49.944669 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d5e71-3521-40f8-a1ba-1f98f6dea4d9 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:49.975179 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae633f7-87d1-41bd-9cc8-711880e4cd31 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:50.017949 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1fd140-3d86-4a82-8424-b279e879fe35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:50.018567 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fd140-3d86-4a82-8424-b279e879fe35 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:50.018845 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fd140-3d86-4a82-8424-b279e879fe35 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:50.019114 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fd140-3d86-4a82-8424-b279e879fe35 None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:50.020009 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1fd140-3d86-4a82-8424-b279e879fe35 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:50.020315 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1fd140-3d86-4a82-8424-b279e879fe35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:50.022292 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1fd140-3d86-4a82-8424-b279e879fe35 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:50.043508 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 348/693] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Aug 30 15:46:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:50.050205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1fd140-3d86-4a82-8424-b279e879fe35 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:50.073295 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d5e71-3521-40f8-a1ba-1f98f6dea4d9 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:50.105284 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:50.115178 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f80b8-57d1-4a29-9917-f95b11e65228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:50.116037 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f80b8-57d1-4a29-9917-f95b11e65228 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:50.116461 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f80b8-57d1-4a29-9917-f95b11e65228 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:50.116967 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f80b8-57d1-4a29-9917-f95b11e65228 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:50.129056 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f80b8-57d1-4a29-9917-f95b11e65228 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:50.130712 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f80b8-57d1-4a29-9917-f95b11e65228 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:50.146954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-ff6f80b8-57d1-4a29-9917-f95b11e65228 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:50.146954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:50.146954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:50.146954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:50.146954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:50.146954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:50.146954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:50.146954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:50.146954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:50.146954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:50.146954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:50.146954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:50.146954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:50.146954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:50.146954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:50.146954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:50.148119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:50.148119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:50.148119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:50.148119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:50.148119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:50.148119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:50.148119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:50.148119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:50.148119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:50.148119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:50.148119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:50.148119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:50.148119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:50.148119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:50.148119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:50.148119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:50.148119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:50.149230 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:50.149230 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:50.149230 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:50.155780 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 346/694] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 15:46:50.157314 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f80b8-57d1-4a29-9917-f95b11e65228 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:50.231227 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:50.268497 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f80b8-57d1-4a29-9917-f95b11e65228 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:50.297080 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1fd140-3d86-4a82-8424-b279e879fe35 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:50.305774 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8f269-d7e5-4ce7-95a7-9aad42a85ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:50.306659 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8f269-d7e5-4ce7-95a7-9aad42a85ae5 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:50.307094 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8f269-d7e5-4ce7-95a7-9aad42a85ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:50.307512 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8f269-d7e5-4ce7-95a7-9aad42a85ae5 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:50.308319 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e8f269-d7e5-4ce7-95a7-9aad42a85ae5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:50.308815 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e8f269-d7e5-4ce7-95a7-9aad42a85ae5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:50.310356 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e8f269-d7e5-4ce7-95a7-9aad42a85ae5 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:50.327403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 347/695] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:50.328859 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8f269-d7e5-4ce7-95a7-9aad42a85ae5 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:50.374057 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:50.397499 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a15e6b-28c2-4f6f-bcb1-7c96a5e49d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:50.398134 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a15e6b-28c2-4f6f-bcb1-7c96a5e49d0e None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:50.398419 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a15e6b-28c2-4f6f-bcb1-7c96a5e49d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:50.398694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a15e6b-28c2-4f6f-bcb1-7c96a5e49d0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:50.456198 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8f269-d7e5-4ce7-95a7-9aad42a85ae5 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:50.494225 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a15e6b-28c2-4f6f-bcb1-7c96a5e49d0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:50.495616 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a15e6b-28c2-4f6f-bcb1-7c96a5e49d0e None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:50.512584 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af06e2-5cbe-47f9-b566-ba186a775f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:50.513532 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af06e2-5cbe-47f9-b566-ba186a775f03 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:50.513955 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af06e2-5cbe-47f9-b566-ba186a775f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:50.514386 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af06e2-5cbe-47f9-b566-ba186a775f03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:50.521904 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af06e2-5cbe-47f9-b566-ba186a775f03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:50.523642 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af06e2-5cbe-47f9-b566-ba186a775f03 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:50.536119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-87af06e2-5cbe-47f9-b566-ba186a775f03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:46:50.536119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:50.536119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:50.536119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:50.536119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:50.536119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:50.536119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:50.536119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:50.536119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:50.536119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:50.536119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:50.536119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:50.536119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 15:46:50.536119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 15:46:50.536119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 15:46:50.537279 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 15:46:50.537279 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:50.537279 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:50.537279 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:50.537279 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:50.537279 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:50.537279 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:50.537279 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:50.537279 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:50.537279 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:50.537279 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:50.537279 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:50.537279 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:50.537279 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:50.537279 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:50.537279 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:50.537279 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:50.538359 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 15:46:50.538359 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 15:46:50.538359 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 15:46:50.538359 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 15:46:50.538359 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 15:46:50.538359 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 15:46:50.538359 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:46:50.538359 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:50.545027 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 348/696] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:46:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:50.546520 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7424ad7-4a05-436a-9b2d-0de8cf310ba3 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:50.546952 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7424ad7-4a05-436a-9b2d-0de8cf310ba3 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:50.547368 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7424ad7-4a05-436a-9b2d-0de8cf310ba3 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:50.552887 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 349/697] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:50.553777 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7424ad7-4a05-436a-9b2d-0de8cf310ba3 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:50.577145 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:50.613669 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 349/698] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:46:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 15:46:50.617440 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc1f42-b954-4395-9e42-c28ca900d2ab None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:50.617923 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc1f42-b954-4395-9e42-c28ca900d2ab None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:50.618355 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc1f42-b954-4395-9e42-c28ca900d2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:50.637667 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-f5dc1f42-b954-4395-9e42-c28ca900d2ab None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:50.639453 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-f5dc1f42-b954-4395-9e42-c28ca900d2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:50.673966 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:50.677852 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7424ad7-4a05-436a-9b2d-0de8cf310ba3 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:50.721073 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 350/699] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:46:50.722891 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc1f42-b954-4395-9e42-c28ca900d2ab None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:50.728800 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2b5c4-423e-467e-b05c-98623d5de961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:50.731245 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2b5c4-423e-467e-b05c-98623d5de961 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:50.731842 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2b5c4-423e-467e-b05c-98623d5de961 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:50.732303 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2b5c4-423e-467e-b05c-98623d5de961 None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:50.733236 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2b5c4-423e-467e-b05c-98623d5de961 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:50.733758 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2b5c4-423e-467e-b05c-98623d5de961 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:50.735442 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2b5c4-423e-467e-b05c-98623d5de961 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:50.751312 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 350/700] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 30 15:46:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:50.761161 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2b5c4-423e-467e-b05c-98623d5de961 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:50.841437 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc1f42-b954-4395-9e42-c28ca900d2ab None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:50.843804 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:50.889088 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf8489-b8f2-485d-aae6-a0d2c670b714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:50.889834 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf8489-b8f2-485d-aae6-a0d2c670b714 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:50.891709 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf8489-b8f2-485d-aae6-a0d2c670b714 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:50.892076 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf8489-b8f2-485d-aae6-a0d2c670b714 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:50.914482 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bf8489-b8f2-485d-aae6-a0d2c670b714 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:50.916353 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bf8489-b8f2-485d-aae6-a0d2c670b714 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:50.933854 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2b5c4-423e-467e-b05c-98623d5de961 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:50.938333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-04bf8489-b8f2-485d-aae6-a0d2c670b714 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:50.938333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:50.938333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:50.938333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:50.938333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:50.938333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:50.938333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:50.938333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:50.938333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:50.938333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:50.938333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:50.938333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:50.938333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:50.938333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:50.938333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:50.938333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:50.939627 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:50.939627 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:50.939627 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:50.939627 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:50.939627 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:50.939627 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:50.939627 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:50.939627 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:50.939627 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:50.939627 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:50.939627 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:50.939627 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:50.939627 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:50.939627 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:50.939627 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:50.939627 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:50.939627 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:50.940717 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:50.940717 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:50.940717 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:50.945049 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 351/701] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:50.948900 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53e73c-1891-44db-a5f8-d0bd8624373c None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:50.948900 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53e73c-1891-44db-a5f8-d0bd8624373c None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:50.948900 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53e73c-1891-44db-a5f8-d0bd8624373c None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:50.952855 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 352/702] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:50.953845 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53e73c-1891-44db-a5f8-d0bd8624373c None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:50.985747 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00331d-480f-4767-8e00-cb4cdcb7a65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:50.986571 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00331d-480f-4767-8e00-cb4cdcb7a65c None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:50.986951 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00331d-480f-4767-8e00-cb4cdcb7a65c None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:50.987327 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00331d-480f-4767-8e00-cb4cdcb7a65c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:50.988159 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00331d-480f-4767-8e00-cb4cdcb7a65c None admin] RBAC: Adding query filter params (role.id=676938e69210499ca11ee75dd572d0dc, scope.project.id=51f312b4cd8b449aa2971993f68de9af, user.id=ebc80bf891614fb895af33ca1ded6b9d) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:50.988577 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00331d-480f-4767-8e00-cb4cdcb7a65c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:50.990265 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00331d-480f-4767-8e00-cb4cdcb7a65c None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:50.996727 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 351/703] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:46:50 2022] GET /identity/v3/role_assignments?user.id=ebc80bf891614fb895af33ca1ded6b9d&scope.project.id=51f312b4cd8b449aa2971993f68de9af&role.id=676938e69210499ca11ee75dd572d0dc => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:50.998105 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3222f-fa4f-464d-8643-e9a526ece22c None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:50.998511 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3222f-fa4f-464d-8643-e9a526ece22c None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:50.998912 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3222f-fa4f-464d-8643-e9a526ece22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:51.019399 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-c1a3222f-fa4f-464d-8643-e9a526ece22c None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:51.020709 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-c1a3222f-fa4f-464d-8643-e9a526ece22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:51.045569 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:51.095977 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53e73c-1891-44db-a5f8-d0bd8624373c None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:51.109604 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 352/704] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:46:51.117778 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3222f-fa4f-464d-8643-e9a526ece22c None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:51.135710 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aee0f9-4dbe-4af8-9949-5ffc0fb50e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:51.136716 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aee0f9-4dbe-4af8-9949-5ffc0fb50e4e None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:51.137523 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aee0f9-4dbe-4af8-9949-5ffc0fb50e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:51.137948 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aee0f9-4dbe-4af8-9949-5ffc0fb50e4e None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:51.138803 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aee0f9-4dbe-4af8-9949-5ffc0fb50e4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:51.139260 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aee0f9-4dbe-4af8-9949-5ffc0fb50e4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:51.140911 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aee0f9-4dbe-4af8-9949-5ffc0fb50e4e None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:51.155437 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 353/705] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:51.161132 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aee0f9-4dbe-4af8-9949-5ffc0fb50e4e None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:51.181262 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:51.259031 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3222f-fa4f-464d-8643-e9a526ece22c None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:51.268889 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aee0f9-4dbe-4af8-9949-5ffc0fb50e4e None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:51.305111 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef9d00-143e-40de-a83e-0dae6da2e6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:51.305668 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef9d00-143e-40de-a83e-0dae6da2e6bc None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:51.305948 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef9d00-143e-40de-a83e-0dae6da2e6bc None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:51.306221 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef9d00-143e-40de-a83e-0dae6da2e6bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:51.311308 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a7cac-6d25-40b5-9f95-51266997af3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:51.311936 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a7cac-6d25-40b5-9f95-51266997af3c None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:51.312213 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a7cac-6d25-40b5-9f95-51266997af3c None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:51.312480 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a7cac-6d25-40b5-9f95-51266997af3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:51.313200 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef9d00-143e-40de-a83e-0dae6da2e6bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:51.314656 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef9d00-143e-40de-a83e-0dae6da2e6bc None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:51.323295 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a7cac-6d25-40b5-9f95-51266997af3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:51.325505 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a7cac-6d25-40b5-9f95-51266997af3c None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:51.327161 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-fdef9d00-143e-40de-a83e-0dae6da2e6bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:46:51.327161 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:51.327161 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:51.327161 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:51.327161 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:51.327161 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:51.327161 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:51.327161 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:51.327161 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:51.327161 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:51.327161 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:51.327161 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:51.327161 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 15:46:51.327161 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 15:46:51.327161 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 15:46:51.328168 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 15:46:51.328168 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:51.328168 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:51.328168 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:51.328168 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:51.328168 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:51.328168 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:51.328168 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:51.328168 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:51.328168 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:51.328168 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:51.328168 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:51.328168 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:51.328168 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:51.328168 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:51.328168 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:51.328168 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:51.329396 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 15:46:51.329396 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 15:46:51.329396 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 15:46:51.329396 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 15:46:51.329396 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 15:46:51.329396 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 15:46:51.329396 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:46:51.329396 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:51.329396 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 354/706] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:46:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 15:46:51.334506 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef9d00-143e-40de-a83e-0dae6da2e6bc None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:51.343557 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-504a7cac-6d25-40b5-9f95-51266997af3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:51.343557 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:51.343557 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:51.343557 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:51.343557 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:51.343557 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:51.343557 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:51.343557 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:51.343557 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:51.343557 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:51.343557 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:51.343557 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:51.343557 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:51.343557 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:51.343557 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:51.343557 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:51.344716 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:51.344716 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:51.344716 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:51.344716 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:51.344716 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:51.344716 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:51.344716 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:51.344716 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:51.344716 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:51.344716 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:51.344716 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:51.344716 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:51.344716 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:51.344716 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:51.344716 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:51.344716 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:51.344716 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:51.345970 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:51.345970 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:51.345970 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:51.347023 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 353/707] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:51.352694 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a7cac-6d25-40b5-9f95-51266997af3c None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:51.364963 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:51.422054 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:51.447828 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef9d00-143e-40de-a83e-0dae6da2e6bc None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:51.487688 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a7cac-6d25-40b5-9f95-51266997af3c None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:51.490832 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205fb49d-3655-4c43-bac6-d20e5f38be55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:51.491770 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fb49d-3655-4c43-bac6-d20e5f38be55 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:51.492255 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fb49d-3655-4c43-bac6-d20e5f38be55 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:51.492731 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fb49d-3655-4c43-bac6-d20e5f38be55 None admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:51.493683 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205fb49d-3655-4c43-bac6-d20e5f38be55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:51.494210 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205fb49d-3655-4c43-bac6-d20e5f38be55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:51.496036 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205fb49d-3655-4c43-bac6-d20e5f38be55 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:51.510165 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 355/708] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 30 15:46:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:51.517225 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205fb49d-3655-4c43-bac6-d20e5f38be55 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:51.525824 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84179b8e-d9aa-43aa-9cb2-cf727b0191bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:51.526434 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84179b8e-d9aa-43aa-9cb2-cf727b0191bb None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:51.526709 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84179b8e-d9aa-43aa-9cb2-cf727b0191bb None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:51.526979 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84179b8e-d9aa-43aa-9cb2-cf727b0191bb None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:51.528958 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84179b8e-d9aa-43aa-9cb2-cf727b0191bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:51.529271 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84179b8e-d9aa-43aa-9cb2-cf727b0191bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:51.530674 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84179b8e-d9aa-43aa-9cb2-cf727b0191bb None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:51.546199 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 354/709] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:46:51.547056 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84179b8e-d9aa-43aa-9cb2-cf727b0191bb None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:51.627013 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:51.641745 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205fb49d-3655-4c43-bac6-d20e5f38be55 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:51.665638 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84179b8e-d9aa-43aa-9cb2-cf727b0191bb None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:51.681223 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f74291-dbff-4ff7-94ac-ad9166104897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:51.682084 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f74291-dbff-4ff7-94ac-ad9166104897 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:51.682492 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f74291-dbff-4ff7-94ac-ad9166104897 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:51.682906 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f74291-dbff-4ff7-94ac-ad9166104897 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:51.683680 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f74291-dbff-4ff7-94ac-ad9166104897 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:51.685421 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f74291-dbff-4ff7-94ac-ad9166104897 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:51.689415 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:51.698863 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-29f74291-dbff-4ff7-94ac-ad9166104897 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 15:46:51.698863 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:51.698863 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 15:46:51.698863 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 15:46:51.698863 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 15:46:51.698863 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 15:46:51.698863 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 15:46:51.698863 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:46:51.698863 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 15:46:51.698863 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:51.698863 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 15:46:51.698863 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:51.698863 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:51.698863 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:51.698863 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:51.698863 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:51.698863 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:51.700122 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:51.700122 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:51.700122 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:51.700122 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:51.700122 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:51.700122 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:51.700122 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 15:46:51.700122 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 15:46:51.700122 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 15:46:51.700122 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 15:46:51.700122 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:51.700122 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:51.700122 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:51.700122 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:51.700122 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:51.700122 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:51.701177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:51.701177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:51.701177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:51.701177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:51.701177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:51.701177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:51.701177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:51.701177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:51.701177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:51.701177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:51.701177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 15:46:51.701177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:46:51.701177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 15:46:51.701177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:51.703628 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 356/710] 10.222.0.25 () {56 vars in 1129 bytes} [Tue Aug 30 15:46:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:51.704540 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f74291-dbff-4ff7-94ac-ad9166104897 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:51.705878 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a72cf-de4c-4686-8879-26bec9a62e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:51.706596 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a72cf-de4c-4686-8879-26bec9a62e55 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:51.707085 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a72cf-de4c-4686-8879-26bec9a62e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:51.707455 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a72cf-de4c-4686-8879-26bec9a62e55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:51.708570 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a72cf-de4c-4686-8879-26bec9a62e55 None admin] RBAC: Adding query filter params (role.id=c99e31de7c4c47c7b7b2c45c2771ca58, scope.project.id=51f312b4cd8b449aa2971993f68de9af, user.id=94765f224c734beabe83b4dc0c5e511f) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:51.709030 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a72cf-de4c-4686-8879-26bec9a62e55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:51.710579 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a72cf-de4c-4686-8879-26bec9a62e55 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:51.733073 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 355/711] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:46:51 2022] GET /identity/v3/role_assignments?user.id=94765f224c734beabe83b4dc0c5e511f&scope.project.id=51f312b4cd8b449aa2971993f68de9af&role.id=c99e31de7c4c47c7b7b2c45c2771ca58 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:51.734215 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a72cf-de4c-4686-8879-26bec9a62e55 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:51.826030 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f74291-dbff-4ff7-94ac-ad9166104897 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:51.865767 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa000f36-bfc7-47a6-8cb0-1aed03bca761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:51.867134 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa000f36-bfc7-47a6-8cb0-1aed03bca761 None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:51.867573 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa000f36-bfc7-47a6-8cb0-1aed03bca761 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:51.867981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa000f36-bfc7-47a6-8cb0-1aed03bca761 None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:51.868769 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa000f36-bfc7-47a6-8cb0-1aed03bca761 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:51.870449 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa000f36-bfc7-47a6-8cb0-1aed03bca761 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:51.912258 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 357/712] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Aug 30 15:46:51 2022] POST /identity/v3/users => generated 254 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:46:51.913856 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c8a3b-e129-4458-9005-cb4382f05651 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:51.914306 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c8a3b-e129-4458-9005-cb4382f05651 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:51.914723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c8a3b-e129-4458-9005-cb4382f05651 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:51.916379 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 358/713] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:51.922671 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a72cf-de4c-4686-8879-26bec9a62e55 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:51.931781 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa0c1a-0d49-4233-b062-ee4d9b38f63f None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:51.932354 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa0c1a-0d49-4233-b062-ee4d9b38f63f None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:51.932773 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa0c1a-0d49-4233-b062-ee4d9b38f63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:51.974753 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-38aa0c1a-0d49-4233-b062-ee4d9b38f63f None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:51.976221 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-38aa0c1a-0d49-4233-b062-ee4d9b38f63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:51.984165 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:51.991437 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff50515-8fe6-4223-81bb-e81b79680922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:51.992597 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff50515-8fe6-4223-81bb-e81b79680922 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:51.993627 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff50515-8fe6-4223-81bb-e81b79680922 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:51.994043 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff50515-8fe6-4223-81bb-e81b79680922 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:51.994851 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff50515-8fe6-4223-81bb-e81b79680922 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:51.995294 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff50515-8fe6-4223-81bb-e81b79680922 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:51.997296 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff50515-8fe6-4223-81bb-e81b79680922 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:52.004680 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 356/714] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Aug 30 15:46:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:52.009893 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff50515-8fe6-4223-81bb-e81b79680922 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:52.042130 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:52.063286 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 359/715] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 15:46:52.134149 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff50515-8fe6-4223-81bb-e81b79680922 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:52.170654 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11408e83-8ab2-4474-9b66-d71be4347664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:52.171187 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11408e83-8ab2-4474-9b66-d71be4347664 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:52.171461 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11408e83-8ab2-4474-9b66-d71be4347664 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:52.171731 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11408e83-8ab2-4474-9b66-d71be4347664 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:52.172363 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11408e83-8ab2-4474-9b66-d71be4347664 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:52.172662 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11408e83-8ab2-4474-9b66-d71be4347664 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:52.174343 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11408e83-8ab2-4474-9b66-d71be4347664 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:52.180358 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 357/716] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Aug 30 15:46:52 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:52.351410 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa0c1a-0d49-4233-b062-ee4d9b38f63f None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:52.461332 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa0c1a-0d49-4233-b062-ee4d9b38f63f None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:52.501277 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58599cc2-060b-49be-bff6-f15b821254d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:52.502193 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58599cc2-060b-49be-bff6-f15b821254d8 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:52.502634 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58599cc2-060b-49be-bff6-f15b821254d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:52.503053 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58599cc2-060b-49be-bff6-f15b821254d8 None admin] PATH_INFO: `/v3/services/network` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:52.503807 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58599cc2-060b-49be-bff6-f15b821254d8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:52.505354 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58599cc2-060b-49be-bff6-f15b821254d8 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:52.518820 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-58599cc2-060b-49be-bff6-f15b821254d8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 15:46:52.518820 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:52.518820 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 15:46:52.518820 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 15:46:52.518820 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 15:46:52.518820 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 15:46:52.518820 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 15:46:52.518820 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:46:52.518820 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 15:46:52.518820 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:52.518820 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 15:46:52.518820 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:52.518820 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:52.518820 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:52.518820 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:52.518820 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:52.518820 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:52.520106 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:52.520106 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:52.520106 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:52.520106 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:52.520106 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:52.520106 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:52.520106 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 15:46:52.520106 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 15:46:52.520106 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 15:46:52.520106 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 15:46:52.520106 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:52.520106 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:52.520106 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:52.520106 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:52.520106 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:52.520106 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:52.521182 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:52.521182 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:52.521182 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:52.521182 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:52.521182 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:52.521182 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:52.521182 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:52.521182 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:52.521182 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:52.521182 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:52.521182 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 15:46:52.521182 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:46:52.521182 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 15:46:52.521182 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:52.523559 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 360/717] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:46:52 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:52.530509 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11408e83-8ab2-4474-9b66-d71be4347664 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:52.602692 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:52.657840 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11408e83-8ab2-4474-9b66-d71be4347664 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:52.695660 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9004c1d-f30d-4ed4-9bc5-a57805f9cea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:52.696287 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9004c1d-f30d-4ed4-9bc5-a57805f9cea8 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:52.696569 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9004c1d-f30d-4ed4-9bc5-a57805f9cea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:52.696874 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9004c1d-f30d-4ed4-9bc5-a57805f9cea8 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:52.697518 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9004c1d-f30d-4ed4-9bc5-a57805f9cea8 None admin] RBAC: Adding query filter params (name=network) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:52.697820 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9004c1d-f30d-4ed4-9bc5-a57805f9cea8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:52.699803 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9004c1d-f30d-4ed4-9bc5-a57805f9cea8 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:52.704846 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 358/718] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Aug 30 15:46:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:52.714154 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58599cc2-060b-49be-bff6-f15b821254d8 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:52.803055 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:52.871768 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58599cc2-060b-49be-bff6-f15b821254d8 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:52.914722 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64cf9d-acd2-42db-a7ff-f0b9753f5c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:52.915342 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64cf9d-acd2-42db-a7ff-f0b9753f5c6e None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:52.915623 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64cf9d-acd2-42db-a7ff-f0b9753f5c6e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:52.915899 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64cf9d-acd2-42db-a7ff-f0b9753f5c6e None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:52.916544 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64cf9d-acd2-42db-a7ff-f0b9753f5c6e None admin] RBAC: Adding query filter params (type=network) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:52.916881 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64cf9d-acd2-42db-a7ff-f0b9753f5c6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:52.919009 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64cf9d-acd2-42db-a7ff-f0b9753f5c6e None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:52.927682 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 361/719] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Aug 30 15:46:52 2022] GET /identity/v3/services?type=network => generated 124 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:53.256057 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4dfa05-b0b4-4ea1-8b56-66753dfb0704 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:53.256458 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4dfa05-b0b4-4ea1-8b56-66753dfb0704 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:53.256687 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4dfa05-b0b4-4ea1-8b56-66753dfb0704 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:53.258325 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 359/720] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:53.264761 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478725f1-0220-45c4-a36c-c1fd8bddef59 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:53.265077 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478725f1-0220-45c4-a36c-c1fd8bddef59 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:53.265363 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478725f1-0220-45c4-a36c-c1fd8bddef59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:53.285025 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-478725f1-0220-45c4-a36c-c1fd8bddef59 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:53.286219 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-478725f1-0220-45c4-a36c-c1fd8bddef59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:53.367546 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 362/721] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 15:46:53.696016 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4dfa05-b0b4-4ea1-8b56-66753dfb0704 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:53.830419 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4dfa05-b0b4-4ea1-8b56-66753dfb0704 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:53.869238 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:53.874952 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c3b0b-bd29-48c6-8e60-e6d38c98b4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:53.875588 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c3b0b-bd29-48c6-8e60-e6d38c98b4b0 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:53.875866 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c3b0b-bd29-48c6-8e60-e6d38c98b4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:53.876137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c3b0b-bd29-48c6-8e60-e6d38c98b4b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:53.897361 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c3b0b-bd29-48c6-8e60-e6d38c98b4b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:53.902659 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-324c3b0b-bd29-48c6-8e60-e6d38c98b4b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:46:53.902659 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:53.902659 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:53.902659 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:53.902659 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:53.902659 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:53.902659 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:53.902659 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:53.902659 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:53.902659 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:53.902659 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:53.902659 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:53.902659 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:53.902659 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:53.902659 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:53.902659 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:53.905137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:53.905137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:53.905137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:53.905137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:53.905137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:53.905137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:53.905137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:53.905137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:53.905137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:53.905137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:53.905137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:53.905137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:53.905137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:53.905137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:53.905137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:53.905137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:53.907553 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:53.907553 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:53.907553 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:53.907553 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:53.907553 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:53.907553 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:53.907553 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:53.907553 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:53.907553 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:53.907553 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:53.907553 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:46:53.907553 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:53.907553 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 360/722] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 30 15:46:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:53.917656 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478725f1-0220-45c4-a36c-c1fd8bddef59 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:53.998902 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:54.065679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478725f1-0220-45c4-a36c-c1fd8bddef59 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:54.111243 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95cf5ee-03c3-412a-bd45-8b41b0673642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:54.111860 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cf5ee-03c3-412a-bd45-8b41b0673642 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:54.112141 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cf5ee-03c3-412a-bd45-8b41b0673642 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:54.112413 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cf5ee-03c3-412a-bd45-8b41b0673642 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:54.113131 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95cf5ee-03c3-412a-bd45-8b41b0673642 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:54.113436 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95cf5ee-03c3-412a-bd45-8b41b0673642 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:54.114803 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95cf5ee-03c3-412a-bd45-8b41b0673642 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:54.124345 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 363/723] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:46:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:54.129875 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c3b0b-bd29-48c6-8e60-e6d38c98b4b0 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:54.252673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c3b0b-bd29-48c6-8e60-e6d38c98b4b0 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:54.296999 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a2ac7-511b-411e-8b5e-60bfdbce954e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:54.297642 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a2ac7-511b-411e-8b5e-60bfdbce954e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:54.297918 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a2ac7-511b-411e-8b5e-60bfdbce954e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:54.298185 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a2ac7-511b-411e-8b5e-60bfdbce954e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:54.309604 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a2ac7-511b-411e-8b5e-60bfdbce954e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:54.311066 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a2ac7-511b-411e-8b5e-60bfdbce954e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:54.332438 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-6c6a2ac7-511b-411e-8b5e-60bfdbce954e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:54.332438 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:54.332438 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:54.332438 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:54.332438 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:54.332438 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:54.332438 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:54.332438 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:54.332438 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:54.332438 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:54.332438 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:54.332438 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:54.332438 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:54.332438 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:54.332438 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:54.332438 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:54.334488 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:54.334488 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:54.334488 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:54.334488 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:54.334488 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:54.334488 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:54.334488 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:54.334488 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:54.334488 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:54.334488 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:54.334488 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:54.334488 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:54.334488 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:54.334488 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:54.334488 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:54.334488 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:54.334488 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:54.335632 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:54.335632 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:54.335632 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:54.335632 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 361/724] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:54.343098 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95cf5ee-03c3-412a-bd45-8b41b0673642 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:54.485367 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95cf5ee-03c3-412a-bd45-8b41b0673642 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:54.487836 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3fab3-4d29-46ea-b2b6-410f209e8daf None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:54.487836 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3fab3-4d29-46ea-b2b6-410f209e8daf None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:54.488216 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3fab3-4d29-46ea-b2b6-410f209e8daf None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:54.489715 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 362/725] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 15:46:54.497676 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad65c3-d80c-4026-bb68-8916d9e0dd38 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:54.498044 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad65c3-d80c-4026-bb68-8916d9e0dd38 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:54.498238 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad65c3-d80c-4026-bb68-8916d9e0dd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:54.503588 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:54.519490 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-47ad65c3-d80c-4026-bb68-8916d9e0dd38 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:54.520816 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-47ad65c3-d80c-4026-bb68-8916d9e0dd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:54.551411 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df862a-29c3-4282-843c-8a9f5a7bf077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:54.553568 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df862a-29c3-4282-843c-8a9f5a7bf077 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:54.553846 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df862a-29c3-4282-843c-8a9f5a7bf077 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:54.555555 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df862a-29c3-4282-843c-8a9f5a7bf077 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:54.556279 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df862a-29c3-4282-843c-8a9f5a7bf077 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:54.556591 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df862a-29c3-4282-843c-8a9f5a7bf077 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:54.557994 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df862a-29c3-4282-843c-8a9f5a7bf077 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:54.579834 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:54.584584 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 364/726] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:46:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:54.591522 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df862a-29c3-4282-843c-8a9f5a7bf077 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:54.626263 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 363/727] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 15:46:54.627537 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255ee94-c6a4-42b9-87d3-7ed2a75fa977 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:54.627823 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255ee94-c6a4-42b9-87d3-7ed2a75fa977 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:54.628112 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255ee94-c6a4-42b9-87d3-7ed2a75fa977 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:54.635882 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 364/728] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:54 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:54.641730 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fefa7-2bc6-44ef-b492-a739eafa3f05 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:54.642016 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fefa7-2bc6-44ef-b492-a739eafa3f05 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:54.642298 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fefa7-2bc6-44ef-b492-a739eafa3f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:54.668637 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-b36fefa7-2bc6-44ef-b492-a739eafa3f05 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:54.669870 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-b36fefa7-2bc6-44ef-b492-a739eafa3f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:54.743974 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 365/729] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 15:46:54.759862 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df862a-29c3-4282-843c-8a9f5a7bf077 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:54.794669 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ccf64a-0723-4c33-8ecd-01860f3ca149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:54.795298 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccf64a-0723-4c33-8ecd-01860f3ca149 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:54.795574 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccf64a-0723-4c33-8ecd-01860f3ca149 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:54.795841 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccf64a-0723-4c33-8ecd-01860f3ca149 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:54.802949 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ccf64a-0723-4c33-8ecd-01860f3ca149 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:54.804387 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ccf64a-0723-4c33-8ecd-01860f3ca149 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:54.813906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ac82f-61f3-4aca-9c50-ac5e1d19f8bb None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:54.814196 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ac82f-61f3-4aca-9c50-ac5e1d19f8bb None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:54.814477 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ac82f-61f3-4aca-9c50-ac5e1d19f8bb None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:54.815823 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 366/730] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 15:46:54.816257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-27ccf64a-0723-4c33-8ecd-01860f3ca149 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 15:46:54.816257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:54.816257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:54.816257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:54.816257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:54.816257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:54.816257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:54.816257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:54.816257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:54.816257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:54.816257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:54.816257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:54.816257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 15:46:54.816257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 15:46:54.816257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 15:46:54.816257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 15:46:54.817211 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:54.817211 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:54.817211 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 15:46:54.817211 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:46:54.817211 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 15:46:54.817211 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:46:54.817211 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:54.817211 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:54.817211 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:54.817211 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:54.817211 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:54.817211 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:54.817211 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:54.817211 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:54.817211 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:54.817211 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:54.817211 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:54.817211 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:54.818934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:54.818934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:54.818934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 15:46:54.818934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 15:46:54.818934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 15:46:54.818934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 15:46:54.818934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 15:46:54.818934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 15:46:54.818934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 15:46:54.818934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:54.818934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 365/731] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Aug 30 15:46:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 15:46:54.826021 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ccf64a-0723-4c33-8ecd-01860f3ca149 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:54.826310 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de0a9d-372a-440e-aec7-efdd18a26af7 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:54.826580 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de0a9d-372a-440e-aec7-efdd18a26af7 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:54.826830 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de0a9d-372a-440e-aec7-efdd18a26af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:54.854346 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:54.869959 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-e0de0a9d-372a-440e-aec7-efdd18a26af7 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:54.871232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-e0de0a9d-372a-440e-aec7-efdd18a26af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:54.945198 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 367/732] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:46:54.973956 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ccf64a-0723-4c33-8ecd-01860f3ca149 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:55.023774 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dee429-1dec-426b-b3ee-e7d4c0274680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:55.024316 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dee429-1dec-426b-b3ee-e7d4c0274680 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:55.024594 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dee429-1dec-426b-b3ee-e7d4c0274680 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:55.024892 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dee429-1dec-426b-b3ee-e7d4c0274680 None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:55.025635 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dee429-1dec-426b-b3ee-e7d4c0274680 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:55.025939 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dee429-1dec-426b-b3ee-e7d4c0274680 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:55.027417 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dee429-1dec-426b-b3ee-e7d4c0274680 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:55.048772 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 366/733] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Aug 30 15:46:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:55.054233 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de0a9d-372a-440e-aec7-efdd18a26af7 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:55.066080 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dee429-1dec-426b-b3ee-e7d4c0274680 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:55.094443 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:55.176126 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de0a9d-372a-440e-aec7-efdd18a26af7 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:55.183254 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:55.204891 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dee429-1dec-426b-b3ee-e7d4c0274680 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:55.214301 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb3287-5d2f-46b3-bc43-00999f97cf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:55.215541 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb3287-5d2f-46b3-bc43-00999f97cf5f None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:55.215817 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb3287-5d2f-46b3-bc43-00999f97cf5f None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:55.216090 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb3287-5d2f-46b3-bc43-00999f97cf5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:55.228039 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb3287-5d2f-46b3-bc43-00999f97cf5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:55.229639 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb3287-5d2f-46b3-bc43-00999f97cf5f None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:55.246226 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-83fb3287-5d2f-46b3-bc43-00999f97cf5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:55.246226 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:55.246226 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:55.246226 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:55.246226 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:55.246226 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:55.246226 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:55.246226 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:55.246226 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:55.246226 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:55.246226 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:55.246226 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:55.246226 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:55.246226 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:55.246226 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:55.246226 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:55.248533 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:55.248533 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:55.248533 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:55.248533 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:55.248533 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:55.248533 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:55.248533 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:55.248533 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:55.248533 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:55.248533 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:55.248533 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:55.248533 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:55.248533 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:55.248533 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:55.248533 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:55.248533 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:55.248533 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:55.250822 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:55.250822 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:55.250822 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:55.250822 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 368/734] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:55.251355 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97516f4b-08d5-4361-b39a-d2a652f78219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:55.251506 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb3287-5d2f-46b3-bc43-00999f97cf5f None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:55.251639 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97516f4b-08d5-4361-b39a-d2a652f78219 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:55.251639 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97516f4b-08d5-4361-b39a-d2a652f78219 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:55.251639 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97516f4b-08d5-4361-b39a-d2a652f78219 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:55.264171 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97516f4b-08d5-4361-b39a-d2a652f78219 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:55.269372 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-97516f4b-08d5-4361-b39a-d2a652f78219 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 15:46:55.269372 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:55.269372 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:55.269372 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:55.269372 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:55.269372 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:55.269372 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:55.269372 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:55.269372 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:55.269372 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:55.269372 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:55.269372 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:55.269372 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:55.269372 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:55.269372 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:55.269372 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:55.271479 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:55.271479 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:55.271479 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:55.271479 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:55.271479 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:55.271479 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:55.271479 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:55.271479 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:55.271479 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:55.271479 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:55.271479 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:55.271479 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:55.271479 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:55.271479 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:55.271479 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:55.271479 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:55.272819 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:55.272819 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:55.272819 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:55.272819 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:55.272819 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:55.272819 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:55.272819 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:55.272819 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:55.272819 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:55.272819 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:55.272819 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 15:46:55.272819 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:55.272819 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 367/735] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 30 15:46:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:55.272819 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97516f4b-08d5-4361-b39a-d2a652f78219 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:55.347613 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:55.373042 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb3287-5d2f-46b3-bc43-00999f97cf5f None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:55.389018 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97516f4b-08d5-4361-b39a-d2a652f78219 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:55.409948 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef4178-2677-4885-b87b-c9bd6a8d63f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:55.410588 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef4178-2677-4885-b87b-c9bd6a8d63f4 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:55.410872 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef4178-2677-4885-b87b-c9bd6a8d63f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:55.411150 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef4178-2677-4885-b87b-c9bd6a8d63f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:55.421937 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ef4178-2677-4885-b87b-c9bd6a8d63f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:55.426050 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da87f2a-cfbe-4a1c-8a1f-6d49c0e3e551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:55.426652 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da87f2a-cfbe-4a1c-8a1f-6d49c0e3e551 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:55.426927 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da87f2a-cfbe-4a1c-8a1f-6d49c0e3e551 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:55.427173 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-92ef4178-2677-4885-b87b-c9bd6a8d63f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:46:55.427173 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:55.427173 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:55.427173 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:55.427173 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:55.427173 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:55.427173 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:55.427173 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:55.427173 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:55.427173 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:55.427173 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:55.427173 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:55.427173 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:55.427173 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:55.427173 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:55.427173 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:55.428057 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:55.428057 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:55.428057 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:55.428057 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:55.428057 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:55.428057 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:55.428057 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:55.428057 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:55.428057 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:55.428057 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:55.428057 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:55.428057 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:55.428057 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:55.428057 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:55.428057 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:55.428057 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:55.428910 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:55.428910 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:55.428910 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:55.428910 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:55.428910 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:55.428910 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:55.428910 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:55.428910 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:55.428910 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:55.428910 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:55.428910 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:46:55.428910 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:55.429552 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da87f2a-cfbe-4a1c-8a1f-6d49c0e3e551 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:55.429552 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da87f2a-cfbe-4a1c-8a1f-6d49c0e3e551 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:55.429552 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da87f2a-cfbe-4a1c-8a1f-6d49c0e3e551 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:55.429552 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da87f2a-cfbe-4a1c-8a1f-6d49c0e3e551 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:55.430329 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 369/736] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 30 15:46:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:55.430755 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef4178-2677-4885-b87b-c9bd6a8d63f4 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:55.451566 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 368/737] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:46:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:55.451566 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da87f2a-cfbe-4a1c-8a1f-6d49c0e3e551 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:55.451566 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:55.531775 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef4178-2677-4885-b87b-c9bd6a8d63f4 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:55.548971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da87f2a-cfbe-4a1c-8a1f-6d49c0e3e551 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:55.565505 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e8120-c976-4f2c-b4ab-e0f27b1a74ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:55.566112 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e8120-c976-4f2c-b4ab-e0f27b1a74ca None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:55.566394 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e8120-c976-4f2c-b4ab-e0f27b1a74ca None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:55.566669 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e8120-c976-4f2c-b4ab-e0f27b1a74ca None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:55.567342 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e8120-c976-4f2c-b4ab-e0f27b1a74ca None admin] RBAC: Adding query filter params (name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:55.567645 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e8120-c976-4f2c-b4ab-e0f27b1a74ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:55.569052 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e8120-c976-4f2c-b4ab-e0f27b1a74ca None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:55.571419 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:55.578246 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 370/738] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Aug 30 15:46:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:55.579035 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e8120-c976-4f2c-b4ab-e0f27b1a74ca None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:55.582279 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b4a7c-09ca-4880-a084-6a0809bedba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:55.582894 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b4a7c-09ca-4880-a084-6a0809bedba5 None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:55.583203 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b4a7c-09ca-4880-a084-6a0809bedba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:55.583482 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b4a7c-09ca-4880-a084-6a0809bedba5 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:55.584132 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b4a7c-09ca-4880-a084-6a0809bedba5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:55.585527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b4a7c-09ca-4880-a084-6a0809bedba5 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:55.602165 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 369/739] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Aug 30 15:46:55 2022] POST /identity/v3/services => generated 251 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:46:55.603304 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed53962-ffab-4ba4-80a4-cfeff9fca456 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:55.603592 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed53962-ffab-4ba4-80a4-cfeff9fca456 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:55.603868 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed53962-ffab-4ba4-80a4-cfeff9fca456 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:55.606077 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 370/740] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:55.606898 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed53962-ffab-4ba4-80a4-cfeff9fca456 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:55.683785 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:55.695747 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e8120-c976-4f2c-b4ab-e0f27b1a74ca None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:55.742981 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6ec4c-472a-447c-97da-302a4027c5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:55.743877 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6ec4c-472a-447c-97da-302a4027c5d1 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:55.744153 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6ec4c-472a-447c-97da-302a4027c5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:55.744919 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6ec4c-472a-447c-97da-302a4027c5d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:55.745592 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b6ec4c-472a-447c-97da-302a4027c5d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:55.746009 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b6ec4c-472a-447c-97da-302a4027c5d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:55.747428 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b6ec4c-472a-447c-97da-302a4027c5d1 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:55.753298 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed53962-ffab-4ba4-80a4-cfeff9fca456 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:55.757114 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 371/741] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:46:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:55.763071 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6ec4c-472a-447c-97da-302a4027c5d1 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:55.796569 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f66d655-292a-4922-9629-a2bd638bf5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:55.797641 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66d655-292a-4922-9629-a2bd638bf5cb None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:55.797919 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66d655-292a-4922-9629-a2bd638bf5cb None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:55.798188 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66d655-292a-4922-9629-a2bd638bf5cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:55.805979 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f66d655-292a-4922-9629-a2bd638bf5cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:55.807429 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f66d655-292a-4922-9629-a2bd638bf5cb None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:55.820162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-3f66d655-292a-4922-9629-a2bd638bf5cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:46:55.820162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:55.820162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:55.820162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:55.820162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:55.820162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:55.820162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:55.820162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:55.820162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:55.820162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:55.820162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:55.820162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:55.820162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 15:46:55.820162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 15:46:55.820162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 15:46:55.821117 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 15:46:55.821117 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:55.821117 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:55.821117 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:55.821117 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:55.821117 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:55.821117 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:55.821117 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:55.821117 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:55.821117 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:55.821117 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:55.821117 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:55.821117 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:55.821117 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:55.821117 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:55.821117 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:55.821117 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:55.821982 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 15:46:55.821982 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 15:46:55.821982 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 15:46:55.821982 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 15:46:55.821982 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 15:46:55.821982 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 15:46:55.821982 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:46:55.821982 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:55.821982 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 371/742] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:46:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:55.823150 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75cd8b-f7e6-40b2-b459-80e4f774b07d None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:55.823150 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75cd8b-f7e6-40b2-b459-80e4f774b07d None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:55.823308 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75cd8b-f7e6-40b2-b459-80e4f774b07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:55.834516 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:55.843058 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-ff75cd8b-f7e6-40b2-b459-80e4f774b07d None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:55.844356 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-ff75cd8b-f7e6-40b2-b459-80e4f774b07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:55.882692 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6ec4c-472a-447c-97da-302a4027c5d1 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:55.917235 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 372/743] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:55 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 15:46:55.924989 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75cd8b-f7e6-40b2-b459-80e4f774b07d None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:55.929980 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d8213-3d67-4521-a49f-ee0502d5d1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:55.931096 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d8213-3d67-4521-a49f-ee0502d5d1a0 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:55.931660 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d8213-3d67-4521-a49f-ee0502d5d1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:55.931946 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d8213-3d67-4521-a49f-ee0502d5d1a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:55.947532 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d8213-3d67-4521-a49f-ee0502d5d1a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:55.949602 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d8213-3d67-4521-a49f-ee0502d5d1a0 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:55.968766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-382d8213-3d67-4521-a49f-ee0502d5d1a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:55.968766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:55.968766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:55.968766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:55.968766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:55.968766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:55.968766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:55.968766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:55.968766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:55.968766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:55.968766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:55.968766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:55.968766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:55.968766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:55.968766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:55.968766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:55.969735 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:55.969735 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:55.969735 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:55.969735 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:55.969735 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:55.969735 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:55.969735 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:55.969735 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:55.969735 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:55.969735 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:55.969735 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:55.969735 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:55.969735 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:55.969735 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:55.969735 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:55.969735 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:55.969735 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:55.970613 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:55.970613 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:55.970613 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:55.970777 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:55.975182 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 372/744] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:55.976053 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d8213-3d67-4521-a49f-ee0502d5d1a0 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:56.028207 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75cd8b-f7e6-40b2-b459-80e4f774b07d None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:56.071173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e4679-6bb1-435f-b063-45850d13078c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:56.071821 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e4679-6bb1-435f-b063-45850d13078c None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:56.072113 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e4679-6bb1-435f-b063-45850d13078c None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:56.073118 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e4679-6bb1-435f-b063-45850d13078c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:56.087336 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1e4679-6bb1-435f-b063-45850d13078c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:56.089125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1e4679-6bb1-435f-b063-45850d13078c None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:56.099782 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d8213-3d67-4521-a49f-ee0502d5d1a0 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:56.110677 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:56.112807 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-ff1e4679-6bb1-435f-b063-45850d13078c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:56.112807 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:56.112807 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:56.112807 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:56.112807 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:56.112807 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:56.112807 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:56.112807 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:56.112807 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:56.112807 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:56.112807 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:56.112807 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:56.112807 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:56.112807 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:56.112807 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:56.112807 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:56.114612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:56.114612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:56.114612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:56.114612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:56.114612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:56.114612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:56.114612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:56.114612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:56.114612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:56.114612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:56.114612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:56.114612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:56.114612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:56.114612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:56.114612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:56.114612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:56.114612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:56.116467 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:56.116467 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:56.116467 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:56.119835 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 373/745] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:56.119835 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e4679-6bb1-435f-b063-45850d13078c None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:56.143827 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18911cea-a73c-4255-bd8d-cdc752dabf2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:56.144460 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18911cea-a73c-4255-bd8d-cdc752dabf2e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:56.144825 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18911cea-a73c-4255-bd8d-cdc752dabf2e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:56.145226 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18911cea-a73c-4255-bd8d-cdc752dabf2e None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:56.145987 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18911cea-a73c-4255-bd8d-cdc752dabf2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:56.146358 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18911cea-a73c-4255-bd8d-cdc752dabf2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:56.147910 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18911cea-a73c-4255-bd8d-cdc752dabf2e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:56.162204 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 373/746] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 30 15:46:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:56.165554 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18911cea-a73c-4255-bd8d-cdc752dabf2e None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:56.249328 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e4679-6bb1-435f-b063-45850d13078c None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:56.250842 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:56.280444 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18911cea-a73c-4255-bd8d-cdc752dabf2e None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:56.284838 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d1758-5f8d-46c7-831e-0ba40a4f847f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:56.285449 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d1758-5f8d-46c7-831e-0ba40a4f847f None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:56.285723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d1758-5f8d-46c7-831e-0ba40a4f847f None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:56.285987 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d1758-5f8d-46c7-831e-0ba40a4f847f None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:56.286625 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d1758-5f8d-46c7-831e-0ba40a4f847f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:56.286918 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d1758-5f8d-46c7-831e-0ba40a4f847f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:56.288259 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d1758-5f8d-46c7-831e-0ba40a4f847f None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:56.305674 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 374/747] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:56.305674 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d1758-5f8d-46c7-831e-0ba40a4f847f None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:56.329591 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a90e00-4447-4e83-8a4c-ef0d09d26115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:56.330212 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a90e00-4447-4e83-8a4c-ef0d09d26115 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:56.330468 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a90e00-4447-4e83-8a4c-ef0d09d26115 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:56.330733 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a90e00-4447-4e83-8a4c-ef0d09d26115 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:56.331369 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a90e00-4447-4e83-8a4c-ef0d09d26115 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:56.331693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a90e00-4447-4e83-8a4c-ef0d09d26115 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:56.333070 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a90e00-4447-4e83-8a4c-ef0d09d26115 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:56.345392 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 374/748] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:56.346112 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a90e00-4447-4e83-8a4c-ef0d09d26115 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:56.375109 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:56.410725 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d1758-5f8d-46c7-831e-0ba40a4f847f None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:56.445873 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c86ce-07fc-486b-b5fa-750ef9137606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:56.446646 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c86ce-07fc-486b-b5fa-750ef9137606 None admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:56.446928 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c86ce-07fc-486b-b5fa-750ef9137606 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:56.447203 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c86ce-07fc-486b-b5fa-750ef9137606 None admin] PATH_INFO: `/v3/projects/51f312b4cd8b449aa2971993f68de9af/users/ebc80bf891614fb895af33ca1ded6b9d/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:56.449738 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c86ce-07fc-486b-b5fa-750ef9137606 None admin] RBAC: Authorizing `identity:create_grant(project_id=51f312b4cd8b449aa2971993f68de9af, user_id=ebc80bf891614fb895af33ca1ded6b9d, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:56.451241 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c86ce-07fc-486b-b5fa-750ef9137606 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:56.454045 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a90e00-4447-4e83-8a4c-ef0d09d26115 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:56.464275 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 375/749] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 30 15:46:56 2022] PUT /identity/v3/projects/51f312b4cd8b449aa2971993f68de9af/users/ebc80bf891614fb895af33ca1ded6b9d/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:46:56.465913 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c86ce-07fc-486b-b5fa-750ef9137606 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:56.501734 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9f2bf-b0c4-4e0c-a58f-4cd9c13ac672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:56.502418 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:56.503964 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9f2bf-b0c4-4e0c-a58f-4cd9c13ac672 None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:56.504519 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9f2bf-b0c4-4e0c-a58f-4cd9c13ac672 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:56.505027 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9f2bf-b0c4-4e0c-a58f-4cd9c13ac672 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:56.505937 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9f2bf-b0c4-4e0c-a58f-4cd9c13ac672 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:56.507736 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9f2bf-b0c4-4e0c-a58f-4cd9c13ac672 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:56.536859 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 375/750] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Aug 30 15:46:56 2022] POST /identity/v3/services => generated 240 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:46:56.536859 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9f2bf-b0c4-4e0c-a58f-4cd9c13ac672 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:56.637684 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:56.661254 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c86ce-07fc-486b-b5fa-750ef9137606 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:56.662419 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9f2bf-b0c4-4e0c-a58f-4cd9c13ac672 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:56.702161 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd644cee-06ed-498f-8c7a-0973462b940f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:56.702378 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d6aa8-263e-40de-ad0a-91912bed5eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:56.702818 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd644cee-06ed-498f-8c7a-0973462b940f None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:56.703019 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d6aa8-263e-40de-ad0a-91912bed5eea None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:56.703142 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd644cee-06ed-498f-8c7a-0973462b940f None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:56.703357 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd644cee-06ed-498f-8c7a-0973462b940f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:56.703995 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d6aa8-263e-40de-ad0a-91912bed5eea None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:56.704523 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d6aa8-263e-40de-ad0a-91912bed5eea None admin] PATH_INFO: `/v3/users/swift` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:56.712635 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd644cee-06ed-498f-8c7a-0973462b940f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:56.714040 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d6aa8-263e-40de-ad0a-91912bed5eea None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:56.714315 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd644cee-06ed-498f-8c7a-0973462b940f None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:56.716987 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d6aa8-263e-40de-ad0a-91912bed5eea None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:56.729003 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-dd644cee-06ed-498f-8c7a-0973462b940f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 15:46:56.729003 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:56.729003 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:56.729003 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:56.729003 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:56.729003 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:56.729003 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:56.729003 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:56.729003 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:56.729003 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:56.729003 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:56.729003 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:56.729003 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 15:46:56.729003 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 15:46:56.729003 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 15:46:56.729003 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 15:46:56.729934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:56.729934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:56.729934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 15:46:56.729934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:46:56.729934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 15:46:56.729934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:46:56.729934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:56.729934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:56.729934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:56.729934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:56.729934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:56.729934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:56.729934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:56.729934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:56.729934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:56.729934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:56.729934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:56.729934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:56.730907 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:56.730907 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:56.730907 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 15:46:56.730907 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 15:46:56.730907 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 15:46:56.730907 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 15:46:56.730907 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 15:46:56.730907 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 15:46:56.730907 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 15:46:56.730907 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:56.730907 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 376/751] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Aug 30 15:46:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:56.733773 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-591d6aa8-263e-40de-ad0a-91912bed5eea None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 15:46:56.733773 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:56.733773 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:56.733773 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:56.733773 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:56.733773 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:56.733773 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:56.733773 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:56.733773 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:56.733773 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:56.733773 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:56.733773 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:56.733773 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 15:46:56.733773 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 15:46:56.733773 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 15:46:56.733773 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 15:46:56.734700 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:56.734700 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:56.734700 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 15:46:56.734700 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:46:56.734700 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 15:46:56.734700 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:46:56.734700 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:56.734700 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:56.734700 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:56.734700 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:56.734700 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:56.734700 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:56.734700 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:56.734700 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:56.734700 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:56.734700 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:56.734700 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:56.734700 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:56.735658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:56.735658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:56.735658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 15:46:56.735658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 15:46:56.735658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 15:46:56.735658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 15:46:56.735658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 15:46:56.735658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 15:46:56.735658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 15:46:56.735658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:56.736756 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd644cee-06ed-498f-8c7a-0973462b940f None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:56.738569 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 376/752] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 30 15:46:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:56.750255 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d6aa8-263e-40de-ad0a-91912bed5eea None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:56.837018 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:56.858798 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd644cee-06ed-498f-8c7a-0973462b940f None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:56.882650 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d6aa8-263e-40de-ad0a-91912bed5eea None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:56.895086 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ace61d-fcba-4a32-ae84-49e739b37270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:56.895395 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ace61d-fcba-4a32-ae84-49e739b37270 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:56.895673 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ace61d-fcba-4a32-ae84-49e739b37270 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:56.895948 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ace61d-fcba-4a32-ae84-49e739b37270 None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:56.896677 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ace61d-fcba-4a32-ae84-49e739b37270 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:56.897011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ace61d-fcba-4a32-ae84-49e739b37270 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:56.898450 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ace61d-fcba-4a32-ae84-49e739b37270 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:56.922471 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 377/753] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Aug 30 15:46:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:56.923699 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ace61d-fcba-4a32-ae84-49e739b37270 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:56.925785 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741ca65-8a8d-4288-bd84-d3bf0ad451c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:56.926744 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741ca65-8a8d-4288-bd84-d3bf0ad451c5 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:56.927248 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741ca65-8a8d-4288-bd84-d3bf0ad451c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:56.927770 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741ca65-8a8d-4288-bd84-d3bf0ad451c5 None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:56.928706 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a741ca65-8a8d-4288-bd84-d3bf0ad451c5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:56.929249 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a741ca65-8a8d-4288-bd84-d3bf0ad451c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:56.930909 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a741ca65-8a8d-4288-bd84-d3bf0ad451c5 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:56.954064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 377/754] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Aug 30 15:46:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:46:56.960901 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741ca65-8a8d-4288-bd84-d3bf0ad451c5 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:56.977141 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:57.066853 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ace61d-fcba-4a32-ae84-49e739b37270 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:57.095510 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741ca65-8a8d-4288-bd84-d3bf0ad451c5 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:57.140848 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c36be-43fe-4f03-a522-93039e81f6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:57.141477 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c36be-43fe-4f03-a522-93039e81f6cc None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:57.141757 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c36be-43fe-4f03-a522-93039e81f6cc None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:57.142023 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c36be-43fe-4f03-a522-93039e81f6cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:57.154997 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f6252-48f6-4993-85da-e7cb54e57c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:57.155679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f6252-48f6-4993-85da-e7cb54e57c36 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:57.155963 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f6252-48f6-4993-85da-e7cb54e57c36 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:57.156230 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f6252-48f6-4993-85da-e7cb54e57c36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:57.176515 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:57.262842 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c36be-43fe-4f03-a522-93039e81f6cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:57.264315 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c36be-43fe-4f03-a522-93039e81f6cc None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:57.266812 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:57.303263 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f6252-48f6-4993-85da-e7cb54e57c36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:57.304751 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f6252-48f6-4993-85da-e7cb54e57c36 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:57.431854 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 378/755] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:46:56 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 15:46:57.437677 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c36be-43fe-4f03-a522-93039e81f6cc None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:57.492978 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 378/756] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:46:56 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 15:46:57.501550 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f6252-48f6-4993-85da-e7cb54e57c36 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:57.571611 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c36be-43fe-4f03-a522-93039e81f6cc None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:57.573138 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:57.582923 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:57.612250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6be066-5563-4ee4-9467-e5beffe954cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:57.613025 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6be066-5563-4ee4-9467-e5beffe954cc None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:57.613317 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6be066-5563-4ee4-9467-e5beffe954cc None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:57.613576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6be066-5563-4ee4-9467-e5beffe954cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:57.624834 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6be066-5563-4ee4-9467-e5beffe954cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:57.626300 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6be066-5563-4ee4-9467-e5beffe954cc None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:57.642807 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-6e6be066-5563-4ee4-9467-e5beffe954cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:57.642807 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:57.642807 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:57.642807 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:57.642807 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:57.642807 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:57.642807 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:57.642807 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:57.642807 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:57.642807 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:57.642807 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:57.642807 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:57.642807 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:57.642807 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:57.642807 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:57.642807 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:57.643773 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:57.643773 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:57.643773 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:57.643773 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:57.643773 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:57.643773 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:57.643773 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:57.643773 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:57.643773 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:57.643773 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:57.643773 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:57.643773 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:57.643773 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:57.643773 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:57.643773 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:57.643773 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:57.643773 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:57.644659 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:57.644659 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:57.644659 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:57.644659 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 379/757] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:57.651326 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6be066-5563-4ee4-9467-e5beffe954cc None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:57.675435 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f6252-48f6-4993-85da-e7cb54e57c36 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:57.780544 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256abe54-e121-4d06-bc94-59449e28f81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:57.781243 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256abe54-e121-4d06-bc94-59449e28f81b None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:57.781519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256abe54-e121-4d06-bc94-59449e28f81b None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:57.781784 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256abe54-e121-4d06-bc94-59449e28f81b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:57.789933 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6be066-5563-4ee4-9467-e5beffe954cc None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:57.793433 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256abe54-e121-4d06-bc94-59449e28f81b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:57.794884 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256abe54-e121-4d06-bc94-59449e28f81b None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:57.810888 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-256abe54-e121-4d06-bc94-59449e28f81b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:57.810888 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:57.810888 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:57.810888 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:57.810888 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:57.810888 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:57.810888 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:57.810888 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:57.810888 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:57.810888 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:57.810888 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:57.810888 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:57.810888 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:57.810888 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:57.810888 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:57.810888 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:57.811836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:57.811836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:57.811836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:57.811836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:57.811836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:57.811836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:57.811836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:57.811836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:57.811836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:57.811836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:57.811836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:57.811836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:57.811836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:57.811836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:57.811836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:57.811836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:57.811836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:57.812711 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:57.812711 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:57.812711 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:57.816732 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 379/758] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:57.818176 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043adea-5b75-43dc-b271-c7fe22e88e07 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:57.818555 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043adea-5b75-43dc-b271-c7fe22e88e07 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:57.818833 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043adea-5b75-43dc-b271-c7fe22e88e07 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:57.820326 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 380/759] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:57.821154 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043adea-5b75-43dc-b271-c7fe22e88e07 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:57.831660 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9b1c1-4762-4175-97eb-7dfafc63dd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:57.832278 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9b1c1-4762-4175-97eb-7dfafc63dd01 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:57.832556 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9b1c1-4762-4175-97eb-7dfafc63dd01 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:57.832861 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9b1c1-4762-4175-97eb-7dfafc63dd01 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:57.833508 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9b1c1-4762-4175-97eb-7dfafc63dd01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:57.833810 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9b1c1-4762-4175-97eb-7dfafc63dd01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:57.835205 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9b1c1-4762-4175-97eb-7dfafc63dd01 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:57.856325 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 380/760] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:57.858322 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd7dd3-a024-4267-bf5f-6a2b7e9ef2a8 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:57.859057 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd7dd3-a024-4267-bf5f-6a2b7e9ef2a8 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:57.859559 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd7dd3-a024-4267-bf5f-6a2b7e9ef2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:57.887913 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-3fdd7dd3-a024-4267-bf5f-6a2b7e9ef2a8 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:57.890003 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-3fdd7dd3-a024-4267-bf5f-6a2b7e9ef2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:57.903189 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:57.946136 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:57.960339 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043adea-5b75-43dc-b271-c7fe22e88e07 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:57.985268 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 381/761] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:46:57.986311 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd7dd3-a024-4267-bf5f-6a2b7e9ef2a8 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:58.023907 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eee1e6-b2f1-4994-b860-f79c6542b039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:58.024575 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eee1e6-b2f1-4994-b860-f79c6542b039 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:58.024890 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eee1e6-b2f1-4994-b860-f79c6542b039 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:58.025161 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eee1e6-b2f1-4994-b860-f79c6542b039 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:58.025809 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eee1e6-b2f1-4994-b860-f79c6542b039 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:58.026109 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eee1e6-b2f1-4994-b860-f79c6542b039 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:58.027569 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eee1e6-b2f1-4994-b860-f79c6542b039 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:58.054235 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 381/762] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:58.059628 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eee1e6-b2f1-4994-b860-f79c6542b039 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:58.149307 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd7dd3-a024-4267-bf5f-6a2b7e9ef2a8 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:58.185396 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2acce0-a104-4cea-888e-6f3138c3e7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:58.186039 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2acce0-a104-4cea-888e-6f3138c3e7c7 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:58.186364 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2acce0-a104-4cea-888e-6f3138c3e7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:58.186640 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2acce0-a104-4cea-888e-6f3138c3e7c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:58.191696 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eee1e6-b2f1-4994-b860-f79c6542b039 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:58.193519 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2acce0-a104-4cea-888e-6f3138c3e7c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:58.195433 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2acce0-a104-4cea-888e-6f3138c3e7c7 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:58.206963 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-ce2acce0-a104-4cea-888e-6f3138c3e7c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:46:58.206963 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:58.206963 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:58.206963 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:58.206963 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:58.206963 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:58.206963 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:58.206963 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:58.206963 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:58.206963 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:58.206963 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:58.206963 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:58.206963 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 15:46:58.206963 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 15:46:58.206963 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 15:46:58.208004 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 15:46:58.208004 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:58.208004 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:58.208004 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:58.208004 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:58.208004 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:58.208004 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:58.208004 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:58.208004 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:58.208004 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:58.208004 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:58.208004 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:58.208004 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:58.208004 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:58.208004 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:58.208004 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:58.208004 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:58.208906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 15:46:58.208906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 15:46:58.208906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 15:46:58.208906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 15:46:58.208906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 15:46:58.208906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 15:46:58.208906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:46:58.208906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:58.213273 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 382/763] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:46:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:58.214965 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2acce0-a104-4cea-888e-6f3138c3e7c7 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:58.219098 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:58.237894 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00971c-a5ec-415c-8a08-d31a62fec9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:58.238860 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00971c-a5ec-415c-8a08-d31a62fec9a2 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:58.239310 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00971c-a5ec-415c-8a08-d31a62fec9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:58.239749 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00971c-a5ec-415c-8a08-d31a62fec9a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:58.248275 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00971c-a5ec-415c-8a08-d31a62fec9a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:58.249954 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00971c-a5ec-415c-8a08-d31a62fec9a2 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:58.262181 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-fd00971c-a5ec-415c-8a08-d31a62fec9a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:46:58.262181 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:58.262181 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:58.262181 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:58.262181 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:58.262181 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:58.262181 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:58.262181 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:58.262181 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:58.262181 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:58.262181 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:58.262181 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:58.262181 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 15:46:58.262181 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 15:46:58.262181 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 15:46:58.263089 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 15:46:58.263089 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:58.263089 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:58.263089 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:58.263089 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:58.263089 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:58.263089 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:58.263089 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:58.263089 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:58.263089 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:58.263089 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:58.263089 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:58.263089 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:58.263089 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:58.263089 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:58.263089 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:58.263089 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:58.263953 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 15:46:58.263953 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 15:46:58.263953 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 15:46:58.263953 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 15:46:58.263953 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 15:46:58.263953 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 15:46:58.263953 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:46:58.263953 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:58.266491 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 382/764] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:46:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 15:46:58.272501 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00971c-a5ec-415c-8a08-d31a62fec9a2 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:58.288262 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:58.324409 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2acce0-a104-4cea-888e-6f3138c3e7c7 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:58.361862 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369cdf1-7328-4a8e-859a-8d9bb7db4f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:58.362579 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369cdf1-7328-4a8e-859a-8d9bb7db4f5c None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:58.362925 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369cdf1-7328-4a8e-859a-8d9bb7db4f5c None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:58.363284 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369cdf1-7328-4a8e-859a-8d9bb7db4f5c None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:58.364054 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369cdf1-7328-4a8e-859a-8d9bb7db4f5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:58.364428 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369cdf1-7328-4a8e-859a-8d9bb7db4f5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:58.366096 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369cdf1-7328-4a8e-859a-8d9bb7db4f5c None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:58.383591 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 383/765] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 30 15:46:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:46:58.384357 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00971c-a5ec-415c-8a08-d31a62fec9a2 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:58.384905 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369cdf1-7328-4a8e-859a-8d9bb7db4f5c None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:58.422937 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63ec84-05bc-47c4-803b-1c90b39282cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:58.423878 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63ec84-05bc-47c4-803b-1c90b39282cb None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:58.424342 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63ec84-05bc-47c4-803b-1c90b39282cb None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:58.424805 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63ec84-05bc-47c4-803b-1c90b39282cb None admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:58.425666 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef63ec84-05bc-47c4-803b-1c90b39282cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:58.426137 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef63ec84-05bc-47c4-803b-1c90b39282cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:58.427866 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef63ec84-05bc-47c4-803b-1c90b39282cb None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:58.441502 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 383/766] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 30 15:46:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:46:58.442576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63ec84-05bc-47c4-803b-1c90b39282cb None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:58.451278 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:58.491615 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369cdf1-7328-4a8e-859a-8d9bb7db4f5c None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:58.527747 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:58.529195 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee73f4-4233-4759-8bf8-062d53654d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:58.529963 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee73f4-4233-4759-8bf8-062d53654d9a None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:58.530328 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee73f4-4233-4759-8bf8-062d53654d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:58.530668 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee73f4-4233-4759-8bf8-062d53654d9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:58.531466 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee73f4-4233-4759-8bf8-062d53654d9a None admin] RBAC: Adding query filter params (role.id=676938e69210499ca11ee75dd572d0dc, scope.project.id=51f312b4cd8b449aa2971993f68de9af, user.id=94765f224c734beabe83b4dc0c5e511f) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:58.531843 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee73f4-4233-4759-8bf8-062d53654d9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:58.533570 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee73f4-4233-4759-8bf8-062d53654d9a None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:58.546600 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 384/767] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:46:58 2022] GET /identity/v3/role_assignments?user.id=94765f224c734beabe83b4dc0c5e511f&scope.project.id=51f312b4cd8b449aa2971993f68de9af&role.id=676938e69210499ca11ee75dd572d0dc => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:58.547746 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee73f4-4233-4759-8bf8-062d53654d9a None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:58.568805 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63ec84-05bc-47c4-803b-1c90b39282cb None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:58.607633 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f9310-2901-43b4-9853-1b4fcc192bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:58.608661 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f9310-2901-43b4-9853-1b4fcc192bca None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:58.609168 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f9310-2901-43b4-9853-1b4fcc192bca None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:58.609652 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f9310-2901-43b4-9853-1b4fcc192bca None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:58.610440 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f9310-2901-43b4-9853-1b4fcc192bca None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:58.612173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f9310-2901-43b4-9853-1b4fcc192bca None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:58.622400 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-5b9f9310-2901-43b4-9853-1b4fcc192bca None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 15:46:58.622400 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:58.622400 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 15:46:58.622400 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 15:46:58.622400 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 15:46:58.622400 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 15:46:58.622400 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 15:46:58.622400 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:46:58.622400 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 15:46:58.622400 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:58.622400 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 15:46:58.622400 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:58.622400 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:58.622400 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:58.622400 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:58.622400 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:58.622400 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:58.623442 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:58.623442 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:58.623442 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:58.623442 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:58.623442 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:58.623442 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:58.623442 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 15:46:58.623442 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 15:46:58.623442 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 15:46:58.623442 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 15:46:58.623442 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:58.623442 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:58.623442 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:58.623442 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:58.623442 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:58.623442 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:58.624265 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:58.624265 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:58.624265 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:58.624265 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:58.624265 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:58.624265 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:58.624265 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:58.624265 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:58.624265 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:58.624265 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:58.624265 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 15:46:58.624265 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:46:58.624265 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 15:46:58.624265 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:58.627208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 384/768] 10.222.0.25 () {56 vars in 1129 bytes} [Tue Aug 30 15:46:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:58.633618 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f9310-2901-43b4-9853-1b4fcc192bca None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:58.707168 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee73f4-4233-4759-8bf8-062d53654d9a None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:58.751990 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:58.765961 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb62cc-8091-4d4a-ad77-a91bb32af20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:58.766594 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb62cc-8091-4d4a-ad77-a91bb32af20e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:58.766876 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb62cc-8091-4d4a-ad77-a91bb32af20e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:58.767150 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb62cc-8091-4d4a-ad77-a91bb32af20e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:58.768430 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb62cc-8091-4d4a-ad77-a91bb32af20e None admin] RBAC: Adding query filter params (role.id=c99e31de7c4c47c7b7b2c45c2771ca58, scope.project.id=51f312b4cd8b449aa2971993f68de9af, user.id=d7958b395d5e4f5da37927536b1856ae) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:58.768741 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb62cc-8091-4d4a-ad77-a91bb32af20e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:58.770416 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb62cc-8091-4d4a-ad77-a91bb32af20e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:58.779212 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 385/769] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:46:58 2022] GET /identity/v3/role_assignments?user.id=d7958b395d5e4f5da37927536b1856ae&scope.project.id=51f312b4cd8b449aa2971993f68de9af&role.id=c99e31de7c4c47c7b7b2c45c2771ca58 => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:58.780475 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f9310-2901-43b4-9853-1b4fcc192bca None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:58.780592 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa6b4f-5b3a-43c7-9ee8-fe385e87e92d None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:58.780953 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa6b4f-5b3a-43c7-9ee8-fe385e87e92d None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:58.781234 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa6b4f-5b3a-43c7-9ee8-fe385e87e92d None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:58.786886 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 386/770] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:58.788517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375db1b-e29d-4a20-b6af-9247617b61f3 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:58.788828 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375db1b-e29d-4a20-b6af-9247617b61f3 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:58.789102 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375db1b-e29d-4a20-b6af-9247617b61f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:58.814034 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-5375db1b-e29d-4a20-b6af-9247617b61f3 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:58.815406 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-5375db1b-e29d-4a20-b6af-9247617b61f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:58.825707 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941ba0f-cacf-4c50-8200-61507b408caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:58.826707 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941ba0f-cacf-4c50-8200-61507b408caf None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:58.827215 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941ba0f-cacf-4c50-8200-61507b408caf None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:58.827802 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941ba0f-cacf-4c50-8200-61507b408caf None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:58.828701 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941ba0f-cacf-4c50-8200-61507b408caf None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:58.829376 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941ba0f-cacf-4c50-8200-61507b408caf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:58.831009 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941ba0f-cacf-4c50-8200-61507b408caf None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:58.835054 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:58.839092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 385/771] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Aug 30 15:46:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:58.847577 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941ba0f-cacf-4c50-8200-61507b408caf None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:58.953917 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 387/772] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:46:58.988553 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941ba0f-cacf-4c50-8200-61507b408caf None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:59.024238 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa31df-e754-4f43-84bf-bf05ed26a7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:59.024770 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa31df-e754-4f43-84bf-bf05ed26a7ca None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:59.025070 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa31df-e754-4f43-84bf-bf05ed26a7ca None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:59.025338 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa31df-e754-4f43-84bf-bf05ed26a7ca None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:59.025974 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa31df-e754-4f43-84bf-bf05ed26a7ca None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:59.026271 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa31df-e754-4f43-84bf-bf05ed26a7ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:59.028294 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa31df-e754-4f43-84bf-bf05ed26a7ca None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:59.033808 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 386/773] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Aug 30 15:46:58 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:59.039367 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375db1b-e29d-4a20-b6af-9247617b61f3 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:59.150814 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375db1b-e29d-4a20-b6af-9247617b61f3 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:59.157140 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9890c2a-36e9-460c-99d0-941d05007a92 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:59.157423 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9890c2a-36e9-460c-99d0-941d05007a92 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:59.157692 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9890c2a-36e9-460c-99d0-941d05007a92 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:59.159375 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 387/774] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:46:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:46:59.164803 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1d0f0-aa4f-4230-b1f5-c67ca2a5723c None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:59.165084 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1d0f0-aa4f-4230-b1f5-c67ca2a5723c None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:59.165354 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1d0f0-aa4f-4230-b1f5-c67ca2a5723c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:59.184605 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:59.194494 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-c0c1d0f0-aa4f-4230-b1f5-c67ca2a5723c None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:46:59.196475 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c0c1d0f0-aa4f-4230-b1f5-c67ca2a5723c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:46:59.221772 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d186ac-5094-4752-a763-3ee81e7c98b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:59.222760 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d186ac-5094-4752-a763-3ee81e7c98b1 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:59.223269 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d186ac-5094-4752-a763-3ee81e7c98b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:59.223741 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d186ac-5094-4752-a763-3ee81e7c98b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:59.224657 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d186ac-5094-4752-a763-3ee81e7c98b1 None admin] RBAC: Adding query filter params (interface=public, service_id=14108d13871b454892f6e2fe231b8b24, region_id=RegionOne) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:59.225199 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d186ac-5094-4752-a763-3ee81e7c98b1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:59.226776 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d186ac-5094-4752-a763-3ee81e7c98b1 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:59.242867 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 388/775] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Aug 30 15:46:59 2022] GET /identity/v3/endpoints?service_id=14108d13871b454892f6e2fe231b8b24&interface=public®ion_id=RegionOne => generated 194 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:46:59.248510 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d186ac-5094-4752-a763-3ee81e7c98b1 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:59.317425 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:59.321773 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 388/776] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:46:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:46:59.323318 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1d0f0-aa4f-4230-b1f5-c67ca2a5723c None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:59.440610 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1d0f0-aa4f-4230-b1f5-c67ca2a5723c None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:59.444907 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d186ac-5094-4752-a763-3ee81e7c98b1 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:59.489381 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207df8c3-c703-4bb0-a7f4-eaaafd0a9a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:59.490617 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207df8c3-c703-4bb0-a7f4-eaaafd0a9a04 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:59.491122 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207df8c3-c703-4bb0-a7f4-eaaafd0a9a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:59.491766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207df8c3-c703-4bb0-a7f4-eaaafd0a9a04 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:59.492609 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207df8c3-c703-4bb0-a7f4-eaaafd0a9a04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:59.494799 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207df8c3-c703-4bb0-a7f4-eaaafd0a9a04 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:59.501401 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 389/777] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Aug 30 15:46:59 2022] GET /identity/v3/services => generated 772 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:46:59.530606 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1d487-3f4d-4b37-bf92-caf4dc3e9a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:59.531281 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1d487-3f4d-4b37-bf92-caf4dc3e9a88 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:59.531574 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1d487-3f4d-4b37-bf92-caf4dc3e9a88 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:59.531851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1d487-3f4d-4b37-bf92-caf4dc3e9a88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:59.553925 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c1d487-3f4d-4b37-bf92-caf4dc3e9a88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:46:59.559530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-31c1d487-3f4d-4b37-bf92-caf4dc3e9a88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:46:59.559530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:59.559530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:59.559530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:59.559530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:59.559530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:59.559530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:59.559530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:59.559530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:59.559530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:59.559530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:59.559530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:59.559530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:46:59.559530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:46:59.559530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:46:59.559530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:46:59.560495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:46:59.560495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:46:59.560495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:46:59.560495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:46:59.560495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:59.560495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:59.560495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:59.560495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:59.560495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:59.560495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:59.560495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:59.560495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:59.560495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:59.560495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:59.560495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:59.560495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:59.561895 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:59.561895 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:59.561895 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:59.561895 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:59.561895 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:46:59.561895 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:46:59.561895 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:46:59.561895 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:46:59.561895 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:46:59.561895 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:46:59.561895 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:46:59.561895 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:59.561895 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 389/778] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 30 15:46:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:59.569279 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207df8c3-c703-4bb0-a7f4-eaaafd0a9a04 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:59.628909 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:59.650229 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1d487-3f4d-4b37-bf92-caf4dc3e9a88 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:59.684460 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207df8c3-c703-4bb0-a7f4-eaaafd0a9a04 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:59.720342 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:59.724121 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be69c0e-cc1d-4afe-a6ac-16df2641e56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:59.724745 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be69c0e-cc1d-4afe-a6ac-16df2641e56f None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:59.725057 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be69c0e-cc1d-4afe-a6ac-16df2641e56f None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:59.732941 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be69c0e-cc1d-4afe-a6ac-16df2641e56f None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:59.732941 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be69c0e-cc1d-4afe-a6ac-16df2641e56f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:46:59.732941 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be69c0e-cc1d-4afe-a6ac-16df2641e56f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:59.732941 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be69c0e-cc1d-4afe-a6ac-16df2641e56f None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:59.738797 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 390/779] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:46:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:46:59.745883 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be69c0e-cc1d-4afe-a6ac-16df2641e56f None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:59.812069 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1d487-3f4d-4b37-bf92-caf4dc3e9a88 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:59.851902 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be69c0e-cc1d-4afe-a6ac-16df2641e56f None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:46:59.877789 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:46:59.886129 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5317f39-7348-4820-b86f-c8d5e3ead4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:59.887490 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5317f39-7348-4820-b86f-c8d5e3ead4a6 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:59.888665 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5317f39-7348-4820-b86f-c8d5e3ead4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:59.889683 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5317f39-7348-4820-b86f-c8d5e3ead4a6 None admin] PATH_INFO: `/v3/services/network` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:59.890916 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5317f39-7348-4820-b86f-c8d5e3ead4a6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:59.894336 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5317f39-7348-4820-b86f-c8d5e3ead4a6 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:59.910805 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-d5317f39-7348-4820-b86f-c8d5e3ead4a6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 15:46:59.910805 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:59.910805 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 15:46:59.910805 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 15:46:59.910805 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 15:46:59.910805 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 15:46:59.910805 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 15:46:59.910805 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:46:59.910805 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 15:46:59.910805 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:59.910805 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 15:46:59.910805 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:59.910805 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:59.910805 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:59.910805 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:59.910805 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:59.910805 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:59.911829 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:59.911829 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:59.911829 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:59.911829 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:59.911829 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:59.911829 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:59.911829 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 15:46:59.911829 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 15:46:59.911829 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 15:46:59.911829 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 15:46:59.911829 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:59.911829 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:59.911829 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:59.911829 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:59.911829 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:59.911829 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:59.912652 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:59.912652 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:59.912652 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:59.912652 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:59.912652 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:59.912652 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:59.912652 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:59.912652 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:59.912652 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:59.912652 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:59.912652 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 15:46:59.912652 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:46:59.912652 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 15:46:59.912652 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:46:59.915520 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae78764-1572-4034-9ed0-eea90ba6d0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:46:59.916447 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae78764-1572-4034-9ed0-eea90ba6d0e5 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:46:59.916989 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae78764-1572-4034-9ed0-eea90ba6d0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:46:59.918100 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae78764-1572-4034-9ed0-eea90ba6d0e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:46:59.919947 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 390/780] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:46:59 2022] GET /identity/v3/services/network => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:46:59.926814 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5317f39-7348-4820-b86f-c8d5e3ead4a6 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:46:59.940652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae78764-1572-4034-9ed0-eea90ba6d0e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:46:59.944523 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae78764-1572-4034-9ed0-eea90ba6d0e5 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:46:59.978986 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-5ae78764-1572-4034-9ed0-eea90ba6d0e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:59.978986 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:46:59.978986 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:46:59.978986 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:46:59.978986 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:46:59.978986 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:46:59.978986 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:46:59.978986 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:46:59.978986 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:46:59.978986 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:46:59.978986 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:46:59.978986 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:46:59.978986 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:46:59.978986 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:46:59.978986 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:46:59.978986 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:46:59.980587 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:46:59.980587 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:46:59.980587 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:46:59.980587 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:46:59.980587 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:46:59.980587 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:46:59.980587 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:46:59.980587 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:46:59.980587 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:46:59.980587 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:46:59.980587 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:46:59.980587 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:46:59.980587 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:46:59.980587 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:46:59.980587 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:46:59.980587 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:46:59.980587 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:46:59.982042 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:46:59.982042 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:46:59.982042 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:46:59.988593 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 391/781] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:46:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:00.002588 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae78764-1572-4034-9ed0-eea90ba6d0e5 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:00.140011 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae78764-1572-4034-9ed0-eea90ba6d0e5 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:00.174859 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5317f39-7348-4820-b86f-c8d5e3ead4a6 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:00.180253 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c3742-1b87-4c1a-87bc-f8ca5394bcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:00.180913 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c3742-1b87-4c1a-87bc-f8ca5394bcf9 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:00.182193 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c3742-1b87-4c1a-87bc-f8ca5394bcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:00.182469 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c3742-1b87-4c1a-87bc-f8ca5394bcf9 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:00.188426 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c3742-1b87-4c1a-87bc-f8ca5394bcf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:00.188746 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c3742-1b87-4c1a-87bc-f8ca5394bcf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:00.190328 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c3742-1b87-4c1a-87bc-f8ca5394bcf9 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:00.213230 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:00.215797 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 392/782] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:47:00.221228 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c3742-1b87-4c1a-87bc-f8ca5394bcf9 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:00.252146 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e260061-8104-49fa-92d1-90463db1412a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:00.252768 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e260061-8104-49fa-92d1-90463db1412a None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:00.253077 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e260061-8104-49fa-92d1-90463db1412a None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:00.253344 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e260061-8104-49fa-92d1-90463db1412a None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:00.255800 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e260061-8104-49fa-92d1-90463db1412a None admin] RBAC: Adding query filter params (name=network) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:00.256109 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e260061-8104-49fa-92d1-90463db1412a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:00.257509 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e260061-8104-49fa-92d1-90463db1412a None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:00.265276 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:00.279178 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 391/783] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Aug 30 15:46:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:00.294434 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e260061-8104-49fa-92d1-90463db1412a None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:00.384834 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c3742-1b87-4c1a-87bc-f8ca5394bcf9 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:00.432666 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e260061-8104-49fa-92d1-90463db1412a None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:00.476132 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44005d54-9763-4a07-87ee-0e6f96758b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:00.476859 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44005d54-9763-4a07-87ee-0e6f96758b85 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:00.477157 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44005d54-9763-4a07-87ee-0e6f96758b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:00.477453 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44005d54-9763-4a07-87ee-0e6f96758b85 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:00.481493 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a41de-ee5a-4daf-a715-baea874df3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:00.482125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a41de-ee5a-4daf-a715-baea874df3b7 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:00.482411 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a41de-ee5a-4daf-a715-baea874df3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:00.482691 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a41de-ee5a-4daf-a715-baea874df3b7 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:00.483338 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a41de-ee5a-4daf-a715-baea874df3b7 None admin] RBAC: Adding query filter params (type=network) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:00.483643 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a41de-ee5a-4daf-a715-baea874df3b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:00.485054 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a41de-ee5a-4daf-a715-baea874df3b7 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:00.485535 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44005d54-9763-4a07-87ee-0e6f96758b85 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:00.486981 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44005d54-9763-4a07-87ee-0e6f96758b85 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:00.490406 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 392/784] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Aug 30 15:47:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:00.497261 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a41de-ee5a-4daf-a715-baea874df3b7 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:00.499576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-44005d54-9763-4a07-87ee-0e6f96758b85 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 15:47:00.499576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:00.499576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:00.499576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:00.499576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:00.499576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:00.499576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:00.499576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:00.499576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:00.499576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:00.499576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:00.499576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:00.499576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 15:47:00.499576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 15:47:00.499576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 15:47:00.499576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 15:47:00.500487 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:00.500487 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:00.500487 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 15:47:00.500487 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:47:00.500487 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 15:47:00.500487 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:47:00.500487 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:00.500487 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:00.500487 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:00.500487 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:00.500487 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:00.500487 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:00.500487 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:00.500487 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:00.500487 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:00.500487 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:00.500487 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:00.500487 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:00.501807 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:00.501807 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:00.501807 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 15:47:00.501807 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 15:47:00.501807 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 15:47:00.501807 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 15:47:00.501807 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 15:47:00.501807 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 15:47:00.501807 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 15:47:00.501807 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:00.501807 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 393/785] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Aug 30 15:47:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:00.507629 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44005d54-9763-4a07-87ee-0e6f96758b85 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:00.584444 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:00.604373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:00.628432 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44005d54-9763-4a07-87ee-0e6f96758b85 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:00.695306 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a41de-ee5a-4daf-a715-baea874df3b7 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:00.697803 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5110e5-3adc-49e3-8078-2c4c164b11ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:00.698432 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5110e5-3adc-49e3-8078-2c4c164b11ca None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:00.699264 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5110e5-3adc-49e3-8078-2c4c164b11ca None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:00.699541 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5110e5-3adc-49e3-8078-2c4c164b11ca None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:00.700297 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5110e5-3adc-49e3-8078-2c4c164b11ca None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:00.700602 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5110e5-3adc-49e3-8078-2c4c164b11ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:00.702086 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5110e5-3adc-49e3-8078-2c4c164b11ca None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:00.729767 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 394/786] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Aug 30 15:47:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:47:00.737525 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5110e5-3adc-49e3-8078-2c4c164b11ca None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:00.768367 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea86bd-488b-467e-9b67-45a078aa6a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:00.770026 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea86bd-488b-467e-9b67-45a078aa6a1b None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:00.770307 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea86bd-488b-467e-9b67-45a078aa6a1b None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:00.771430 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea86bd-488b-467e-9b67-45a078aa6a1b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:00.772985 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ea86bd-488b-467e-9b67-45a078aa6a1b None admin] RBAC: Adding query filter params (interface=public, service_id=acc9904912054a619f86c1f10cd24cbd, region_id=RegionOne) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:00.773303 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ea86bd-488b-467e-9b67-45a078aa6a1b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:00.774939 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ea86bd-488b-467e-9b67-45a078aa6a1b None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:00.793444 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 393/787] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Aug 30 15:47:00 2022] GET /identity/v3/endpoints?service_id=acc9904912054a619f86c1f10cd24cbd&interface=public®ion_id=RegionOne => generated 194 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:00.797900 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea86bd-488b-467e-9b67-45a078aa6a1b None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:00.903307 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea86bd-488b-467e-9b67-45a078aa6a1b None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:00.913824 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:00.940441 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5110e5-3adc-49e3-8078-2c4c164b11ca None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:00.961739 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c47fc6-5f6d-4960-b1d9-ce4e34f86235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:00.962279 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c47fc6-5f6d-4960-b1d9-ce4e34f86235 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:00.962562 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c47fc6-5f6d-4960-b1d9-ce4e34f86235 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:00.962841 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c47fc6-5f6d-4960-b1d9-ce4e34f86235 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:00.963452 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c47fc6-5f6d-4960-b1d9-ce4e34f86235 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:00.965141 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c47fc6-5f6d-4960-b1d9-ce4e34f86235 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:00.975238 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 394/788] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Aug 30 15:47:00 2022] GET /identity/v3/services => generated 772 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:00.976449 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b1653-bdf0-4875-80ee-ae7057da59e4 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:00.976734 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b1653-bdf0-4875-80ee-ae7057da59e4 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:00.977037 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b1653-bdf0-4875-80ee-ae7057da59e4 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:00.978514 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 395/789] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:47:00.988273 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d81dea-1d89-4433-85d9-c18730bd411c None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:00.988611 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d81dea-1d89-4433-85d9-c18730bd411c None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:00.988859 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d81dea-1d89-4433-85d9-c18730bd411c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:01.023372 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-d9d81dea-1d89-4433-85d9-c18730bd411c None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:01.024615 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-d9d81dea-1d89-4433-85d9-c18730bd411c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:01.026224 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13a568-face-43ae-b64d-c0b34d38a47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:01.027491 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13a568-face-43ae-b64d-c0b34d38a47f None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:01.027909 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13a568-face-43ae-b64d-c0b34d38a47f None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:01.028194 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13a568-face-43ae-b64d-c0b34d38a47f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:01.054905 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:01.127249 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13a568-face-43ae-b64d-c0b34d38a47f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:01.128735 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13a568-face-43ae-b64d-c0b34d38a47f None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:01.173217 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 396/790] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 15:47:01.181861 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66401819-15ac-4920-bd48-33043e42da07 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:01.182150 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66401819-15ac-4920-bd48-33043e42da07 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:01.182429 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66401819-15ac-4920-bd48-33043e42da07 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:01.188220 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 397/791] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 15:47:01.189763 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e36bf-0cb1-4e3d-8fa5-b4a8ad208101 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:01.190050 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e36bf-0cb1-4e3d-8fa5-b4a8ad208101 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:01.190327 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e36bf-0cb1-4e3d-8fa5-b4a8ad208101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:01.209304 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-ef7e36bf-0cb1-4e3d-8fa5-b4a8ad208101 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:01.210500 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-ef7e36bf-0cb1-4e3d-8fa5-b4a8ad208101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:01.254808 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 395/792] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:47:00 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 15:47:01.261899 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13a568-face-43ae-b64d-c0b34d38a47f None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:01.288143 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 398/793] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 15:47:01.333210 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:01.402785 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13a568-face-43ae-b64d-c0b34d38a47f None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:01.446656 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85165982-4481-4380-998c-28d8bba8839c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:01.447296 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85165982-4481-4380-998c-28d8bba8839c None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:01.447575 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85165982-4481-4380-998c-28d8bba8839c None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:01.447850 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85165982-4481-4380-998c-28d8bba8839c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:01.461642 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85165982-4481-4380-998c-28d8bba8839c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:01.463104 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85165982-4481-4380-998c-28d8bba8839c None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:01.483445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-85165982-4481-4380-998c-28d8bba8839c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:47:01.483445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:01.483445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:01.483445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:01.483445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:01.483445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:01.483445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:01.483445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:01.483445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:01.483445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:01.483445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:01.483445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:01.483445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:47:01.483445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:47:01.483445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:47:01.483445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:47:01.484418 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:01.484418 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:01.484418 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:01.484418 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:01.484418 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:01.484418 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:01.484418 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:01.484418 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:01.484418 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:01.484418 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:01.484418 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:01.484418 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:01.484418 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:01.484418 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:01.484418 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:01.484418 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:01.484418 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:47:01.485332 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:47:01.485332 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:47:01.485332 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:01.485904 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 396/794] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:47:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:01.490204 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e36bf-0cb1-4e3d-8fa5-b4a8ad208101 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:01.532655 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:01.617965 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e36bf-0cb1-4e3d-8fa5-b4a8ad208101 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:01.635514 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85165982-4481-4380-998c-28d8bba8839c None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:01.657547 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b5f6d-7fcd-4ce3-b118-e4d2718c6349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:01.658165 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b5f6d-7fcd-4ce3-b118-e4d2718c6349 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:01.658449 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b5f6d-7fcd-4ce3-b118-e4d2718c6349 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:01.659165 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b5f6d-7fcd-4ce3-b118-e4d2718c6349 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:01.659824 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b5f6d-7fcd-4ce3-b118-e4d2718c6349 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:01.660423 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b5f6d-7fcd-4ce3-b118-e4d2718c6349 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:01.662021 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b5f6d-7fcd-4ce3-b118-e4d2718c6349 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:01.678627 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 399/795] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:47:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:01.679485 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b5f6d-7fcd-4ce3-b118-e4d2718c6349 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:01.735741 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:01.742608 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85165982-4481-4380-998c-28d8bba8839c None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:01.779264 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b56c1-9913-4a3e-9a48-239846e5335c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:01.780063 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b56c1-9913-4a3e-9a48-239846e5335c None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:01.780441 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b56c1-9913-4a3e-9a48-239846e5335c None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:01.781167 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b56c1-9913-4a3e-9a48-239846e5335c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:01.786282 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:01.791897 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b56c1-9913-4a3e-9a48-239846e5335c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:47:01.794822 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b5f6d-7fcd-4ce3-b118-e4d2718c6349 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:01.798941 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-603b56c1-9913-4a3e-9a48-239846e5335c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:47:01.798941 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:01.798941 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:01.798941 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:01.798941 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:01.798941 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:01.798941 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:01.798941 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:01.798941 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:01.798941 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:01.798941 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:01.798941 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:01.798941 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:47:01.798941 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:47:01.798941 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:47:01.798941 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:47:01.799893 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:47:01.799893 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:47:01.799893 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:47:01.799893 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:47:01.799893 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:01.799893 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:01.799893 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:01.799893 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:01.799893 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:01.799893 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:01.799893 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:01.799893 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:01.799893 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:01.799893 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:01.799893 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:01.799893 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:01.805851 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:01.805851 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:01.805851 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:01.805851 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:01.805851 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:47:01.805851 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:47:01.805851 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:47:01.805851 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:47:01.805851 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:47:01.805851 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:47:01.805851 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:47:01.805851 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:01.805851 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 397/796] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 30 15:47:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:01.805851 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b56c1-9913-4a3e-9a48-239846e5335c None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:01.830349 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7be16-b8fd-44e6-96f8-33fdd9c874a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:01.830988 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7be16-b8fd-44e6-96f8-33fdd9c874a2 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:01.831269 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7be16-b8fd-44e6-96f8-33fdd9c874a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:01.831545 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7be16-b8fd-44e6-96f8-33fdd9c874a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:01.843564 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd7be16-b8fd-44e6-96f8-33fdd9c874a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:47:01.849208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-1dd7be16-b8fd-44e6-96f8-33fdd9c874a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 15:47:01.849208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:01.849208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:01.849208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:01.849208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:01.849208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:01.849208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:01.849208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:01.849208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:01.849208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:01.849208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:01.849208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:01.849208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:47:01.849208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:47:01.849208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:47:01.849208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:47:01.850142 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:47:01.850142 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:47:01.850142 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:47:01.850142 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:47:01.850142 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:01.850142 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:01.850142 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:01.850142 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:01.850142 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:01.850142 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:01.850142 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:01.850142 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:01.850142 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:01.850142 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:01.850142 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:01.850142 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:01.850980 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:01.850980 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:01.850980 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:01.850980 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:01.850980 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:47:01.850980 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:47:01.850980 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:47:01.850980 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:47:01.850980 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:47:01.850980 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:47:01.850980 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 15:47:01.850980 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:01.850980 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 400/797] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 30 15:47:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:01.851649 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a31a4-8313-467e-9aef-088413c5f043 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:01.852512 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a31a4-8313-467e-9aef-088413c5f043 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:01.852512 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a31a4-8313-467e-9aef-088413c5f043 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:01.856012 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 401/798] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:47:01.857413 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a31a4-8313-467e-9aef-088413c5f043 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:01.918247 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b56c1-9913-4a3e-9a48-239846e5335c None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:01.954222 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5929b01-f03a-4d75-9472-1c4fdbb50aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:01.954876 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5929b01-f03a-4d75-9472-1c4fdbb50aa9 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:01.955119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5929b01-f03a-4d75-9472-1c4fdbb50aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:01.955394 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5929b01-f03a-4d75-9472-1c4fdbb50aa9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:01.962486 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5929b01-f03a-4d75-9472-1c4fdbb50aa9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:01.963930 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5929b01-f03a-4d75-9472-1c4fdbb50aa9 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:01.964188 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a31a4-8313-467e-9aef-088413c5f043 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:01.976587 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-d5929b01-f03a-4d75-9472-1c4fdbb50aa9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:47:01.976587 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:01.976587 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:01.976587 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:01.976587 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:01.976587 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:01.976587 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:01.976587 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:01.976587 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:01.976587 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:01.976587 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:01.976587 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:01.976587 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 15:47:01.976587 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 15:47:01.976587 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 15:47:01.977498 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 15:47:01.977498 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:01.977498 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:01.977498 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:01.977498 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:01.977498 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:01.977498 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:01.977498 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:01.977498 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:01.977498 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:01.977498 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:01.977498 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:01.977498 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:01.977498 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:01.977498 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:01.977498 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:01.977498 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:01.978467 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 15:47:01.978467 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 15:47:01.978467 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 15:47:01.978467 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 15:47:01.978467 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 15:47:01.978467 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 15:47:01.978467 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:47:01.978467 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:01.978467 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 398/799] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:47:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:01.978975 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5929b01-f03a-4d75-9472-1c4fdbb50aa9 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:01.996584 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:02.006886 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d31e8d-690c-4122-8ccc-11e58bdff60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:02.007491 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d31e8d-690c-4122-8ccc-11e58bdff60f None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:02.007767 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d31e8d-690c-4122-8ccc-11e58bdff60f None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:02.008035 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d31e8d-690c-4122-8ccc-11e58bdff60f None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:02.008694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d31e8d-690c-4122-8ccc-11e58bdff60f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:02.009020 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d31e8d-690c-4122-8ccc-11e58bdff60f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:02.010385 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d31e8d-690c-4122-8ccc-11e58bdff60f None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:02.019504 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 402/800] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:47:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:02.020645 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5ebe3-6324-435c-86e0-f9fe20c11c12 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:02.020954 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5ebe3-6324-435c-86e0-f9fe20c11c12 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:02.021226 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5ebe3-6324-435c-86e0-f9fe20c11c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:02.093160 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5929b01-f03a-4d75-9472-1c4fdbb50aa9 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:02.130274 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01436a24-e538-4d13-9253-c726ac7c6e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:02.130893 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01436a24-e538-4d13-9253-c726ac7c6e0b None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:02.131173 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01436a24-e538-4d13-9253-c726ac7c6e0b None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:02.131445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01436a24-e538-4d13-9253-c726ac7c6e0b None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:02.132127 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01436a24-e538-4d13-9253-c726ac7c6e0b None admin] RBAC: Adding query filter params (name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:02.132428 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01436a24-e538-4d13-9253-c726ac7c6e0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:02.133865 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01436a24-e538-4d13-9253-c726ac7c6e0b None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:02.148085 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 399/801] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Aug 30 15:47:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:02.148085 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01436a24-e538-4d13-9253-c726ac7c6e0b None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:02.155181 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-40f5ebe3-6324-435c-86e0-f9fe20c11c12 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:02.156363 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-40f5ebe3-6324-435c-86e0-f9fe20c11c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:02.168191 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:02.234796 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:02.239352 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 403/802] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:47:02.240742 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5ebe3-6324-435c-86e0-f9fe20c11c12 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:02.258575 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01436a24-e538-4d13-9253-c726ac7c6e0b None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:02.296839 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d9346-c1de-4d20-827f-c82408daf174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:02.297588 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d9346-c1de-4d20-827f-c82408daf174 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:02.297936 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d9346-c1de-4d20-827f-c82408daf174 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:02.298272 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d9346-c1de-4d20-827f-c82408daf174 None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:02.299030 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d9346-c1de-4d20-827f-c82408daf174 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:02.299399 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d9346-c1de-4d20-827f-c82408daf174 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:02.301015 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d9346-c1de-4d20-827f-c82408daf174 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:02.319932 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 400/803] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 30 15:47:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:02.320757 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d9346-c1de-4d20-827f-c82408daf174 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:02.381742 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5ebe3-6324-435c-86e0-f9fe20c11c12 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:02.423548 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380e776-5ced-4b78-aca9-f4360532d3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:02.424308 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380e776-5ced-4b78-aca9-f4360532d3d3 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:02.424681 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380e776-5ced-4b78-aca9-f4360532d3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:02.425069 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380e776-5ced-4b78-aca9-f4360532d3d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:02.432618 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d9346-c1de-4d20-827f-c82408daf174 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:02.436167 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5380e776-5ced-4b78-aca9-f4360532d3d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:02.437739 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5380e776-5ced-4b78-aca9-f4360532d3d3 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:02.446608 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:02.455822 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-5380e776-5ced-4b78-aca9-f4360532d3d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:47:02.455822 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:02.455822 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:02.455822 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:02.455822 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:02.455822 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:02.455822 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:02.455822 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:02.455822 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:02.455822 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:02.455822 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:02.455822 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:02.455822 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:47:02.455822 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:47:02.455822 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:47:02.455822 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:47:02.457011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:02.457011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:02.457011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:02.457011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:02.457011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:02.457011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:02.457011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:02.457011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:02.457011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:02.457011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:02.457011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:02.457011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:02.457011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:02.457011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:02.457011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:02.457011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:02.457011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:47:02.458111 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:47:02.458111 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:47:02.458111 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:02.463418 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 404/804] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:47:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:02.463418 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380e776-5ced-4b78-aca9-f4360532d3d3 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:02.493982 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66c0a2-9b3d-413d-a054-bd918407a0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:02.495280 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66c0a2-9b3d-413d-a054-bd918407a0a7 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:02.496590 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66c0a2-9b3d-413d-a054-bd918407a0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:02.497048 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66c0a2-9b3d-413d-a054-bd918407a0a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:02.501166 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:02.513016 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d66c0a2-9b3d-413d-a054-bd918407a0a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:02.515496 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d66c0a2-9b3d-413d-a054-bd918407a0a7 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:02.535840 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-2d66c0a2-9b3d-413d-a054-bd918407a0a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:47:02.535840 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:02.535840 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:02.535840 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:02.535840 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:02.535840 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:02.535840 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:02.535840 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:02.535840 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:02.535840 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:02.535840 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:02.535840 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:02.535840 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:47:02.535840 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:47:02.535840 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:47:02.535840 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:47:02.537050 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:02.537050 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:02.537050 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:02.537050 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:02.537050 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:02.537050 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:02.537050 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:02.537050 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:02.537050 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:02.537050 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:02.537050 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:02.537050 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:02.537050 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:02.537050 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:02.537050 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:02.537050 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:02.537050 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:47:02.538180 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:47:02.538180 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:47:02.538180 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:02.544550 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 401/805] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:47:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:02.544550 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66c0a2-9b3d-413d-a054-bd918407a0a7 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:02.580730 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380e776-5ced-4b78-aca9-f4360532d3d3 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:02.619065 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8adc03d-51ef-4ec0-9ca6-5471f0601afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:02.619674 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adc03d-51ef-4ec0-9ca6-5471f0601afb None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:02.619987 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adc03d-51ef-4ec0-9ca6-5471f0601afb None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:02.620225 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adc03d-51ef-4ec0-9ca6-5471f0601afb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:02.621518 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8adc03d-51ef-4ec0-9ca6-5471f0601afb None admin] RBAC: Adding query filter params (role.id=676938e69210499ca11ee75dd572d0dc, scope.project.id=51f312b4cd8b449aa2971993f68de9af, user.id=ebc80bf891614fb895af33ca1ded6b9d) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:02.622509 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8adc03d-51ef-4ec0-9ca6-5471f0601afb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:02.623242 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8adc03d-51ef-4ec0-9ca6-5471f0601afb None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:02.629284 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 405/806] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:47:02 2022] GET /identity/v3/role_assignments?user.id=ebc80bf891614fb895af33ca1ded6b9d&scope.project.id=51f312b4cd8b449aa2971993f68de9af&role.id=676938e69210499ca11ee75dd572d0dc => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:02.629995 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8adc03d-51ef-4ec0-9ca6-5471f0601afb None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:02.675498 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66c0a2-9b3d-413d-a054-bd918407a0a7 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:02.702367 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:02.744618 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb1acb1-9a33-4abb-b17d-e3c3b3882032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:02.746222 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1acb1-9a33-4abb-b17d-e3c3b3882032 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:02.746845 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1acb1-9a33-4abb-b17d-e3c3b3882032 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:02.747375 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1acb1-9a33-4abb-b17d-e3c3b3882032 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:02.748562 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb1acb1-9a33-4abb-b17d-e3c3b3882032 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:02.749125 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb1acb1-9a33-4abb-b17d-e3c3b3882032 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:02.751581 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb1acb1-9a33-4abb-b17d-e3c3b3882032 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:02.755880 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8adc03d-51ef-4ec0-9ca6-5471f0601afb None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:02.771659 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 402/807] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:02.773392 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb1acb1-9a33-4abb-b17d-e3c3b3882032 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:02.800121 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0859b27-a76c-44a4-a1fc-a22a209f0499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:02.800768 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0859b27-a76c-44a4-a1fc-a22a209f0499 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:02.801086 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0859b27-a76c-44a4-a1fc-a22a209f0499 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:02.801358 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0859b27-a76c-44a4-a1fc-a22a209f0499 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:02.802232 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0859b27-a76c-44a4-a1fc-a22a209f0499 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:02.803754 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0859b27-a76c-44a4-a1fc-a22a209f0499 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:02.815273 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-c0859b27-a76c-44a4-a1fc-a22a209f0499 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 15:47:02.815273 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:02.815273 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 15:47:02.815273 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 15:47:02.815273 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 15:47:02.815273 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 15:47:02.815273 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 15:47:02.815273 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:47:02.815273 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 15:47:02.815273 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:02.815273 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 15:47:02.815273 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:02.815273 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:02.815273 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:02.815273 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:02.815273 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:02.815273 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:02.816495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:02.816495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:02.816495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:02.816495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:02.816495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:02.816495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:02.816495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 15:47:02.816495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 15:47:02.816495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 15:47:02.816495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 15:47:02.816495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:02.816495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:02.816495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:02.816495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:02.816495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:02.816495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:02.817367 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:02.817367 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:02.817367 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:02.817367 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:02.817367 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:02.817367 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:02.817367 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:02.817367 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:02.817367 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:02.817367 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:02.817367 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 15:47:02.817367 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:47:02.817367 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 15:47:02.817367 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:02.817367 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 406/808] 10.222.0.25 () {56 vars in 1129 bytes} [Tue Aug 30 15:47:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:02.818141 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0859b27-a76c-44a4-a1fc-a22a209f0499 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:02.833477 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:02.900116 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb1acb1-9a33-4abb-b17d-e3c3b3882032 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:02.946733 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0859b27-a76c-44a4-a1fc-a22a209f0499 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:02.947813 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116c447-d051-451e-9347-01e58854cda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:02.948538 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116c447-d051-451e-9347-01e58854cda8 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:02.949798 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116c447-d051-451e-9347-01e58854cda8 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:02.950198 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116c447-d051-451e-9347-01e58854cda8 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:02.951876 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9116c447-d051-451e-9347-01e58854cda8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:02.952259 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9116c447-d051-451e-9347-01e58854cda8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:02.953756 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9116c447-d051-451e-9347-01e58854cda8 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:02.969385 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 403/809] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:02.970378 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116c447-d051-451e-9347-01e58854cda8 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:02.978365 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:02.989737 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092f06a-a6fb-4a4b-a512-80b29b7258b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:02.990643 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092f06a-a6fb-4a4b-a512-80b29b7258b0 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:02.991064 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092f06a-a6fb-4a4b-a512-80b29b7258b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:02.991617 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092f06a-a6fb-4a4b-a512-80b29b7258b0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:03.000764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092f06a-a6fb-4a4b-a512-80b29b7258b0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:03.002566 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092f06a-a6fb-4a4b-a512-80b29b7258b0 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:03.016181 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-2092f06a-a6fb-4a4b-a512-80b29b7258b0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 15:47:03.016181 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:03.016181 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:03.016181 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:03.016181 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:03.016181 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:03.016181 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:03.016181 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:03.016181 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:03.016181 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:03.016181 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:03.016181 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:03.016181 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 15:47:03.016181 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 15:47:03.016181 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 15:47:03.016181 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 15:47:03.017329 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:03.017329 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:03.017329 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 15:47:03.017329 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:47:03.017329 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 15:47:03.017329 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:47:03.017329 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:03.017329 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:03.017329 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:03.017329 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:03.017329 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:03.017329 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:03.017329 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:03.017329 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:03.017329 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:03.017329 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:03.017329 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:03.017329 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:03.018719 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:03.018719 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:03.018719 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 15:47:03.018719 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 15:47:03.018719 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 15:47:03.018719 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 15:47:03.018719 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 15:47:03.018719 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 15:47:03.018719 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 15:47:03.018719 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:03.025211 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 407/810] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 30 15:47:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:03.026350 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092f06a-a6fb-4a4b-a512-80b29b7258b0 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:03.093661 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116c447-d051-451e-9347-01e58854cda8 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:03.105600 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:03.135410 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5600c5-ee8b-47dd-b81e-5f4c5ea7031e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:03.136077 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5600c5-ee8b-47dd-b81e-5f4c5ea7031e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:03.137282 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5600c5-ee8b-47dd-b81e-5f4c5ea7031e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:03.137578 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5600c5-ee8b-47dd-b81e-5f4c5ea7031e None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:03.138225 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5600c5-ee8b-47dd-b81e-5f4c5ea7031e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:03.138532 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5600c5-ee8b-47dd-b81e-5f4c5ea7031e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:03.139909 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5600c5-ee8b-47dd-b81e-5f4c5ea7031e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:03.142262 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092f06a-a6fb-4a4b-a512-80b29b7258b0 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:03.145471 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 404/811] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Aug 30 15:47:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:03.145970 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5600c5-ee8b-47dd-b81e-5f4c5ea7031e None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:03.186011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33cd81-f5ae-49f6-9668-12d0d3653a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:03.187151 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33cd81-f5ae-49f6-9668-12d0d3653a27 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:03.187434 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33cd81-f5ae-49f6-9668-12d0d3653a27 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:03.187704 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33cd81-f5ae-49f6-9668-12d0d3653a27 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:03.198213 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33cd81-f5ae-49f6-9668-12d0d3653a27 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:03.200726 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33cd81-f5ae-49f6-9668-12d0d3653a27 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:03.214397 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-4f33cd81-f5ae-49f6-9668-12d0d3653a27 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 15:47:03.214397 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:03.214397 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:03.214397 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:03.214397 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:03.214397 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:03.214397 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:03.214397 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:03.214397 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:03.214397 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:03.214397 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:03.214397 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:03.214397 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 15:47:03.214397 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 15:47:03.214397 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 15:47:03.214397 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 15:47:03.215332 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:03.215332 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:03.215332 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 15:47:03.215332 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:47:03.215332 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 15:47:03.215332 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:47:03.215332 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:03.215332 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:03.215332 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:03.215332 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:03.215332 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:03.215332 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:03.215332 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:03.215332 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:03.215332 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:03.215332 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:03.215332 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:03.215332 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:03.216255 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:03.216255 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:03.216255 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 15:47:03.216255 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 15:47:03.216255 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 15:47:03.216255 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 15:47:03.216255 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 15:47:03.216255 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 15:47:03.216255 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 15:47:03.216255 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:03.220105 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 408/812] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Aug 30 15:47:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:03.221269 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d752140-f128-4e53-b274-a7f5301fc3ff None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:03.221554 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d752140-f128-4e53-b274-a7f5301fc3ff None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:03.221820 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d752140-f128-4e53-b274-a7f5301fc3ff None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:03.227084 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 409/813] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:47:03.227084 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d752140-f128-4e53-b274-a7f5301fc3ff None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:03.255003 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5600c5-ee8b-47dd-b81e-5f4c5ea7031e None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:03.275532 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:03.294232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63394e5d-1cd5-48af-aa46-ada80aacc6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:03.294848 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63394e5d-1cd5-48af-aa46-ada80aacc6c5 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:03.295119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63394e5d-1cd5-48af-aa46-ada80aacc6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:03.295385 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63394e5d-1cd5-48af-aa46-ada80aacc6c5 None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:03.296106 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63394e5d-1cd5-48af-aa46-ada80aacc6c5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:03.296403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63394e5d-1cd5-48af-aa46-ada80aacc6c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:03.297850 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63394e5d-1cd5-48af-aa46-ada80aacc6c5 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:03.315230 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 405/814] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Aug 30 15:47:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:03.320434 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63394e5d-1cd5-48af-aa46-ada80aacc6c5 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:03.335328 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d752140-f128-4e53-b274-a7f5301fc3ff None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:03.353960 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:03.369497 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc17aca3-a531-43fc-9c14-59f184e116c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:03.370105 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17aca3-a531-43fc-9c14-59f184e116c1 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:03.370453 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17aca3-a531-43fc-9c14-59f184e116c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:03.371333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17aca3-a531-43fc-9c14-59f184e116c1 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:03.371969 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc17aca3-a531-43fc-9c14-59f184e116c1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:03.372266 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc17aca3-a531-43fc-9c14-59f184e116c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:03.373675 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc17aca3-a531-43fc-9c14-59f184e116c1 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:03.383011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 410/815] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Aug 30 15:47:03 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:03.383011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876c4b7-d88e-4bfb-a39e-b10e92f6209c None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:03.383011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876c4b7-d88e-4bfb-a39e-b10e92f6209c None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:03.383011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876c4b7-d88e-4bfb-a39e-b10e92f6209c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:03.398553 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-5876c4b7-d88e-4bfb-a39e-b10e92f6209c None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:03.399723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-5876c4b7-d88e-4bfb-a39e-b10e92f6209c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:03.437772 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63394e5d-1cd5-48af-aa46-ada80aacc6c5 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:03.469094 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 411/816] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:47:03.469659 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876c4b7-d88e-4bfb-a39e-b10e92f6209c None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:03.482350 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6894c8-63fe-42a8-93f5-88cdf62f2dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:03.483267 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6894c8-63fe-42a8-93f5-88cdf62f2dc5 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:03.483983 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6894c8-63fe-42a8-93f5-88cdf62f2dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:03.484492 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6894c8-63fe-42a8-93f5-88cdf62f2dc5 None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:03.486111 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6894c8-63fe-42a8-93f5-88cdf62f2dc5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:03.486586 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6894c8-63fe-42a8-93f5-88cdf62f2dc5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:03.488767 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6894c8-63fe-42a8-93f5-88cdf62f2dc5 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:03.517243 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:03.517907 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 406/817] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Aug 30 15:47:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:03.519540 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6894c8-63fe-42a8-93f5-88cdf62f2dc5 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:03.577406 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876c4b7-d88e-4bfb-a39e-b10e92f6209c None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:03.621099 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c300da-bb75-4f22-a151-df298898c173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:03.622276 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c300da-bb75-4f22-a151-df298898c173 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:03.622699 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c300da-bb75-4f22-a151-df298898c173 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:03.623157 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c300da-bb75-4f22-a151-df298898c173 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:03.627726 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:03.639522 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c300da-bb75-4f22-a151-df298898c173 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:03.641299 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c300da-bb75-4f22-a151-df298898c173 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:03.641754 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6894c8-63fe-42a8-93f5-88cdf62f2dc5 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:03.658398 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-e8c300da-bb75-4f22-a151-df298898c173 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:47:03.658398 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:03.658398 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:03.658398 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:03.658398 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:03.658398 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:03.658398 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:03.658398 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:03.658398 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:03.658398 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:03.658398 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:03.658398 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:03.658398 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:47:03.658398 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:47:03.658398 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:47:03.658398 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:47:03.659576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:03.659576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:03.659576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:03.659576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:03.659576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:03.659576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:03.659576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:03.659576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:03.659576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:03.659576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:03.659576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:03.659576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:03.659576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:03.659576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:03.659576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:03.659576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:03.659576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:47:03.660688 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:47:03.660688 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:47:03.660688 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:03.666404 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 412/818] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:47:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:03.666404 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c300da-bb75-4f22-a151-df298898c173 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:03.687222 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58734859-6510-41e2-b0ab-5cc7f9bf83b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:03.687880 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58734859-6510-41e2-b0ab-5cc7f9bf83b7 None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:03.688100 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58734859-6510-41e2-b0ab-5cc7f9bf83b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:03.688371 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58734859-6510-41e2-b0ab-5cc7f9bf83b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:03.689130 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58734859-6510-41e2-b0ab-5cc7f9bf83b7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:03.690494 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58734859-6510-41e2-b0ab-5cc7f9bf83b7 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:03.726656 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 407/819] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:47:03 2022] POST /identity/v3/endpoints => generated 346 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:47:03.728206 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58734859-6510-41e2-b0ab-5cc7f9bf83b7 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:03.783230 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:03.795491 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c300da-bb75-4f22-a151-df298898c173 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:03.841986 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96aeb13-83a5-4807-bd69-47d49387254d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:03.843042 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96aeb13-83a5-4807-bd69-47d49387254d None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:03.843388 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96aeb13-83a5-4807-bd69-47d49387254d None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:03.843764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96aeb13-83a5-4807-bd69-47d49387254d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:03.856852 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96aeb13-83a5-4807-bd69-47d49387254d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:03.858576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96aeb13-83a5-4807-bd69-47d49387254d None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:03.875612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-f96aeb13-83a5-4807-bd69-47d49387254d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:47:03.875612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:03.875612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:03.875612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:03.875612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:03.875612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:03.875612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:03.875612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:03.875612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:03.875612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:03.875612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:03.875612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:03.875612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:47:03.875612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:47:03.875612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:47:03.875612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:47:03.876616 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:03.876616 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:03.876616 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:03.876616 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:03.876616 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:03.876616 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:03.876616 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:03.876616 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:03.876616 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:03.876616 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:03.876616 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:03.876616 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:03.876616 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:03.876616 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:03.876616 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:03.876616 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:03.876616 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:47:03.877605 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:47:03.877605 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:47:03.877605 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:03.878377 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 413/820] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:47:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:03.879273 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96aeb13-83a5-4807-bd69-47d49387254d None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:03.882427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58734859-6510-41e2-b0ab-5cc7f9bf83b7 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:03.933527 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ba868-d371-4046-ba6c-ebdf7127d16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:03.934329 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ba868-d371-4046-ba6c-ebdf7127d16b None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:03.934614 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ba868-d371-4046-ba6c-ebdf7127d16b None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:03.934892 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ba868-d371-4046-ba6c-ebdf7127d16b None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:03.935733 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ba868-d371-4046-ba6c-ebdf7127d16b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:03.936081 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ba868-d371-4046-ba6c-ebdf7127d16b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:03.938044 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ba868-d371-4046-ba6c-ebdf7127d16b None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:03.951823 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 408/821] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:03.952716 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ba868-d371-4046-ba6c-ebdf7127d16b None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:03.957053 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:04.004695 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96aeb13-83a5-4807-bd69-47d49387254d None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:04.040618 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad82e47f-937d-423e-b415-238704721064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:04.041285 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82e47f-937d-423e-b415-238704721064 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:04.041564 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82e47f-937d-423e-b415-238704721064 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:04.041837 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82e47f-937d-423e-b415-238704721064 None admin] PATH_INFO: `/v3/services/network` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:04.042457 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad82e47f-937d-423e-b415-238704721064 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:04.043923 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad82e47f-937d-423e-b415-238704721064 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:04.053182 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-ad82e47f-937d-423e-b415-238704721064 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 15:47:04.053182 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:04.053182 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 15:47:04.053182 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 15:47:04.053182 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 15:47:04.053182 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 15:47:04.053182 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 15:47:04.053182 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:47:04.053182 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 15:47:04.053182 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:04.053182 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 15:47:04.053182 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:04.053182 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:04.053182 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:04.053182 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:04.053182 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:04.053182 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:04.054175 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:04.054175 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:04.054175 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:04.054175 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:04.054175 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:04.054175 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:04.054175 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 15:47:04.054175 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 15:47:04.054175 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 15:47:04.054175 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 15:47:04.054175 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:04.054175 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:04.054175 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:04.054175 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:04.054175 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:04.054175 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:04.054992 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:04.054992 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:04.054992 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:04.054992 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:04.054992 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:04.054992 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:04.054992 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:04.054992 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:04.054992 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:04.054992 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:04.054992 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 15:47:04.054992 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:47:04.054992 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 15:47:04.054992 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:04.054992 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 414/822] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:47:03 2022] GET /identity/v3/services/network => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:04.055764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad82e47f-937d-423e-b415-238704721064 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:04.059700 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:04.075224 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ba868-d371-4046-ba6c-ebdf7127d16b None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:04.114173 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c203e-d55a-43c5-a8d0-fdb5c4812989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:04.115169 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c203e-d55a-43c5-a8d0-fdb5c4812989 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:04.115742 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c203e-d55a-43c5-a8d0-fdb5c4812989 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:04.116219 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c203e-d55a-43c5-a8d0-fdb5c4812989 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:04.117151 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c203e-d55a-43c5-a8d0-fdb5c4812989 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:04.117649 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c203e-d55a-43c5-a8d0-fdb5c4812989 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:04.119442 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c203e-d55a-43c5-a8d0-fdb5c4812989 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:04.133041 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 409/823] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:04.134364 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c203e-d55a-43c5-a8d0-fdb5c4812989 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:04.162804 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad82e47f-937d-423e-b415-238704721064 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:04.198347 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13335af4-4a46-4101-9322-86c9a2870ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:04.199511 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13335af4-4a46-4101-9322-86c9a2870ee7 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:04.199789 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13335af4-4a46-4101-9322-86c9a2870ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:04.200060 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13335af4-4a46-4101-9322-86c9a2870ee7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:04.204750 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:04.207163 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13335af4-4a46-4101-9322-86c9a2870ee7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:04.208616 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13335af4-4a46-4101-9322-86c9a2870ee7 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:04.220760 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-13335af4-4a46-4101-9322-86c9a2870ee7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:47:04.220760 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:04.220760 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:04.220760 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:04.220760 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:04.220760 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:04.220760 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:04.220760 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:04.220760 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:04.220760 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:04.220760 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:04.220760 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:04.220760 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 15:47:04.220760 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 15:47:04.220760 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 15:47:04.221702 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 15:47:04.221702 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:04.221702 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:04.221702 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:04.221702 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:04.221702 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:04.221702 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:04.221702 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:04.221702 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:04.221702 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:04.221702 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:04.221702 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:04.221702 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:04.221702 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:04.221702 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:04.221702 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:04.221702 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:04.222560 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 15:47:04.222560 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 15:47:04.222560 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 15:47:04.222560 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 15:47:04.222560 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 15:47:04.222560 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 15:47:04.222560 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:47:04.222560 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:04.226727 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 415/824] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:47:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:04.227472 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13335af4-4a46-4101-9322-86c9a2870ee7 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:04.252638 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c203e-d55a-43c5-a8d0-fdb5c4812989 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:04.291687 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2b1ba-6ebf-4e81-acf9-cb3db78b9620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:04.292735 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2b1ba-6ebf-4e81-acf9-cb3db78b9620 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:04.293049 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2b1ba-6ebf-4e81-acf9-cb3db78b9620 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:04.293332 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2b1ba-6ebf-4e81-acf9-cb3db78b9620 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:04.293958 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2b1ba-6ebf-4e81-acf9-cb3db78b9620 None admin] RBAC: Adding query filter params (name=network) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:04.294085 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:04.294370 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2b1ba-6ebf-4e81-acf9-cb3db78b9620 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:04.295608 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2b1ba-6ebf-4e81-acf9-cb3db78b9620 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:04.306765 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 410/825] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Aug 30 15:47:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:04.306765 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2b1ba-6ebf-4e81-acf9-cb3db78b9620 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:04.350282 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13335af4-4a46-4101-9322-86c9a2870ee7 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:04.389156 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1ca65-9e53-4da9-9121-86c56c00fe6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:04.390599 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1ca65-9e53-4da9-9121-86c56c00fe6c None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:04.391081 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1ca65-9e53-4da9-9121-86c56c00fe6c None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:04.391555 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1ca65-9e53-4da9-9121-86c56c00fe6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:04.399322 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1ca65-9e53-4da9-9121-86c56c00fe6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:04.401096 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1ca65-9e53-4da9-9121-86c56c00fe6c None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:04.413613 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-8be1ca65-9e53-4da9-9121-86c56c00fe6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:47:04.413613 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:04.413613 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:04.413613 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:04.413613 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:04.413613 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:04.413613 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:04.413613 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:04.413613 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:04.413613 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:04.413613 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:04.413613 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:04.413613 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 15:47:04.413613 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 15:47:04.413613 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 15:47:04.414516 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 15:47:04.414516 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:04.414516 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:04.414516 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:04.414516 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:04.414516 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:04.414516 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:04.414516 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:04.414516 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:04.414516 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:04.414516 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:04.414516 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:04.414516 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:04.414516 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:04.414516 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:04.414516 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:04.414516 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:04.415380 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 15:47:04.415380 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 15:47:04.415380 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 15:47:04.415380 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 15:47:04.415380 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 15:47:04.415380 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 15:47:04.415380 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:47:04.415380 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:04.417876 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 416/826] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:47:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:04.417985 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2b1ba-6ebf-4e81-acf9-cb3db78b9620 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:04.419087 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1ca65-9e53-4da9-9121-86c56c00fe6c None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:04.446986 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:04.458152 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca7f29-cff3-4dd2-9257-aa4b26a19090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:04.458765 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca7f29-cff3-4dd2-9257-aa4b26a19090 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:04.459098 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca7f29-cff3-4dd2-9257-aa4b26a19090 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:04.459371 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca7f29-cff3-4dd2-9257-aa4b26a19090 None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:04.460064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca7f29-cff3-4dd2-9257-aa4b26a19090 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:04.460363 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca7f29-cff3-4dd2-9257-aa4b26a19090 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:04.461819 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca7f29-cff3-4dd2-9257-aa4b26a19090 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:04.476201 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 411/827] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 30 15:47:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:04.477118 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca7f29-cff3-4dd2-9257-aa4b26a19090 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:04.528749 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1ca65-9e53-4da9-9121-86c56c00fe6c None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:04.553148 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:04.564411 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368ce07-3263-47ee-905f-ec5113eea1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:04.565468 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368ce07-3263-47ee-905f-ec5113eea1d5 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:04.565592 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368ce07-3263-47ee-905f-ec5113eea1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:04.565972 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368ce07-3263-47ee-905f-ec5113eea1d5 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:04.566707 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4368ce07-3263-47ee-905f-ec5113eea1d5 None admin] RBAC: Adding query filter params (type=network) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:04.567105 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4368ce07-3263-47ee-905f-ec5113eea1d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:04.568556 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4368ce07-3263-47ee-905f-ec5113eea1d5 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:04.578686 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 417/828] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Aug 30 15:47:04 2022] GET /identity/v3/services?type=network => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:04.579654 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368ce07-3263-47ee-905f-ec5113eea1d5 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:04.596918 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca7f29-cff3-4dd2-9257-aa4b26a19090 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:04.641025 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd32b73-7baf-4d50-a3c9-dd69843c4ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:04.642023 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd32b73-7baf-4d50-a3c9-dd69843c4ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:04.642729 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd32b73-7baf-4d50-a3c9-dd69843c4ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:04.643173 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd32b73-7baf-4d50-a3c9-dd69843c4ec9 None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:04.644097 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd32b73-7baf-4d50-a3c9-dd69843c4ec9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:04.644704 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd32b73-7baf-4d50-a3c9-dd69843c4ec9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:04.646474 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd32b73-7baf-4d50-a3c9-dd69843c4ec9 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:04.659739 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 412/829] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 30 15:47:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:04.660833 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd32b73-7baf-4d50-a3c9-dd69843c4ec9 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:04.685688 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368ce07-3263-47ee-905f-ec5113eea1d5 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:04.718930 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:04.722383 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3993a3-b633-4c19-ab2a-4739b8c841a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:04.722915 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3993a3-b633-4c19-ab2a-4739b8c841a8 None admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:04.723293 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3993a3-b633-4c19-ab2a-4739b8c841a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:04.723680 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3993a3-b633-4c19-ab2a-4739b8c841a8 None admin] PATH_INFO: `/v3/projects/51f312b4cd8b449aa2971993f68de9af/users/94765f224c734beabe83b4dc0c5e511f/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:04.725922 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3993a3-b633-4c19-ab2a-4739b8c841a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=51f312b4cd8b449aa2971993f68de9af, user_id=94765f224c734beabe83b4dc0c5e511f, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:04.727468 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3993a3-b633-4c19-ab2a-4739b8c841a8 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:04.741637 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 418/830] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 30 15:47:04 2022] PUT /identity/v3/projects/51f312b4cd8b449aa2971993f68de9af/users/94765f224c734beabe83b4dc0c5e511f/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:47:04.742653 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3993a3-b633-4c19-ab2a-4739b8c841a8 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:04.791426 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd32b73-7baf-4d50-a3c9-dd69843c4ec9 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:04.811729 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:04.847471 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2262e-9d7a-4077-80fb-3bcb81a11a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:04.848110 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2262e-9d7a-4077-80fb-3bcb81a11a2a None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:04.848397 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2262e-9d7a-4077-80fb-3bcb81a11a2a None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:04.848670 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2262e-9d7a-4077-80fb-3bcb81a11a2a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:04.849898 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2262e-9d7a-4077-80fb-3bcb81a11a2a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:04.851784 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2262e-9d7a-4077-80fb-3bcb81a11a2a None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:04.878195 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3993a3-b633-4c19-ab2a-4739b8c841a8 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:04.880667 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 413/831] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:47:04 2022] POST /identity/v3/endpoints => generated 337 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:47:04.882666 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1e263-a819-4d49-b205-b0f861c7786e None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:04.883003 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1e263-a819-4d49-b205-b0f861c7786e None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:04.883283 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1e263-a819-4d49-b205-b0f861c7786e None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:04.884891 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 414/832] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:47:04.892403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aeabab-8a6e-4193-b520-e9d6f21400a9 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:04.893011 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aeabab-8a6e-4193-b520-e9d6f21400a9 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:04.893237 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aeabab-8a6e-4193-b520-e9d6f21400a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:04.921534 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-60aeabab-8a6e-4193-b520-e9d6f21400a9 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:04.923700 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-60aeabab-8a6e-4193-b520-e9d6f21400a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:04.940903 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e91026-bdf1-4ac0-97fb-fb4601f859a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:04.941971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e91026-bdf1-4ac0-97fb-fb4601f859a6 None admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:04.942258 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e91026-bdf1-4ac0-97fb-fb4601f859a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:04.942846 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e91026-bdf1-4ac0-97fb-fb4601f859a6 None admin] PATH_INFO: `/v3/projects/51f312b4cd8b449aa2971993f68de9af/users/d7958b395d5e4f5da37927536b1856ae/roles/c99e31de7c4c47c7b7b2c45c2771ca58` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:04.966116 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e91026-bdf1-4ac0-97fb-fb4601f859a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=51f312b4cd8b449aa2971993f68de9af, user_id=d7958b395d5e4f5da37927536b1856ae, role_id=c99e31de7c4c47c7b7b2c45c2771ca58)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:04.967782 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e91026-bdf1-4ac0-97fb-fb4601f859a6 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:04.987533 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 419/833] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 30 15:47:04 2022] PUT /identity/v3/projects/51f312b4cd8b449aa2971993f68de9af/users/d7958b395d5e4f5da37927536b1856ae/roles/c99e31de7c4c47c7b7b2c45c2771ca58 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:47:05.021897 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 415/834] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 15:47:05.336535 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e91026-bdf1-4ac0-97fb-fb4601f859a6 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:05.439035 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:05.446060 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e91026-bdf1-4ac0-97fb-fb4601f859a6 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:05.482141 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4406c-e5d8-498f-a88c-c97f70d78d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:05.482780 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4406c-e5d8-498f-a88c-c97f70d78d0d None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:05.483057 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4406c-e5d8-498f-a88c-c97f70d78d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:05.483321 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4406c-e5d8-498f-a88c-c97f70d78d0d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:05.483908 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb4406c-e5d8-498f-a88c-c97f70d78d0d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:05.485291 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb4406c-e5d8-498f-a88c-c97f70d78d0d None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:05.494250 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-ccb4406c-e5d8-498f-a88c-c97f70d78d0d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 15:47:05.494250 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:05.494250 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 15:47:05.494250 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 15:47:05.494250 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 15:47:05.494250 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 15:47:05.494250 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 15:47:05.494250 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:47:05.494250 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 15:47:05.494250 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:05.494250 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 15:47:05.494250 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:05.494250 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:05.494250 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:05.494250 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:05.494250 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:05.496252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:05.496252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:05.496252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:05.496252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:05.496252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:05.496252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:05.496252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:05.496252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 15:47:05.496252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 15:47:05.496252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 15:47:05.496252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 15:47:05.496252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:05.496252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:05.496252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:05.496252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:05.496252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:05.496252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:05.497483 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:05.497483 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:05.497483 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:05.497483 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:05.497483 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:05.497483 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:05.497483 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:05.497483 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:05.497483 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:05.497483 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:05.497483 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 15:47:05.497483 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:47:05.497483 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 15:47:05.497483 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:05.497483 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 420/835] 10.222.0.25 () {56 vars in 1132 bytes} [Tue Aug 30 15:47:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:05.501703 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aeabab-8a6e-4193-b520-e9d6f21400a9 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:05.537226 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:05.723395 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aeabab-8a6e-4193-b520-e9d6f21400a9 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:05.758214 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ffeafe-d922-444a-aa88-83bcb9a97c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:05.758828 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffeafe-d922-444a-aa88-83bcb9a97c88 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:05.759102 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffeafe-d922-444a-aa88-83bcb9a97c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:05.759369 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffeafe-d922-444a-aa88-83bcb9a97c88 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:05.759997 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ffeafe-d922-444a-aa88-83bcb9a97c88 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:05.760289 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ffeafe-d922-444a-aa88-83bcb9a97c88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:05.761757 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ffeafe-d922-444a-aa88-83bcb9a97c88 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:05.766552 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 416/836] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Aug 30 15:47:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:47:05.772313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4406c-e5d8-498f-a88c-c97f70d78d0d None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:05.878189 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4406c-e5d8-498f-a88c-c97f70d78d0d None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:05.916647 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c4968-54e8-4479-8b8d-c2f74421d213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:05.917831 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c4968-54e8-4479-8b8d-c2f74421d213 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:05.918115 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c4968-54e8-4479-8b8d-c2f74421d213 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:05.918435 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c4968-54e8-4479-8b8d-c2f74421d213 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:05.919108 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c4968-54e8-4479-8b8d-c2f74421d213 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:05.919407 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c4968-54e8-4479-8b8d-c2f74421d213 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:05.920805 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c4968-54e8-4479-8b8d-c2f74421d213 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:05.926020 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 421/837] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Aug 30 15:47:05 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:05.973258 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba1696-6338-4ca5-a3fa-4aae490df922 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:05.973566 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba1696-6338-4ca5-a3fa-4aae490df922 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:05.973718 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba1696-6338-4ca5-a3fa-4aae490df922 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:05.975117 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 417/838] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:47:05.981805 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b72ec-414a-4c7b-9fd4-f3e4fb467c25 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:05.982121 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b72ec-414a-4c7b-9fd4-f3e4fb467c25 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:05.982345 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b72ec-414a-4c7b-9fd4-f3e4fb467c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:06.002736 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-e84b72ec-414a-4c7b-9fd4-f3e4fb467c25 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:06.003968 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-e84b72ec-414a-4c7b-9fd4-f3e4fb467c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:06.025530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:06.081579 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 422/839] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:05 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:47:06.359825 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba1696-6338-4ca5-a3fa-4aae490df922 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:06.462922 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:06.468068 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba1696-6338-4ca5-a3fa-4aae490df922 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:06.503953 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307065a7-e211-421b-8d29-acc0e54442ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:06.504706 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307065a7-e211-421b-8d29-acc0e54442ee None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:06.504888 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307065a7-e211-421b-8d29-acc0e54442ee None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:06.505126 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307065a7-e211-421b-8d29-acc0e54442ee None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:06.505741 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307065a7-e211-421b-8d29-acc0e54442ee None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:06.507182 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307065a7-e211-421b-8d29-acc0e54442ee None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:06.516978 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-307065a7-e211-421b-8d29-acc0e54442ee None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 15:47:06.516978 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:06.516978 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 15:47:06.516978 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 15:47:06.516978 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 15:47:06.516978 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 15:47:06.516978 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 15:47:06.516978 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:47:06.516978 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 15:47:06.516978 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:06.516978 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 15:47:06.516978 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:06.516978 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:06.516978 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:06.516978 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:06.516978 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:06.516978 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:06.520096 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:06.520096 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:06.520096 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:06.520096 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:06.520096 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:06.520096 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:06.520096 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 15:47:06.520096 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 15:47:06.520096 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 15:47:06.520096 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 15:47:06.520096 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:06.520096 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:06.520096 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:06.520096 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:06.520096 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:06.520096 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:06.522070 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:06.522070 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:06.522070 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:06.522070 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:06.522070 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:06.522070 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:06.522070 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:06.522070 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:06.522070 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:06.522070 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:06.522070 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 15:47:06.522070 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:47:06.522070 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 15:47:06.522070 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:06.522070 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 418/840] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Aug 30 15:47:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:06.528821 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b72ec-414a-4c7b-9fd4-f3e4fb467c25 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:06.640196 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b72ec-414a-4c7b-9fd4-f3e4fb467c25 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:06.676858 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31b450-8ecf-4d57-b147-1b5a8ff23ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:06.677472 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31b450-8ecf-4d57-b147-1b5a8ff23ecb None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:06.677751 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31b450-8ecf-4d57-b147-1b5a8ff23ecb None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:06.678024 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31b450-8ecf-4d57-b147-1b5a8ff23ecb None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:06.678652 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31b450-8ecf-4d57-b147-1b5a8ff23ecb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:06.678947 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31b450-8ecf-4d57-b147-1b5a8ff23ecb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:06.680310 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31b450-8ecf-4d57-b147-1b5a8ff23ecb None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:06.685448 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 423/841] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Aug 30 15:47:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:06.691154 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307065a7-e211-421b-8d29-acc0e54442ee None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:06.801467 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307065a7-e211-421b-8d29-acc0e54442ee None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:06.841024 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57901c-4d6d-4ba0-bc53-318a2c75d0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:06.841633 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57901c-4d6d-4ba0-bc53-318a2c75d0d1 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:06.841905 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57901c-4d6d-4ba0-bc53-318a2c75d0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:06.842168 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57901c-4d6d-4ba0-bc53-318a2c75d0d1 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:06.842803 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f57901c-4d6d-4ba0-bc53-318a2c75d0d1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:06.843095 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f57901c-4d6d-4ba0-bc53-318a2c75d0d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:06.844457 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f57901c-4d6d-4ba0-bc53-318a2c75d0d1 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:06.849479 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 419/842] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Aug 30 15:47:06 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:06.881129 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4ee51-59f6-45cf-8e64-a65a929c155b None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:06.881129 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4ee51-59f6-45cf-8e64-a65a929c155b None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:06.881129 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4ee51-59f6-45cf-8e64-a65a929c155b None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:06.881129 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 424/843] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:47:06.891105 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79130f-4881-4166-8686-b22a6df092a5 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:06.891105 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79130f-4881-4166-8686-b22a6df092a5 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:06.891105 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79130f-4881-4166-8686-b22a6df092a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:06.909163 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-dc79130f-4881-4166-8686-b22a6df092a5 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:06.910727 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-dc79130f-4881-4166-8686-b22a6df092a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:06.934488 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:06.989338 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 420/844] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:06 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:47:07.042576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f821fc-5953-497e-811e-ad6de91142e0 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:07.042857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f821fc-5953-497e-811e-ad6de91142e0 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:07.043134 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f821fc-5953-497e-811e-ad6de91142e0 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:07.044758 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 425/845] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:47:07.050123 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca0970-2440-4d02-94b4-2be9225a212a None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:07.050466 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca0970-2440-4d02-94b4-2be9225a212a None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:07.050746 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca0970-2440-4d02-94b4-2be9225a212a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:07.069360 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-90ca0970-2440-4d02-94b4-2be9225a212a None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:07.070605 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-90ca0970-2440-4d02-94b4-2be9225a212a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:07.148975 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 421/846] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:07 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:47:07.263304 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f821fc-5953-497e-811e-ad6de91142e0 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:07.282477 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:07.376367 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f821fc-5953-497e-811e-ad6de91142e0 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:07.412146 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c843255-ffe4-4597-9da3-47b21e2cc59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:07.412704 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c843255-ffe4-4597-9da3-47b21e2cc59e None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:07.413010 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c843255-ffe4-4597-9da3-47b21e2cc59e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:07.413284 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c843255-ffe4-4597-9da3-47b21e2cc59e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:07.424315 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c843255-ffe4-4597-9da3-47b21e2cc59e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:47:07.429162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-1c843255-ffe4-4597-9da3-47b21e2cc59e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:47:07.429162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:07.429162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:07.429162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:07.429162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:07.429162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:07.429162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:07.429162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:07.429162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:07.429162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:07.429162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:07.429162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:07.429162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:47:07.429162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:47:07.429162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:47:07.429162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:47:07.430092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:47:07.430092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:47:07.430092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:47:07.430092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:47:07.430092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:07.430092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:07.430092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:07.430092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:07.430092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:07.430092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:07.430092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:07.430092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:07.430092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:07.430092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:07.430092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:07.430092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:07.430932 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:07.430932 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:07.430932 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:07.430932 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:07.430932 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:47:07.430932 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:47:07.430932 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:47:07.430932 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:47:07.430932 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:47:07.430932 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:47:07.430932 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:47:07.430932 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:07.430932 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 426/847] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 30 15:47:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 15:47:07.436608 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca0970-2440-4d02-94b4-2be9225a212a None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:07.444192 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c843255-ffe4-4597-9da3-47b21e2cc59e None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:07.526781 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:07.531211 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:07.548404 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca0970-2440-4d02-94b4-2be9225a212a None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:07.552331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c843255-ffe4-4597-9da3-47b21e2cc59e None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:07.586717 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e892b7f-3e1f-4022-8c98-95c91f467437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:07.587356 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e892b7f-3e1f-4022-8c98-95c91f467437 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:07.587635 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e892b7f-3e1f-4022-8c98-95c91f467437 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:07.587806 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89e914-4968-4d1c-8581-744cdf9fcf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:07.587996 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e892b7f-3e1f-4022-8c98-95c91f467437 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:07.588360 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89e914-4968-4d1c-8581-744cdf9fcf61 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:07.588563 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e892b7f-3e1f-4022-8c98-95c91f467437 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:07.588736 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89e914-4968-4d1c-8581-744cdf9fcf61 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:07.589004 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89e914-4968-4d1c-8581-744cdf9fcf61 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:07.589166 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e892b7f-3e1f-4022-8c98-95c91f467437 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:07.590745 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e892b7f-3e1f-4022-8c98-95c91f467437 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:07.600038 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 422/848] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:47:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:07.605323 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd89e914-4968-4d1c-8581-744cdf9fcf61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:47:07.605958 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e892b7f-3e1f-4022-8c98-95c91f467437 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:07.610240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-cd89e914-4968-4d1c-8581-744cdf9fcf61 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 15:47:07.610240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:07.610240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:07.610240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:07.610240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:07.610240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:07.610240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:07.610240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:07.610240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:07.610240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:07.610240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:07.610240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:07.610240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:47:07.610240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:47:07.610240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:47:07.610240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:47:07.611173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:47:07.611173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:47:07.611173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:47:07.611173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:47:07.611173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:07.611173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:07.611173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:07.611173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:07.611173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:07.611173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:07.611173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:07.611173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:07.611173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:07.611173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:07.611173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:07.611173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:07.617093 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:07.617093 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:07.617093 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:07.617093 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:07.617093 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:47:07.617093 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:47:07.617093 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:47:07.617093 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:47:07.617093 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:47:07.617093 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:47:07.617093 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 15:47:07.617093 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:07.617093 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 427/849] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 30 15:47:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 15:47:07.619225 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89e914-4968-4d1c-8581-744cdf9fcf61 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:07.739403 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89e914-4968-4d1c-8581-744cdf9fcf61 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:07.752755 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e892b7f-3e1f-4022-8c98-95c91f467437 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:07.790520 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3419a-862d-455e-ad22-be748eb1ace0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:07.791140 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3419a-862d-455e-ad22-be748eb1ace0 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:07.791436 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3419a-862d-455e-ad22-be748eb1ace0 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:07.791681 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3419a-862d-455e-ad22-be748eb1ace0 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:07.792471 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c3419a-862d-455e-ad22-be748eb1ace0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:07.792869 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c3419a-862d-455e-ad22-be748eb1ace0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:07.793971 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a03683-7137-40b7-9388-acb391fabf41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:07.794634 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c3419a-862d-455e-ad22-be748eb1ace0 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:07.795067 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a03683-7137-40b7-9388-acb391fabf41 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:07.795539 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a03683-7137-40b7-9388-acb391fabf41 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:07.796259 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a03683-7137-40b7-9388-acb391fabf41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:07.797302 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:07.810288 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 428/850] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Aug 30 15:47:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:47:07.811510 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3419a-862d-455e-ad22-be748eb1ace0 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:07.812581 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a03683-7137-40b7-9388-acb391fabf41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:07.814287 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a03683-7137-40b7-9388-acb391fabf41 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:07.830505 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:07.842060 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-11a03683-7137-40b7-9388-acb391fabf41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:47:07.842060 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:07.842060 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:07.842060 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:07.842060 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:07.842060 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:07.842060 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:07.842060 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:07.842060 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:07.842060 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:07.842060 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:07.842060 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:07.842060 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:47:07.842060 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:47:07.842060 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:47:07.842060 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:47:07.843049 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:07.843049 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:07.843049 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:07.843049 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:07.843049 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:07.843049 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:07.843049 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:07.843049 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:07.843049 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:07.843049 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:07.843049 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:07.843049 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:07.843049 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:07.843049 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:07.843049 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:07.843049 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:07.843049 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:47:07.843938 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:47:07.843938 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:47:07.843938 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:07.847318 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 423/851] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:47:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:07.852983 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a03683-7137-40b7-9388-acb391fabf41 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:07.929690 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3419a-862d-455e-ad22-be748eb1ace0 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:07.966952 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b1ea6-1ef8-4d4f-bb85-92feb1785a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:07.967601 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b1ea6-1ef8-4d4f-bb85-92feb1785a81 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:07.967992 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b1ea6-1ef8-4d4f-bb85-92feb1785a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:07.968150 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b1ea6-1ef8-4d4f-bb85-92feb1785a81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:07.972614 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a03683-7137-40b7-9388-acb391fabf41 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:07.980149 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b1ea6-1ef8-4d4f-bb85-92feb1785a81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:07.981818 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b1ea6-1ef8-4d4f-bb85-92feb1785a81 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:07.997729 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-c06b1ea6-1ef8-4d4f-bb85-92feb1785a81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:47:07.997729 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:07.997729 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:07.997729 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:07.997729 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:07.997729 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:07.997729 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:07.997729 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:07.997729 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:07.997729 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:07.997729 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:07.997729 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:07.997729 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:47:07.997729 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:47:07.997729 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:47:07.997729 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:47:07.998729 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:07.998729 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:07.998729 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:07.998729 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:07.998729 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:07.998729 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:07.998729 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:07.998729 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:07.998729 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:07.998729 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:07.998729 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:07.998729 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:07.998729 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:07.998729 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:07.998729 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:07.998729 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:07.998729 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:47:07.999944 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:47:07.999944 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:47:07.999944 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:07.999944 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 429/852] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:47:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:08.007526 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b1ea6-1ef8-4d4f-bb85-92feb1785a81 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:08.019585 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df05484-3d57-456d-80cd-e498046a78df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:08.020223 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df05484-3d57-456d-80cd-e498046a78df None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:08.020505 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df05484-3d57-456d-80cd-e498046a78df None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:08.020796 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df05484-3d57-456d-80cd-e498046a78df None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:08.021483 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df05484-3d57-456d-80cd-e498046a78df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:08.021786 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df05484-3d57-456d-80cd-e498046a78df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:08.023178 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df05484-3d57-456d-80cd-e498046a78df None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:08.042768 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 424/853] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:47:08.042768 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebeea32-3f85-4eea-a5cf-b31e0fa51906 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:08.042768 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebeea32-3f85-4eea-a5cf-b31e0fa51906 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:08.042768 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebeea32-3f85-4eea-a5cf-b31e0fa51906 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:08.042768 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 425/854] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:47:08.043951 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebeea32-3f85-4eea-a5cf-b31e0fa51906 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:08.075281 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:08.122879 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:08.136721 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b1ea6-1ef8-4d4f-bb85-92feb1785a81 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:08.171559 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebeea32-3f85-4eea-a5cf-b31e0fa51906 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:08.188296 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09bc28-1fc2-4451-8dbc-c50278f27cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:08.189156 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09bc28-1fc2-4451-8dbc-c50278f27cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:08.189657 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09bc28-1fc2-4451-8dbc-c50278f27cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:08.190134 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09bc28-1fc2-4451-8dbc-c50278f27cb9 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:08.190793 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c09bc28-1fc2-4451-8dbc-c50278f27cb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:08.191333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c09bc28-1fc2-4451-8dbc-c50278f27cb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:08.193040 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c09bc28-1fc2-4451-8dbc-c50278f27cb9 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:08.213537 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 430/855] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:08.213537 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214e473-cbf0-4d1b-a810-88b7426acf01 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:08.213537 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214e473-cbf0-4d1b-a810-88b7426acf01 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:08.213537 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214e473-cbf0-4d1b-a810-88b7426acf01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:08.217212 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b8598-6f7c-4cd1-bf82-6c5bc1d3cb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:08.217908 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b8598-6f7c-4cd1-bf82-6c5bc1d3cb29 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:08.218159 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b8598-6f7c-4cd1-bf82-6c5bc1d3cb29 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:08.218445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b8598-6f7c-4cd1-bf82-6c5bc1d3cb29 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:08.226592 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b8598-6f7c-4cd1-bf82-6c5bc1d3cb29 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:08.228058 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b8598-6f7c-4cd1-bf82-6c5bc1d3cb29 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:08.235557 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-f214e473-cbf0-4d1b-a810-88b7426acf01 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:08.236956 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-f214e473-cbf0-4d1b-a810-88b7426acf01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:08.241435 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-705b8598-6f7c-4cd1-bf82-6c5bc1d3cb29 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 15:47:08.241435 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:08.241435 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:08.241435 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:08.241435 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:08.241435 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:08.241435 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:08.241435 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:08.241435 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:08.241435 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:08.241435 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:08.241435 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:08.241435 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 15:47:08.241435 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 15:47:08.241435 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 15:47:08.241435 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 15:47:08.242597 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:08.242597 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:08.242597 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 15:47:08.242597 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:47:08.242597 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 15:47:08.242597 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:47:08.242597 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:08.242597 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:08.242597 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:08.242597 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:08.242597 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:08.242597 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:08.242597 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:08.242597 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:08.242597 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:08.242597 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:08.242597 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:08.242597 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:08.243557 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:08.243557 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:08.243557 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 15:47:08.243557 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 15:47:08.243557 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 15:47:08.243557 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 15:47:08.243557 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 15:47:08.243557 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 15:47:08.243557 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 15:47:08.243557 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:08.243557 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 426/856] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 30 15:47:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:08.244142 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b8598-6f7c-4cd1-bf82-6c5bc1d3cb29 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:08.332855 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 431/857] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:08 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:47:08.332855 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214e473-cbf0-4d1b-a810-88b7426acf01 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:08.377313 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b8598-6f7c-4cd1-bf82-6c5bc1d3cb29 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:08.399754 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:08.404547 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:08.423217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b3fe2-32b9-4290-a0cb-d2d7a9c0cb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:08.424813 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b3fe2-32b9-4290-a0cb-d2d7a9c0cb6a None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:08.425269 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b3fe2-32b9-4290-a0cb-d2d7a9c0cb6a None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:08.425719 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b3fe2-32b9-4290-a0cb-d2d7a9c0cb6a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:08.441196 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b3fe2-32b9-4290-a0cb-d2d7a9c0cb6a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:08.442985 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b3fe2-32b9-4290-a0cb-d2d7a9c0cb6a None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:08.462350 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-7f6b3fe2-32b9-4290-a0cb-d2d7a9c0cb6a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 15:47:08.462350 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:08.462350 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:08.462350 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:08.462350 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:08.462350 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:08.462350 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:08.462350 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:08.462350 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:08.462350 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:08.462350 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:08.462350 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:08.462350 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 15:47:08.462350 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 15:47:08.462350 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 15:47:08.462350 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 15:47:08.463582 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:08.463582 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:08.463582 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 15:47:08.463582 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:47:08.463582 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 15:47:08.463582 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:47:08.463582 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:08.463582 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:08.463582 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:08.463582 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:08.463582 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:08.463582 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:08.463582 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:08.463582 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:08.463582 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:08.463582 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:08.463582 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:08.463582 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:08.465479 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:08.465479 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:08.465479 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 15:47:08.465479 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 15:47:08.465479 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 15:47:08.465479 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 15:47:08.465479 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 15:47:08.465479 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 15:47:08.465479 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 15:47:08.465479 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:08.469195 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 427/858] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Aug 30 15:47:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:08.477752 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b3fe2-32b9-4290-a0cb-d2d7a9c0cb6a None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:08.488346 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214e473-cbf0-4d1b-a810-88b7426acf01 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:08.529156 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89581d08-f55c-419a-867a-8eba80eaf7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:08.530024 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89581d08-f55c-419a-867a-8eba80eaf7d5 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:08.530513 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89581d08-f55c-419a-867a-8eba80eaf7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:08.530962 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89581d08-f55c-419a-867a-8eba80eaf7d5 None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:08.532104 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89581d08-f55c-419a-867a-8eba80eaf7d5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:08.532650 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89581d08-f55c-419a-867a-8eba80eaf7d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:08.534797 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89581d08-f55c-419a-867a-8eba80eaf7d5 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:08.561132 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 432/859] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Aug 30 15:47:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:08.564329 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89581d08-f55c-419a-867a-8eba80eaf7d5 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:08.642782 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b3fe2-32b9-4290-a0cb-d2d7a9c0cb6a None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:08.684448 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:08.689549 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd010c1-9f38-43e5-9cb4-04ed0f10148e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:08.690175 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd010c1-9f38-43e5-9cb4-04ed0f10148e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:08.690459 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd010c1-9f38-43e5-9cb4-04ed0f10148e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:08.690731 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd010c1-9f38-43e5-9cb4-04ed0f10148e None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:08.691080 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89581d08-f55c-419a-867a-8eba80eaf7d5 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:08.691476 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd010c1-9f38-43e5-9cb4-04ed0f10148e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:08.691779 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd010c1-9f38-43e5-9cb4-04ed0f10148e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:08.693356 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd010c1-9f38-43e5-9cb4-04ed0f10148e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:08.712418 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 428/860] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Aug 30 15:47:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:08.713723 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd010c1-9f38-43e5-9cb4-04ed0f10148e None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:08.742216 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149cedd3-9aa7-4461-a6e8-ff36dabc372a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:08.742748 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149cedd3-9aa7-4461-a6e8-ff36dabc372a None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:08.743029 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149cedd3-9aa7-4461-a6e8-ff36dabc372a None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:08.743294 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149cedd3-9aa7-4461-a6e8-ff36dabc372a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:08.760075 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:08.816187 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149cedd3-9aa7-4461-a6e8-ff36dabc372a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:08.817667 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149cedd3-9aa7-4461-a6e8-ff36dabc372a None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:08.832397 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd010c1-9f38-43e5-9cb4-04ed0f10148e None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:08.866828 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a588ed2f-fe6b-49a4-94aa-6ca824705265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:08.867434 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588ed2f-fe6b-49a4-94aa-6ca824705265 None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:08.867709 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588ed2f-fe6b-49a4-94aa-6ca824705265 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:08.868005 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588ed2f-fe6b-49a4-94aa-6ca824705265 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:08.868651 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a588ed2f-fe6b-49a4-94aa-6ca824705265 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:08.870045 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a588ed2f-fe6b-49a4-94aa-6ca824705265 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:08.886006 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 429/861] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Aug 30 15:47:08 2022] POST /identity/v3/services => generated 269 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:47:08.887061 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a588ed2f-fe6b-49a4-94aa-6ca824705265 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:08.924998 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:08.933366 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 433/862] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:47:08 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 15:47:08.935332 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434c57d-cc75-432e-b80d-86e77593585d None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:08.935683 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434c57d-cc75-432e-b80d-86e77593585d None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:08.936026 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434c57d-cc75-432e-b80d-86e77593585d None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:08.937979 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 434/863] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:47:08.938920 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434c57d-cc75-432e-b80d-86e77593585d None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:09.010660 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:09.026156 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a588ed2f-fe6b-49a4-94aa-6ca824705265 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:09.055350 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434c57d-cc75-432e-b80d-86e77593585d None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:09.072892 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958d711-6edb-41b3-b140-956ff49a9c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:09.073531 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958d711-6edb-41b3-b140-956ff49a9c3f None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:09.073871 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958d711-6edb-41b3-b140-956ff49a9c3f None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:09.074220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958d711-6edb-41b3-b140-956ff49a9c3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:09.094943 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945dd1e-8928-442f-a9f2-d575d90b710b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:09.095920 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945dd1e-8928-442f-a9f2-d575d90b710b None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:09.096395 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945dd1e-8928-442f-a9f2-d575d90b710b None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:09.096940 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945dd1e-8928-442f-a9f2-d575d90b710b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:09.109371 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945dd1e-8928-442f-a9f2-d575d90b710b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:09.111174 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945dd1e-8928-442f-a9f2-d575d90b710b None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:09.127324 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-1945dd1e-8928-442f-a9f2-d575d90b710b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:47:09.127324 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:09.127324 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:09.127324 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:09.127324 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:09.127324 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:09.127324 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:09.127324 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:09.127324 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:09.127324 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:09.127324 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:09.127324 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:09.127324 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:47:09.127324 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:47:09.127324 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:47:09.127324 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:47:09.128312 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:09.128312 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:09.128312 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:09.128312 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:09.128312 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:09.128312 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:09.128312 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:09.128312 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:09.128312 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:09.128312 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:09.128312 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:09.128312 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:09.128312 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:09.128312 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:09.128312 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:09.128312 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:09.128312 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:47:09.129184 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:47:09.129184 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:47:09.129184 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:09.131358 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 435/864] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:47:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:09.132887 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3dc55-c231-4b3a-9bb8-93743fc6a0be None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:09.133243 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3dc55-c231-4b3a-9bb8-93743fc6a0be None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:09.133570 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3dc55-c231-4b3a-9bb8-93743fc6a0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:09.149556 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958d711-6edb-41b3-b140-956ff49a9c3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:09.151010 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958d711-6edb-41b3-b140-956ff49a9c3f None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:09.153086 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-58f3dc55-c231-4b3a-9bb8-93743fc6a0be None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:09.154498 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-58f3dc55-c231-4b3a-9bb8-93743fc6a0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:09.202536 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:09.224596 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 436/865] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:09 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:47:09.225297 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3dc55-c231-4b3a-9bb8-93743fc6a0be None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:09.252674 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:09.262103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 430/866] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:47:08 2022] GET /identity/v3/auth/tokens => generated 1271 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 15:47:09.269795 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958d711-6edb-41b3-b140-956ff49a9c3f None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:09.342135 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3dc55-c231-4b3a-9bb8-93743fc6a0be None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:09.379790 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958d711-6edb-41b3-b140-956ff49a9c3f None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:09.386295 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087e8ff-7a6d-4ff9-b2f8-ef768de3d3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:09.386919 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087e8ff-7a6d-4ff9-b2f8-ef768de3d3b2 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:09.387191 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087e8ff-7a6d-4ff9-b2f8-ef768de3d3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:09.387453 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087e8ff-7a6d-4ff9-b2f8-ef768de3d3b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:09.388106 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087e8ff-7a6d-4ff9-b2f8-ef768de3d3b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:09.388398 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087e8ff-7a6d-4ff9-b2f8-ef768de3d3b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:09.389802 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087e8ff-7a6d-4ff9-b2f8-ef768de3d3b2 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:09.406845 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 437/867] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:09.411976 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087e8ff-7a6d-4ff9-b2f8-ef768de3d3b2 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:09.425496 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c2fcb-f404-4e73-a085-5f3d0c9ebae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:09.426457 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c2fcb-f404-4e73-a085-5f3d0c9ebae1 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:09.427387 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c2fcb-f404-4e73-a085-5f3d0c9ebae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:09.427859 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c2fcb-f404-4e73-a085-5f3d0c9ebae1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:09.441789 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c2fcb-f404-4e73-a085-5f3d0c9ebae1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:09.444260 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c2fcb-f404-4e73-a085-5f3d0c9ebae1 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:09.463851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:09.465500 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-228c2fcb-f404-4e73-a085-5f3d0c9ebae1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:47:09.465500 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:09.465500 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:09.465500 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:09.465500 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:09.465500 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:09.465500 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:09.465500 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:09.465500 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:09.465500 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:09.465500 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:09.465500 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:09.465500 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:47:09.465500 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:47:09.465500 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:47:09.465500 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:47:09.466426 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:09.466426 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:09.466426 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:09.466426 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:09.466426 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:09.466426 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:09.466426 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:09.466426 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:09.466426 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:09.466426 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:09.466426 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:09.466426 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:09.466426 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:09.466426 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:09.466426 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:09.466426 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:09.466426 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:47:09.467325 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:47:09.467325 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:47:09.467325 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:09.469988 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 431/868] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:47:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 15:47:09.480803 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c2fcb-f404-4e73-a085-5f3d0c9ebae1 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:09.525204 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:09.529625 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087e8ff-7a6d-4ff9-b2f8-ef768de3d3b2 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:09.563478 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20532ed5-c701-4690-bbbb-d8ab1d74df2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:09.564141 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20532ed5-c701-4690-bbbb-d8ab1d74df2a None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:09.564382 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20532ed5-c701-4690-bbbb-d8ab1d74df2a None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:09.564658 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20532ed5-c701-4690-bbbb-d8ab1d74df2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:09.571431 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20532ed5-c701-4690-bbbb-d8ab1d74df2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:09.572893 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20532ed5-c701-4690-bbbb-d8ab1d74df2a None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:09.584823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-20532ed5-c701-4690-bbbb-d8ab1d74df2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:47:09.584823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:09.584823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:09.584823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:09.584823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:09.584823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:09.584823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:09.584823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:09.584823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:09.584823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:09.584823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:09.584823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:09.584823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 15:47:09.584823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 15:47:09.584823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 15:47:09.585764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 15:47:09.585764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:09.585764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:09.585764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:09.585764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:09.585764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:09.585764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:09.585764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:09.585764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:09.585764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:09.585764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:09.585764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:09.585764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:09.585764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:09.585764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:09.585764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:09.585764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:09.586618 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 15:47:09.586618 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 15:47:09.586618 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 15:47:09.586618 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 15:47:09.586618 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 15:47:09.586618 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 15:47:09.586618 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:47:09.586618 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:09.586618 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 438/869] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:47:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 15:47:09.586618 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20532ed5-c701-4690-bbbb-d8ab1d74df2a None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:09.594410 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c2fcb-f404-4e73-a085-5f3d0c9ebae1 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:09.634126 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424249e2-2af3-44fb-b30e-b7361d59b1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:09.634739 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424249e2-2af3-44fb-b30e-b7361d59b1b2 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:09.635021 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424249e2-2af3-44fb-b30e-b7361d59b1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:09.635291 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424249e2-2af3-44fb-b30e-b7361d59b1b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:09.636651 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424249e2-2af3-44fb-b30e-b7361d59b1b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:09.636904 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424249e2-2af3-44fb-b30e-b7361d59b1b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:09.638286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424249e2-2af3-44fb-b30e-b7361d59b1b2 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:09.655696 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 432/870] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:47:09.655696 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424249e2-2af3-44fb-b30e-b7361d59b1b2 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:09.699068 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:09.702641 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20532ed5-c701-4690-bbbb-d8ab1d74df2a None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:09.742978 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439d19f-d9d9-4d79-b967-4c38150f1d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:09.743813 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439d19f-d9d9-4d79-b967-4c38150f1d9f None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:09.743951 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439d19f-d9d9-4d79-b967-4c38150f1d9f None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:09.744119 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439d19f-d9d9-4d79-b967-4c38150f1d9f None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:09.744772 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d439d19f-d9d9-4d79-b967-4c38150f1d9f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:09.746770 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d439d19f-d9d9-4d79-b967-4c38150f1d9f None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:09.764840 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 439/871] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Aug 30 15:47:09 2022] POST /identity/v3/services => generated 251 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:47:09.770159 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439d19f-d9d9-4d79-b967-4c38150f1d9f None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:09.774119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424249e2-2af3-44fb-b30e-b7361d59b1b2 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:09.784473 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:09.827053 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b0260e-7523-4c84-b428-f225d4b5e6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:09.827898 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0260e-7523-4c84-b428-f225d4b5e6b5 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:09.828278 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0260e-7523-4c84-b428-f225d4b5e6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:09.828725 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0260e-7523-4c84-b428-f225d4b5e6b5 None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:09.829586 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b0260e-7523-4c84-b428-f225d4b5e6b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:09.829997 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b0260e-7523-4c84-b428-f225d4b5e6b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:09.832018 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b0260e-7523-4c84-b428-f225d4b5e6b5 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:09.853137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 433/872] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 30 15:47:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:09.855557 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b0260e-7523-4c84-b428-f225d4b5e6b5 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:09.925324 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439d19f-d9d9-4d79-b967-4c38150f1d9f None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:09.968725 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f387c-9978-40ed-b7a4-5138d2e85809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:09.969401 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f387c-9978-40ed-b7a4-5138d2e85809 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:09.969682 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f387c-9978-40ed-b7a4-5138d2e85809 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:09.969956 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f387c-9978-40ed-b7a4-5138d2e85809 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:09.980045 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f387c-9978-40ed-b7a4-5138d2e85809 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:09.980045 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f387c-9978-40ed-b7a4-5138d2e85809 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:09.988762 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b0260e-7523-4c84-b428-f225d4b5e6b5 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:09.994603 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-f43f387c-9978-40ed-b7a4-5138d2e85809 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:47:09.994603 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:09.994603 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:09.994603 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:09.994603 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:09.994603 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:09.994603 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:09.994603 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:09.994603 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:09.994603 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:09.994603 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:09.994603 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:09.994603 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 15:47:09.994603 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 15:47:09.994603 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 15:47:09.995716 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 15:47:09.995716 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:09.995716 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:09.995716 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:09.995716 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:09.995716 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:09.995716 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:09.995716 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:09.995716 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:09.995716 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:09.995716 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:09.995716 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:09.995716 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:09.995716 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:09.995716 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:09.995716 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:09.995716 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:09.996677 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 15:47:09.996677 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 15:47:09.996677 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 15:47:09.996677 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 15:47:09.996677 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 15:47:09.996677 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 15:47:09.996677 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:47:09.996677 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:10.000978 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 440/873] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:47:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:10.002277 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f387c-9978-40ed-b7a4-5138d2e85809 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:10.033623 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:10.036088 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa5ae0-402d-4986-b3b9-3317a5cd4626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:10.036510 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa5ae0-402d-4986-b3b9-3317a5cd4626 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:10.036993 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa5ae0-402d-4986-b3b9-3317a5cd4626 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:10.037435 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa5ae0-402d-4986-b3b9-3317a5cd4626 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:10.038312 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa5ae0-402d-4986-b3b9-3317a5cd4626 None admin] RBAC: Adding query filter params (role.id=676938e69210499ca11ee75dd572d0dc, scope.project.id=51f312b4cd8b449aa2971993f68de9af, user.id=94765f224c734beabe83b4dc0c5e511f) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:10.038803 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa5ae0-402d-4986-b3b9-3317a5cd4626 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:10.040390 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa5ae0-402d-4986-b3b9-3317a5cd4626 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:10.048601 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 434/874] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:47:09 2022] GET /identity/v3/role_assignments?user.id=94765f224c734beabe83b4dc0c5e511f&scope.project.id=51f312b4cd8b449aa2971993f68de9af&role.id=676938e69210499ca11ee75dd572d0dc => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:47:10.132566 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f387c-9978-40ed-b7a4-5138d2e85809 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:10.170750 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63c7e5-4361-4a13-a528-ccf43582d13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:10.171682 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63c7e5-4361-4a13-a528-ccf43582d13d None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:10.172134 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63c7e5-4361-4a13-a528-ccf43582d13d None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:10.172582 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63c7e5-4361-4a13-a528-ccf43582d13d None admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:10.173463 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63c7e5-4361-4a13-a528-ccf43582d13d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:10.173915 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63c7e5-4361-4a13-a528-ccf43582d13d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:10.175515 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63c7e5-4361-4a13-a528-ccf43582d13d None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:10.189778 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 441/875] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 30 15:47:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:10.197988 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa5ae0-402d-4986-b3b9-3317a5cd4626 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:10.230034 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:10.309287 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa5ae0-402d-4986-b3b9-3317a5cd4626 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:10.349715 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140e6f9-5654-48aa-9836-899c622517ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:10.350326 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140e6f9-5654-48aa-9836-899c622517ca None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:10.350607 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140e6f9-5654-48aa-9836-899c622517ca None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:10.350878 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140e6f9-5654-48aa-9836-899c622517ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:10.351608 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4140e6f9-5654-48aa-9836-899c622517ca None admin] RBAC: Adding query filter params (role.id=c99e31de7c4c47c7b7b2c45c2771ca58, scope.project.id=51f312b4cd8b449aa2971993f68de9af, user.id=d7958b395d5e4f5da37927536b1856ae) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:10.351912 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4140e6f9-5654-48aa-9836-899c622517ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:10.353383 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4140e6f9-5654-48aa-9836-899c622517ca None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:10.364904 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 435/876] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:47:10 2022] GET /identity/v3/role_assignments?user.id=d7958b395d5e4f5da37927536b1856ae&scope.project.id=51f312b4cd8b449aa2971993f68de9af&role.id=c99e31de7c4c47c7b7b2c45c2771ca58 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:10.849207 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d1562-db5d-422b-9eae-3e3b606625ef None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:10.849730 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d1562-db5d-422b-9eae-3e3b606625ef None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:10.849730 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d1562-db5d-422b-9eae-3e3b606625ef None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:10.851291 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 442/877] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:47:10.857217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ff163-8237-4e51-b9fb-65b0ff60d2e6 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:10.857648 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ff163-8237-4e51-b9fb-65b0ff60d2e6 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:10.857794 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ff163-8237-4e51-b9fb-65b0ff60d2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:10.876272 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-f84ff163-8237-4e51-b9fb-65b0ff60d2e6 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:10.877550 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-f84ff163-8237-4e51-b9fb-65b0ff60d2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:10.953606 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 436/878] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:10 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:47:11.222490 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d1562-db5d-422b-9eae-3e3b606625ef None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:11.322648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:11.344345 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d1562-db5d-422b-9eae-3e3b606625ef None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:11.379026 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43edb9-e91d-47b1-bac6-c69b8b770657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:11.379661 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43edb9-e91d-47b1-bac6-c69b8b770657 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:11.379943 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43edb9-e91d-47b1-bac6-c69b8b770657 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:11.380216 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43edb9-e91d-47b1-bac6-c69b8b770657 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:11.380811 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43edb9-e91d-47b1-bac6-c69b8b770657 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:11.382199 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43edb9-e91d-47b1-bac6-c69b8b770657 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:11.391659 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-ee43edb9-e91d-47b1-bac6-c69b8b770657 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 15:47:11.391659 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:11.391659 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 15:47:11.391659 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 15:47:11.391659 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 15:47:11.391659 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 15:47:11.391659 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 15:47:11.391659 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:47:11.391659 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 15:47:11.391659 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:11.391659 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 15:47:11.391659 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:11.391659 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:11.391659 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:11.391659 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:11.391659 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:11.392906 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:11.392906 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:11.392906 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:11.392906 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:11.392906 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:11.392906 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:11.392906 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:11.392906 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 15:47:11.392906 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 15:47:11.392906 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 15:47:11.392906 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 15:47:11.392906 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:11.392906 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:11.392906 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:11.392906 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:11.392906 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:11.392906 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:11.393802 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:11.393802 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:11.393802 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:11.393802 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:11.393802 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:11.393802 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:11.393802 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:11.393802 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:11.393802 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:11.393802 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:11.393802 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 15:47:11.393802 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:47:11.393802 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 15:47:11.393802 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:11.393802 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 443/879] 10.222.0.25 () {56 vars in 1132 bytes} [Tue Aug 30 15:47:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:11.399427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ff163-8237-4e51-b9fb-65b0ff60d2e6 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:11.421655 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:11.506268 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ff163-8237-4e51-b9fb-65b0ff60d2e6 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:11.543679 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72489cfa-e395-4259-a7ed-fc3d89dc0247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:11.544317 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72489cfa-e395-4259-a7ed-fc3d89dc0247 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:11.544595 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72489cfa-e395-4259-a7ed-fc3d89dc0247 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:11.544899 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72489cfa-e395-4259-a7ed-fc3d89dc0247 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:11.545560 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72489cfa-e395-4259-a7ed-fc3d89dc0247 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:11.545862 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72489cfa-e395-4259-a7ed-fc3d89dc0247 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:11.547290 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72489cfa-e395-4259-a7ed-fc3d89dc0247 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:11.553364 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 437/880] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Aug 30 15:47:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:11.562013 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43edb9-e91d-47b1-bac6-c69b8b770657 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:11.664306 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43edb9-e91d-47b1-bac6-c69b8b770657 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:11.699872 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e08b8-f8b2-4e53-a33e-3fa2e4065201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:11.700487 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e08b8-f8b2-4e53-a33e-3fa2e4065201 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:11.700769 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e08b8-f8b2-4e53-a33e-3fa2e4065201 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:11.701067 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e08b8-f8b2-4e53-a33e-3fa2e4065201 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:11.701703 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e08b8-f8b2-4e53-a33e-3fa2e4065201 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:11.702005 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e08b8-f8b2-4e53-a33e-3fa2e4065201 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:11.703422 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e08b8-f8b2-4e53-a33e-3fa2e4065201 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:11.708602 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 444/881] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Aug 30 15:47:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:11.714771 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72489cfa-e395-4259-a7ed-fc3d89dc0247 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:11.790381 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e8d67-f889-471c-af90-33eb13c3f27e None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:11.790558 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e8d67-f889-471c-af90-33eb13c3f27e None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:11.790840 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e8d67-f889-471c-af90-33eb13c3f27e None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:11.793109 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 445/882] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:47:11.798117 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca7fa2-c0de-4b34-97e7-5250dfcd4877 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:11.798410 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca7fa2-c0de-4b34-97e7-5250dfcd4877 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:11.799300 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca7fa2-c0de-4b34-97e7-5250dfcd4877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:11.814564 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:11.819008 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-b8ca7fa2-c0de-4b34-97e7-5250dfcd4877 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:11.820932 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-b8ca7fa2-c0de-4b34-97e7-5250dfcd4877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:11.824265 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:11.834711 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72489cfa-e395-4259-a7ed-fc3d89dc0247 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:11.875219 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5857047-6aaf-4338-a811-4766b25cdda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:11.875865 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5857047-6aaf-4338-a811-4766b25cdda7 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:11.876111 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5857047-6aaf-4338-a811-4766b25cdda7 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:11.876386 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5857047-6aaf-4338-a811-4766b25cdda7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:11.877148 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5857047-6aaf-4338-a811-4766b25cdda7 None admin] RBAC: Adding query filter params (interface=public, service_id=4b898c9296764f1c95f089e3061de786, region_id=RegionOne) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:11.877511 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5857047-6aaf-4338-a811-4766b25cdda7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:11.879010 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5857047-6aaf-4338-a811-4766b25cdda7 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:11.885796 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 438/883] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Aug 30 15:47:11 2022] GET /identity/v3/endpoints?service_id=4b898c9296764f1c95f089e3061de786&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:11.891317 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5857047-6aaf-4338-a811-4766b25cdda7 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:11.914231 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 446/884] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:11 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:47:12.006376 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5857047-6aaf-4338-a811-4766b25cdda7 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:12.049090 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ca537-c0b9-4c0b-9e49-d043c0e9bb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:12.049614 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ca537-c0b9-4c0b-9e49-d043c0e9bb33 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:12.049889 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ca537-c0b9-4c0b-9e49-d043c0e9bb33 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:12.050163 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ca537-c0b9-4c0b-9e49-d043c0e9bb33 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:12.050770 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ca537-c0b9-4c0b-9e49-d043c0e9bb33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:12.052138 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ca537-c0b9-4c0b-9e49-d043c0e9bb33 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:12.058590 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 439/885] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Aug 30 15:47:11 2022] GET /identity/v3/services => generated 1268 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:47:12.149330 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eaa8c3-3373-4eb8-b70a-5daa09b85f7a None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:12.150025 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eaa8c3-3373-4eb8-b70a-5daa09b85f7a None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:12.150516 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eaa8c3-3373-4eb8-b70a-5daa09b85f7a None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:12.152420 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 447/886] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:47:12.157806 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8147f-caf9-41c5-808d-d0649f4e6611 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:12.158092 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8147f-caf9-41c5-808d-d0649f4e6611 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:12.158361 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8147f-caf9-41c5-808d-d0649f4e6611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:12.178203 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-f2c8147f-caf9-41c5-808d-d0649f4e6611 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:12.179487 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-f2c8147f-caf9-41c5-808d-d0649f4e6611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:12.188769 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:12.224598 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eaa8c3-3373-4eb8-b70a-5daa09b85f7a None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:12.259266 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 440/887] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:12 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:47:12.341495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eaa8c3-3373-4eb8-b70a-5daa09b85f7a None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:12.378899 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216462db-f522-4b4f-a184-592a23be4754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:12.379546 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216462db-f522-4b4f-a184-592a23be4754 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:12.379825 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216462db-f522-4b4f-a184-592a23be4754 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:12.380098 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216462db-f522-4b4f-a184-592a23be4754 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:12.380688 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216462db-f522-4b4f-a184-592a23be4754 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:12.382134 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216462db-f522-4b4f-a184-592a23be4754 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:12.392723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-216462db-f522-4b4f-a184-592a23be4754 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 15:47:12.392723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:12.392723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 15:47:12.392723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 15:47:12.392723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 15:47:12.392723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 15:47:12.392723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 15:47:12.392723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:47:12.392723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 15:47:12.392723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:12.392723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 15:47:12.392723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:12.392723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:12.392723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:12.392723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:12.392723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:12.392723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:12.393816 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:12.393816 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:12.393816 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:12.393816 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:12.393816 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:12.393816 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:12.393816 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 15:47:12.393816 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 15:47:12.393816 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 15:47:12.393816 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 15:47:12.393816 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:12.393816 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:12.393816 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:12.393816 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:12.393816 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:12.393816 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:12.394656 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:12.394656 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:12.394656 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:12.394656 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:12.394656 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:12.394656 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:12.394656 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:12.394656 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:12.394656 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:12.394656 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:12.394656 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 15:47:12.394656 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:47:12.394656 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 15:47:12.394656 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:12.394656 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 448/888] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Aug 30 15:47:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:12.400134 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8147f-caf9-41c5-808d-d0649f4e6611 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:12.465281 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a44481-7cff-4ad3-822e-ad5bd6a9b7f8 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:12.465563 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a44481-7cff-4ad3-822e-ad5bd6a9b7f8 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:12.465839 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a44481-7cff-4ad3-822e-ad5bd6a9b7f8 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:12.468101 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 449/889] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:47:12.473468 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daeecc5-6934-43c9-8c44-4b2fad59e329 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:12.473826 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daeecc5-6934-43c9-8c44-4b2fad59e329 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:12.474177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daeecc5-6934-43c9-8c44-4b2fad59e329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:12.481133 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:12.496413 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-8daeecc5-6934-43c9-8c44-4b2fad59e329 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:12.498071 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-8daeecc5-6934-43c9-8c44-4b2fad59e329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:12.509870 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8147f-caf9-41c5-808d-d0649f4e6611 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:12.547382 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b842df-2429-474a-b543-1e74cbbeaaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:12.548003 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b842df-2429-474a-b543-1e74cbbeaaaa None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:12.548275 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b842df-2429-474a-b543-1e74cbbeaaaa None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:12.548880 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b842df-2429-474a-b543-1e74cbbeaaaa None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:12.549580 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b842df-2429-474a-b543-1e74cbbeaaaa None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:12.549810 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b842df-2429-474a-b543-1e74cbbeaaaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:12.551185 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b842df-2429-474a-b543-1e74cbbeaaaa None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:12.561411 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 441/890] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Aug 30 15:47:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:12.561411 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b842df-2429-474a-b543-1e74cbbeaaaa None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:12.571160 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:12.585065 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 450/891] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:12 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:47:12.585860 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daeecc5-6934-43c9-8c44-4b2fad59e329 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:12.680076 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b842df-2429-474a-b543-1e74cbbeaaaa None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:12.719987 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daeecc5-6934-43c9-8c44-4b2fad59e329 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:12.738905 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0783ac-c5fe-4278-bb3e-678efa940df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:12.739894 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0783ac-c5fe-4278-bb3e-678efa940df5 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:12.740383 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0783ac-c5fe-4278-bb3e-678efa940df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:12.740865 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0783ac-c5fe-4278-bb3e-678efa940df5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:12.741633 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0783ac-c5fe-4278-bb3e-678efa940df5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:12.743170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0783ac-c5fe-4278-bb3e-678efa940df5 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:12.753657 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-4b0783ac-c5fe-4278-bb3e-678efa940df5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 15:47:12.753657 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:12.753657 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 15:47:12.753657 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 15:47:12.753657 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 15:47:12.753657 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 15:47:12.753657 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 15:47:12.753657 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:47:12.753657 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 15:47:12.753657 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:12.753657 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 15:47:12.753657 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:12.753657 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:12.753657 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:12.753657 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:12.753657 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:12.753657 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:12.754625 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:12.754625 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:12.754625 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:12.754625 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:12.754625 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:12.754625 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:12.754625 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 15:47:12.754625 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 15:47:12.754625 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 15:47:12.754625 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 15:47:12.754625 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:12.754625 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:12.754625 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:12.754625 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:12.754625 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:12.754625 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:12.755451 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:12.755451 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:12.755451 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:12.755451 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:12.755451 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:12.755451 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:12.755451 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:12.755451 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:12.755451 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:12.755451 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:12.755451 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 15:47:12.755451 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:47:12.755451 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 15:47:12.755451 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:12.756165 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:12.758311 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 442/892] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Aug 30 15:47:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:12.764241 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0783ac-c5fe-4278-bb3e-678efa940df5 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:12.765141 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b79d3-cef1-4784-b0de-c2c94746da17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:12.765890 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b79d3-cef1-4784-b0de-c2c94746da17 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:12.766239 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b79d3-cef1-4784-b0de-c2c94746da17 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:12.766579 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b79d3-cef1-4784-b0de-c2c94746da17 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:12.767296 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b79d3-cef1-4784-b0de-c2c94746da17 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:12.767924 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b79d3-cef1-4784-b0de-c2c94746da17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:12.769989 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b79d3-cef1-4784-b0de-c2c94746da17 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:12.779951 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 451/893] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Aug 30 15:47:12 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:12.780891 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b79d3-cef1-4784-b0de-c2c94746da17 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:12.841973 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:12.875415 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0783ac-c5fe-4278-bb3e-678efa940df5 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:12.890171 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b79d3-cef1-4784-b0de-c2c94746da17 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:12.914009 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185ad6f-feab-4b3f-8cfa-ff593a72d47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:12.914607 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185ad6f-feab-4b3f-8cfa-ff593a72d47a None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:12.914881 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185ad6f-feab-4b3f-8cfa-ff593a72d47a None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:12.915148 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185ad6f-feab-4b3f-8cfa-ff593a72d47a None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:12.915771 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8185ad6f-feab-4b3f-8cfa-ff593a72d47a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:12.916065 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8185ad6f-feab-4b3f-8cfa-ff593a72d47a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:12.917622 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8185ad6f-feab-4b3f-8cfa-ff593a72d47a None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:12.926901 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 443/894] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Aug 30 15:47:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:12.927584 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185ad6f-feab-4b3f-8cfa-ff593a72d47a None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:12.929742 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3921fe8e-4683-4162-b04d-bdf63e278811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:12.930536 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921fe8e-4683-4162-b04d-bdf63e278811 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:12.930762 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921fe8e-4683-4162-b04d-bdf63e278811 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:12.931031 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921fe8e-4683-4162-b04d-bdf63e278811 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:12.931733 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3921fe8e-4683-4162-b04d-bdf63e278811 None admin] RBAC: Adding query filter params (interface=public, service_id=012801ae1ed047ef81868eb44e5f76eb, region_id=RegionOne) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:12.932035 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3921fe8e-4683-4162-b04d-bdf63e278811 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:12.934464 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3921fe8e-4683-4162-b04d-bdf63e278811 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:12.939667 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 452/895] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Aug 30 15:47:12 2022] GET /identity/v3/endpoints?service_id=012801ae1ed047ef81868eb44e5f76eb&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:12.940442 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3921fe8e-4683-4162-b04d-bdf63e278811 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:13.004179 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:13.043622 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185ad6f-feab-4b3f-8cfa-ff593a72d47a None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:13.047068 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3921fe8e-4683-4162-b04d-bdf63e278811 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:13.082141 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c531d7-017f-4360-913d-ea22bd441078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:13.082346 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47752554-06fe-44bd-a7fe-06f224e446ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:13.082778 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c531d7-017f-4360-913d-ea22bd441078 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:13.082950 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47752554-06fe-44bd-a7fe-06f224e446ff None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:13.083047 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c531d7-017f-4360-913d-ea22bd441078 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:13.083210 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47752554-06fe-44bd-a7fe-06f224e446ff None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:13.083315 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c531d7-017f-4360-913d-ea22bd441078 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:13.083480 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47752554-06fe-44bd-a7fe-06f224e446ff None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:13.084093 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47752554-06fe-44bd-a7fe-06f224e446ff None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:13.084387 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47752554-06fe-44bd-a7fe-06f224e446ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:13.085196 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:13.085824 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47752554-06fe-44bd-a7fe-06f224e446ff None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:13.090911 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 453/896] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Aug 30 15:47:12 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:13.097006 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c531d7-017f-4360-913d-ea22bd441078 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:47:13.101876 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47752554-06fe-44bd-a7fe-06f224e446ff None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:13.102479 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-f0c531d7-017f-4360-913d-ea22bd441078 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 15:47:13.102479 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:13.102479 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:13.102479 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:13.102479 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:13.102479 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:13.102479 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:13.102479 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:13.102479 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:13.102479 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:13.102479 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:13.102479 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:13.102479 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:47:13.102479 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:47:13.102479 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:47:13.102479 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:47:13.103403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:47:13.103403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:47:13.103403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:47:13.103403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:47:13.103403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:13.103403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:13.103403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:13.103403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:13.103403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:13.103403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:13.103403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:13.103403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:13.103403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:13.103403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:13.103403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:13.103403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:13.105032 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:13.105032 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:13.105032 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:13.105032 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:13.105032 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:47:13.105032 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:47:13.105032 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:47:13.105032 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:47:13.105032 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:47:13.105032 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:47:13.105032 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 15:47:13.105032 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:13.105032 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 444/897] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Aug 30 15:47:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:13.112834 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c531d7-017f-4360-913d-ea22bd441078 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:13.224132 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47752554-06fe-44bd-a7fe-06f224e446ff None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:13.239159 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c531d7-017f-4360-913d-ea22bd441078 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:13.253749 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:13.269142 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82988ec-dcfa-4357-9d00-1da660897a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:13.269748 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82988ec-dcfa-4357-9d00-1da660897a61 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:13.270177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82988ec-dcfa-4357-9d00-1da660897a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:13.270452 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82988ec-dcfa-4357-9d00-1da660897a61 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:13.271059 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82988ec-dcfa-4357-9d00-1da660897a61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:13.273005 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82988ec-dcfa-4357-9d00-1da660897a61 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:13.280354 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 454/898] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Aug 30 15:47:13 2022] GET /identity/v3/services => generated 1268 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:47:13.285185 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f66f4-a3b2-40dd-98ca-0a7758e65419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:13.286166 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f66f4-a3b2-40dd-98ca-0a7758e65419 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:13.286658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f66f4-a3b2-40dd-98ca-0a7758e65419 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:13.287236 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f66f4-a3b2-40dd-98ca-0a7758e65419 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:13.288149 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f66f4-a3b2-40dd-98ca-0a7758e65419 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:13.288667 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f66f4-a3b2-40dd-98ca-0a7758e65419 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:13.290333 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f66f4-a3b2-40dd-98ca-0a7758e65419 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:13.301619 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 445/899] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Aug 30 15:47:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:13.307075 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82988ec-dcfa-4357-9d00-1da660897a61 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:13.423686 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82988ec-dcfa-4357-9d00-1da660897a61 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:13.461645 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288cb76-9a2f-4ff4-a7af-54d8dc4dd4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:13.462282 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288cb76-9a2f-4ff4-a7af-54d8dc4dd4fc None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:13.462556 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288cb76-9a2f-4ff4-a7af-54d8dc4dd4fc None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:13.462825 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288cb76-9a2f-4ff4-a7af-54d8dc4dd4fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:13.474304 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9288cb76-9a2f-4ff4-a7af-54d8dc4dd4fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:13.475684 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9288cb76-9a2f-4ff4-a7af-54d8dc4dd4fc None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:13.491663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-9288cb76-9a2f-4ff4-a7af-54d8dc4dd4fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:47:13.491663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:13.491663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:13.491663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:13.491663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:13.491663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:13.491663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:13.491663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:13.491663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:13.491663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:13.491663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:13.491663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:13.491663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:47:13.491663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:47:13.491663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:47:13.491663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:47:13.492648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:13.492648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:13.492648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:13.492648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:13.492648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:13.492648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:13.492648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:13.492648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:13.492648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:13.492648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:13.492648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:13.492648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:13.492648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:13.492648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:13.492648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:13.492648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:13.492648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:47:13.493554 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:47:13.493554 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:47:13.493554 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:13.493554 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 455/900] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:47:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 15:47:13.498766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f66f4-a3b2-40dd-98ca-0a7758e65419 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:13.564816 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:13.612706 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f66f4-a3b2-40dd-98ca-0a7758e65419 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:13.648539 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205fe58b-36bb-4bb4-97de-9c1381398a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:13.649475 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fe58b-36bb-4bb4-97de-9c1381398a1b None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:13.649908 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fe58b-36bb-4bb4-97de-9c1381398a1b None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:13.650332 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fe58b-36bb-4bb4-97de-9c1381398a1b None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:13.651755 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205fe58b-36bb-4bb4-97de-9c1381398a1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:13.652366 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205fe58b-36bb-4bb4-97de-9c1381398a1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:13.653944 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205fe58b-36bb-4bb4-97de-9c1381398a1b None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:13.667779 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 446/901] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:47:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:13.675338 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288cb76-9a2f-4ff4-a7af-54d8dc4dd4fc None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:13.724012 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:13.791635 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288cb76-9a2f-4ff4-a7af-54d8dc4dd4fc None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:13.827880 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e95eb-91c9-4f14-894d-c137a596da5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:13.828765 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e95eb-91c9-4f14-894d-c137a596da5e None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:13.829219 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e95eb-91c9-4f14-894d-c137a596da5e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:13.829640 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e95eb-91c9-4f14-894d-c137a596da5e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:13.837481 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e95eb-91c9-4f14-894d-c137a596da5e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:13.839831 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e95eb-91c9-4f14-894d-c137a596da5e None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:13.851205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-4e0e95eb-91c9-4f14-894d-c137a596da5e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 15:47:13.851205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:13.851205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:13.851205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:13.851205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:13.851205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:13.851205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:13.851205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:13.851205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:13.851205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:13.851205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:13.851205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:13.851205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 15:47:13.851205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 15:47:13.851205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 15:47:13.851205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 15:47:13.852342 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:13.852342 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:13.852342 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 15:47:13.852342 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:47:13.852342 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 15:47:13.852342 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:47:13.852342 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:13.852342 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:13.852342 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:13.852342 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:13.852342 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:13.852342 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:13.852342 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:13.852342 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:13.852342 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:13.852342 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:13.852342 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:13.852342 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:13.853552 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:13.853552 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:13.853552 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 15:47:13.853552 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 15:47:13.853552 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 15:47:13.853552 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 15:47:13.853552 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 15:47:13.853552 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 15:47:13.853552 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 15:47:13.853552 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:13.855693 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 456/902] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Aug 30 15:47:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:13.861866 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205fe58b-36bb-4bb4-97de-9c1381398a1b None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:13.972634 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205fe58b-36bb-4bb4-97de-9c1381398a1b None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:13.993297 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:14.012719 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287517e-aacc-45a9-b2ae-03a37b42202e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:14.013364 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287517e-aacc-45a9-b2ae-03a37b42202e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:14.013645 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287517e-aacc-45a9-b2ae-03a37b42202e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:14.013918 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287517e-aacc-45a9-b2ae-03a37b42202e None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:14.014658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2287517e-aacc-45a9-b2ae-03a37b42202e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:14.014963 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2287517e-aacc-45a9-b2ae-03a37b42202e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:14.016402 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2287517e-aacc-45a9-b2ae-03a37b42202e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:14.035529 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 447/903] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Aug 30 15:47:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:14.041097 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61516241-5b52-4150-b26f-3c7909da2f4b None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:14.041568 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61516241-5b52-4150-b26f-3c7909da2f4b None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:14.041859 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61516241-5b52-4150-b26f-3c7909da2f4b None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:14.042627 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287517e-aacc-45a9-b2ae-03a37b42202e None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:14.043459 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 457/904] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:47:14.049199 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c3da0-526d-4864-8c2c-190f948d91d9 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:14.049659 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c3da0-526d-4864-8c2c-190f948d91d9 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:14.050085 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c3da0-526d-4864-8c2c-190f948d91d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:14.070360 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-598c3da0-526d-4864-8c2c-190f948d91d9 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:14.072126 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-598c3da0-526d-4864-8c2c-190f948d91d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:14.152529 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287517e-aacc-45a9-b2ae-03a37b42202e None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:14.168868 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 458/905] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:14 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 15:47:14.193071 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232845c-480b-4d91-815d-d4ccbcd50ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:14.193944 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232845c-480b-4d91-815d-d4ccbcd50ceb None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:14.194390 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232845c-480b-4d91-815d-d4ccbcd50ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:14.194869 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232845c-480b-4d91-815d-d4ccbcd50ceb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:14.243083 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:14.270239 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6232845c-480b-4d91-815d-d4ccbcd50ceb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:14.271760 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6232845c-480b-4d91-815d-d4ccbcd50ceb None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:14.374153 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 448/906] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:47:14 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 15:47:14.381892 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c3da0-526d-4864-8c2c-190f948d91d9 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:14.414538 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:14.464557 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232845c-480b-4d91-815d-d4ccbcd50ceb None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:14.495768 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c3da0-526d-4864-8c2c-190f948d91d9 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:14.537774 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00776b-47bd-4b06-8fa8-ef0e17c11802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:14.538859 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00776b-47bd-4b06-8fa8-ef0e17c11802 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:14.539426 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00776b-47bd-4b06-8fa8-ef0e17c11802 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:14.539899 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00776b-47bd-4b06-8fa8-ef0e17c11802 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:14.544339 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:14.552343 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad00776b-47bd-4b06-8fa8-ef0e17c11802 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:14.554173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad00776b-47bd-4b06-8fa8-ef0e17c11802 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:14.570640 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232845c-480b-4d91-815d-d4ccbcd50ceb None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:14.571694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-ad00776b-47bd-4b06-8fa8-ef0e17c11802 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:47:14.571694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:14.571694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:14.571694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:14.571694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:14.571694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:14.571694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:14.571694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:14.571694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:14.571694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:14.571694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:14.571694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:14.571694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:47:14.571694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:47:14.571694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:47:14.571694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:47:14.572600 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:14.572600 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:14.572600 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:14.572600 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:14.572600 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:14.572600 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:14.572600 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:14.572600 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:14.572600 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:14.572600 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:14.572600 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:14.572600 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:14.572600 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:14.572600 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:14.572600 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:14.572600 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:14.572600 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:47:14.574141 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:47:14.574141 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:47:14.574141 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:14.576437 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 459/907] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:47:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:14.582101 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00776b-47bd-4b06-8fa8-ef0e17c11802 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:14.608198 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bea9c5-1a39-47df-b42f-e1b587e77165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:14.608922 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bea9c5-1a39-47df-b42f-e1b587e77165 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:14.609183 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bea9c5-1a39-47df-b42f-e1b587e77165 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:14.609457 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bea9c5-1a39-47df-b42f-e1b587e77165 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:14.610046 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bea9c5-1a39-47df-b42f-e1b587e77165 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:14.611477 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bea9c5-1a39-47df-b42f-e1b587e77165 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:14.620624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-18bea9c5-1a39-47df-b42f-e1b587e77165 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 15:47:14.620624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:14.620624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 15:47:14.620624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 15:47:14.620624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 15:47:14.620624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 15:47:14.620624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 15:47:14.620624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:47:14.620624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 15:47:14.620624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:14.620624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 15:47:14.620624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:14.620624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:14.620624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:14.620624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:14.620624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:14.621583 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:14.621583 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:14.621583 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:14.621583 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:14.621583 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:14.621583 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:14.621583 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:14.621583 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 15:47:14.621583 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 15:47:14.621583 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 15:47:14.621583 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 15:47:14.621583 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:14.621583 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:14.621583 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:14.621583 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:14.621583 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:14.621583 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:14.622452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:14.622452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:14.622452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:14.622452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:14.622452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:14.622452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:14.622452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:14.622452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:14.622452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:14.622452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:14.622452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 15:47:14.622452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:47:14.622452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 15:47:14.622452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:14.626753 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 449/908] 10.222.0.25 () {56 vars in 1132 bytes} [Tue Aug 30 15:47:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:14.627976 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bea9c5-1a39-47df-b42f-e1b587e77165 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:14.679090 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:14.702145 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00776b-47bd-4b06-8fa8-ef0e17c11802 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:14.733953 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bea9c5-1a39-47df-b42f-e1b587e77165 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:14.742132 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784c40b-6486-4ea0-bea1-dc35c74c6765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:14.743064 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784c40b-6486-4ea0-bea1-dc35c74c6765 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:14.743619 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784c40b-6486-4ea0-bea1-dc35c74c6765 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:14.744096 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784c40b-6486-4ea0-bea1-dc35c74c6765 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:14.745307 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784c40b-6486-4ea0-bea1-dc35c74c6765 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:14.745947 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784c40b-6486-4ea0-bea1-dc35c74c6765 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:14.747617 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784c40b-6486-4ea0-bea1-dc35c74c6765 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:14.766785 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 460/909] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:47:14.768520 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784c40b-6486-4ea0-bea1-dc35c74c6765 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:14.770486 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da964bc-899e-4e03-a8ce-5edde9aab425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:14.771104 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da964bc-899e-4e03-a8ce-5edde9aab425 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:14.771383 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da964bc-899e-4e03-a8ce-5edde9aab425 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:14.771657 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da964bc-899e-4e03-a8ce-5edde9aab425 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:14.772317 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da964bc-899e-4e03-a8ce-5edde9aab425 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:14.772640 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da964bc-899e-4e03-a8ce-5edde9aab425 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:14.774442 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da964bc-899e-4e03-a8ce-5edde9aab425 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:14.784538 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 450/910] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Aug 30 15:47:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:14.785907 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da964bc-899e-4e03-a8ce-5edde9aab425 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:14.788655 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:14.884097 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784c40b-6486-4ea0-bea1-dc35c74c6765 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:14.892669 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da964bc-899e-4e03-a8ce-5edde9aab425 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:14.923850 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802a454-f7c4-4781-bb6b-f237200a2996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:14.924963 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802a454-f7c4-4781-bb6b-f237200a2996 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:14.925539 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802a454-f7c4-4781-bb6b-f237200a2996 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:14.926081 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802a454-f7c4-4781-bb6b-f237200a2996 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:14.927758 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812cfd0-9127-4320-a59d-7a6cdafbb548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:14.928373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812cfd0-9127-4320-a59d-7a6cdafbb548 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:14.928660 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812cfd0-9127-4320-a59d-7a6cdafbb548 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:14.928998 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812cfd0-9127-4320-a59d-7a6cdafbb548 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:14.929653 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9812cfd0-9127-4320-a59d-7a6cdafbb548 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:14.929959 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9812cfd0-9127-4320-a59d-7a6cdafbb548 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:14.931505 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9812cfd0-9127-4320-a59d-7a6cdafbb548 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:14.936185 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802a454-f7c4-4781-bb6b-f237200a2996 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:14.937975 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802a454-f7c4-4781-bb6b-f237200a2996 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:14.942215 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 451/911] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Aug 30 15:47:14 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:14.943595 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812cfd0-9127-4320-a59d-7a6cdafbb548 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:14.951615 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-e802a454-f7c4-4781-bb6b-f237200a2996 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:47:14.951615 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:14.951615 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:14.951615 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:14.951615 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:14.951615 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:14.951615 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:14.951615 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:14.951615 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:14.951615 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:14.951615 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:14.951615 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:14.951615 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 15:47:14.951615 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 15:47:14.951615 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 15:47:14.952526 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 15:47:14.952526 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:14.952526 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:14.952526 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:14.952526 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:14.952526 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:14.952526 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:14.952526 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:14.952526 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:14.952526 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:14.952526 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:14.952526 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:14.952526 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:14.952526 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:14.952526 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:14.952526 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:14.952526 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:14.953463 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 15:47:14.953463 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 15:47:14.953463 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 15:47:14.953463 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 15:47:14.953463 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 15:47:14.953463 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 15:47:14.953463 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:47:14.953463 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:14.960537 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 461/912] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:47:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:14.961640 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802a454-f7c4-4781-bb6b-f237200a2996 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:14.965357 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:15.013723 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:15.052529 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812cfd0-9127-4320-a59d-7a6cdafbb548 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:15.080656 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802a454-f7c4-4781-bb6b-f237200a2996 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:15.089182 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b488610-7fe4-417c-8009-fe654bb5739e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:15.089830 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b488610-7fe4-417c-8009-fe654bb5739e None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:15.090118 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b488610-7fe4-417c-8009-fe654bb5739e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:15.090844 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b488610-7fe4-417c-8009-fe654bb5739e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:15.091519 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b488610-7fe4-417c-8009-fe654bb5739e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:15.093610 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b488610-7fe4-417c-8009-fe654bb5739e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:15.117723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626556b-743a-4b1d-b27b-46dc93f7f6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:15.118340 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626556b-743a-4b1d-b27b-46dc93f7f6bd None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:15.118620 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626556b-743a-4b1d-b27b-46dc93f7f6bd None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:15.118892 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626556b-743a-4b1d-b27b-46dc93f7f6bd None admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:15.119587 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2626556b-743a-4b1d-b27b-46dc93f7f6bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:15.120102 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2626556b-743a-4b1d-b27b-46dc93f7f6bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:15.121733 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2626556b-743a-4b1d-b27b-46dc93f7f6bd None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:15.124991 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 452/913] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:47:14 2022] POST /identity/v3/endpoints => generated 347 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:47:15.126632 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e4a2c-5ee1-4a6c-a1d3-048c8a3f57b9 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:15.126993 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e4a2c-5ee1-4a6c-a1d3-048c8a3f57b9 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:15.127422 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e4a2c-5ee1-4a6c-a1d3-048c8a3f57b9 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:15.128924 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 453/914] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:47:15.134860 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b57ac8-5196-4dbf-bb6a-f1645c6ca54e None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:15.135169 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b57ac8-5196-4dbf-bb6a-f1645c6ca54e None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:15.135353 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b57ac8-5196-4dbf-bb6a-f1645c6ca54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:15.153977 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 462/915] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 30 15:47:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:15.159833 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626556b-743a-4b1d-b27b-46dc93f7f6bd None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:15.162529 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-22b57ac8-5196-4dbf-bb6a-f1645c6ca54e None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:15.163817 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-22b57ac8-5196-4dbf-bb6a-f1645c6ca54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:15.255837 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:15.257190 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 454/916] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:15 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 15:47:15.301322 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626556b-743a-4b1d-b27b-46dc93f7f6bd None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:15.338060 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8bc43-b693-42fe-9b05-54f4575fd2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:15.339061 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8bc43-b693-42fe-9b05-54f4575fd2ce None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:15.339495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8bc43-b693-42fe-9b05-54f4575fd2ce None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:15.339912 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8bc43-b693-42fe-9b05-54f4575fd2ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:15.341147 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb8bc43-b693-42fe-9b05-54f4575fd2ce None admin] RBAC: Adding query filter params (role.id=341b3ebd68374dd5bb372bc283d34fd7, scope.project.id=51f312b4cd8b449aa2971993f68de9af, user.id=d7958b395d5e4f5da37927536b1856ae) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:15.341632 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb8bc43-b693-42fe-9b05-54f4575fd2ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:15.343458 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb8bc43-b693-42fe-9b05-54f4575fd2ce None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:15.350396 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 463/917] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:47:15 2022] GET /identity/v3/role_assignments?user.id=d7958b395d5e4f5da37927536b1856ae&scope.project.id=51f312b4cd8b449aa2971993f68de9af&role.id=341b3ebd68374dd5bb372bc283d34fd7 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:47:15.383246 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97560b6f-1704-425a-b8c7-458b0b794e8f None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:15.383562 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97560b6f-1704-425a-b8c7-458b0b794e8f None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:15.383792 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97560b6f-1704-425a-b8c7-458b0b794e8f None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:15.386139 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 455/918] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:47:15.392267 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eaa98c-50df-419d-8096-409a12e84478 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:15.393063 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eaa98c-50df-419d-8096-409a12e84478 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:15.393482 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eaa98c-50df-419d-8096-409a12e84478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:15.414128 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-29eaa98c-50df-419d-8096-409a12e84478 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:15.415637 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-29eaa98c-50df-419d-8096-409a12e84478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:15.493837 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 464/919] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:15 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:47:15.543429 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97560b6f-1704-425a-b8c7-458b0b794e8f None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:15.598970 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:15.656801 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97560b6f-1704-425a-b8c7-458b0b794e8f None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:15.694775 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4666a54-2e80-448b-8b66-82e98b3efada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:15.695441 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4666a54-2e80-448b-8b66-82e98b3efada None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:15.695728 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4666a54-2e80-448b-8b66-82e98b3efada None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:15.696002 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4666a54-2e80-448b-8b66-82e98b3efada None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:15.696675 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4666a54-2e80-448b-8b66-82e98b3efada None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:15.698124 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4666a54-2e80-448b-8b66-82e98b3efada None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:15.719762 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 456/920] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Aug 30 15:47:15 2022] POST /identity/v3/services => generated 241 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:47:15.789609 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eaa98c-50df-419d-8096-409a12e84478 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:15.860666 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:15.909545 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eaa98c-50df-419d-8096-409a12e84478 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:15.952814 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310bd40-69db-4ceb-8cbb-ca3dd691842d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:15.953445 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310bd40-69db-4ceb-8cbb-ca3dd691842d None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:15.953721 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310bd40-69db-4ceb-8cbb-ca3dd691842d None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:15.953988 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310bd40-69db-4ceb-8cbb-ca3dd691842d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:15.954568 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310bd40-69db-4ceb-8cbb-ca3dd691842d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:15.955926 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310bd40-69db-4ceb-8cbb-ca3dd691842d None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:15.965451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-0310bd40-69db-4ceb-8cbb-ca3dd691842d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 15:47:15.965451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:15.965451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 15:47:15.965451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 15:47:15.965451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 15:47:15.965451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 15:47:15.965451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 15:47:15.965451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:47:15.965451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 15:47:15.965451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:15.965451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 15:47:15.965451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:15.965451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:15.965451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:15.965451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:15.965451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:15.965451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:15.966414 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:15.966414 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:15.966414 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:15.966414 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:15.966414 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:15.966414 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:15.966414 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 15:47:15.966414 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 15:47:15.966414 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 15:47:15.966414 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 15:47:15.966414 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:15.966414 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:15.966414 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:15.966414 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:15.966414 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:15.966414 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:15.967235 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:15.967235 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:15.967235 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:15.967235 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:15.967235 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:15.967235 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:15.967235 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:15.967235 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:15.967235 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:15.967235 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:15.967235 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 15:47:15.967235 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:47:15.967235 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 15:47:15.967235 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:15.967235 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 465/921] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Aug 30 15:47:15 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:15.972850 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4666a54-2e80-448b-8b66-82e98b3efada None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:16.081437 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4666a54-2e80-448b-8b66-82e98b3efada None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:16.091529 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:16.120899 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b736b2-ad17-489a-b0ab-cc50b6e617c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:16.121902 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b736b2-ad17-489a-b0ab-cc50b6e617c8 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:16.122392 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b736b2-ad17-489a-b0ab-cc50b6e617c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:16.122859 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b736b2-ad17-489a-b0ab-cc50b6e617c8 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:16.123698 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b736b2-ad17-489a-b0ab-cc50b6e617c8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:16.124193 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b736b2-ad17-489a-b0ab-cc50b6e617c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:16.125876 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b736b2-ad17-489a-b0ab-cc50b6e617c8 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:16.131405 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 457/922] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Aug 30 15:47:15 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:16.138387 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310bd40-69db-4ceb-8cbb-ca3dd691842d None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:16.249221 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310bd40-69db-4ceb-8cbb-ca3dd691842d None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:16.266995 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:16.288524 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26953776-dee5-4895-b8ea-8ece6c6e5c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:16.289424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26953776-dee5-4895-b8ea-8ece6c6e5c52 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:16.289861 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26953776-dee5-4895-b8ea-8ece6c6e5c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:16.290290 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26953776-dee5-4895-b8ea-8ece6c6e5c52 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:16.291067 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26953776-dee5-4895-b8ea-8ece6c6e5c52 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:16.291506 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26953776-dee5-4895-b8ea-8ece6c6e5c52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:16.293181 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26953776-dee5-4895-b8ea-8ece6c6e5c52 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:16.298846 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 466/923] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Aug 30 15:47:16 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:16.305362 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b736b2-ad17-489a-b0ab-cc50b6e617c8 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:16.412026 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b736b2-ad17-489a-b0ab-cc50b6e617c8 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:16.447458 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc45fa-b708-405e-9e7f-50ff670d5d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:16.448142 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc45fa-b708-405e-9e7f-50ff670d5d1c None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:16.448421 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc45fa-b708-405e-9e7f-50ff670d5d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:16.448695 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc45fa-b708-405e-9e7f-50ff670d5d1c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:16.449420 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc45fa-b708-405e-9e7f-50ff670d5d1c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:16.450839 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc45fa-b708-405e-9e7f-50ff670d5d1c None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:16.478394 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 458/924] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:47:16 2022] POST /identity/v3/endpoints => generated 346 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:47:17.252876 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0e94b-4099-43a9-8481-b95030648c29 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:17.253396 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0e94b-4099-43a9-8481-b95030648c29 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:17.253396 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0e94b-4099-43a9-8481-b95030648c29 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:17.255011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 467/925] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:47:17.260603 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c1dff-b6da-4d9e-9762-a07b1f913391 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:17.261157 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c1dff-b6da-4d9e-9762-a07b1f913391 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:17.261157 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c1dff-b6da-4d9e-9762-a07b1f913391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:17.280226 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-dd4c1dff-b6da-4d9e-9762-a07b1f913391 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:17.281430 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-dd4c1dff-b6da-4d9e-9762-a07b1f913391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:17.309965 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:17.315538 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f724bc-4224-4e87-9cb9-442352e92c4f None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:17.316061 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f724bc-4224-4e87-9cb9-442352e92c4f None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:17.316553 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f724bc-4224-4e87-9cb9-442352e92c4f None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:17.318449 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 468/926] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:47:17.323825 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6756d69-9ec2-4d2c-8c4e-4a625fe7dcf6 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:17.324111 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6756d69-9ec2-4d2c-8c4e-4a625fe7dcf6 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:17.324387 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6756d69-9ec2-4d2c-8c4e-4a625fe7dcf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:17.344302 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-b6756d69-9ec2-4d2c-8c4e-4a625fe7dcf6 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:17.345515 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-b6756d69-9ec2-4d2c-8c4e-4a625fe7dcf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:17.376580 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 459/927] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:47:17.422860 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 469/928] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 15:47:17.645808 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4c1dff-b6da-4d9e-9762-a07b1f913391 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:17.692876 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6756d69-9ec2-4d2c-8c4e-4a625fe7dcf6 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:17.763833 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4c1dff-b6da-4d9e-9762-a07b1f913391 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:17.800092 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca28f482-5cad-4ddd-a76b-9b3440d56bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:17.800768 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28f482-5cad-4ddd-a76b-9b3440d56bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:17.801024 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28f482-5cad-4ddd-a76b-9b3440d56bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:17.801283 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28f482-5cad-4ddd-a76b-9b3440d56bb0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:17.801899 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca28f482-5cad-4ddd-a76b-9b3440d56bb0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:17.803228 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca28f482-5cad-4ddd-a76b-9b3440d56bb0 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:17.806970 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6756d69-9ec2-4d2c-8c4e-4a625fe7dcf6 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:17.813154 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-ca28f482-5cad-4ddd-a76b-9b3440d56bb0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 15:47:17.813154 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:17.813154 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 15:47:17.813154 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 15:47:17.813154 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 15:47:17.813154 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 15:47:17.813154 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 15:47:17.813154 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:47:17.813154 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 15:47:17.813154 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:17.813154 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 15:47:17.813154 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:17.813154 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:17.813154 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:17.813154 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:17.813154 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:17.813154 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:17.814137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:17.814137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:17.814137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:17.814137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:17.814137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:17.814137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:17.814137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 15:47:17.814137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 15:47:17.814137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 15:47:17.814137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 15:47:17.814137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:17.814137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:17.814137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:17.814137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:17.814137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:17.814137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:17.817790 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:17.817790 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:17.817790 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:17.817790 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:17.817790 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:17.817790 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:17.817790 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:17.817790 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:17.817790 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:17.817790 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:17.817790 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 15:47:17.817790 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:47:17.817790 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 15:47:17.817790 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:17.817790 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 460/929] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:47:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:17.818561 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b93cd-06c9-4ca9-8900-09e31410fd12 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:17.818561 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b93cd-06c9-4ca9-8900-09e31410fd12 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:17.818561 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b93cd-06c9-4ca9-8900-09e31410fd12 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:17.818561 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 461/930] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:47:17.822231 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b93cd-06c9-4ca9-8900-09e31410fd12 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:17.823305 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:17.843570 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:17.850867 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a6b5e-cdf2-4e18-b41d-1cdcb32a072a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:17.851388 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a6b5e-cdf2-4e18-b41d-1cdcb32a072a None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:17.851663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a6b5e-cdf2-4e18-b41d-1cdcb32a072a None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:17.851922 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a6b5e-cdf2-4e18-b41d-1cdcb32a072a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:17.863345 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a6b5e-cdf2-4e18-b41d-1cdcb32a072a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:47:17.868079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-206a6b5e-cdf2-4e18-b41d-1cdcb32a072a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 15:47:17.868079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:17.868079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:17.868079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:17.868079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:17.868079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:17.868079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:17.868079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:17.868079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:17.868079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:17.868079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:17.868079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:17.868079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:47:17.868079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:47:17.868079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:47:17.868079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:47:17.869007 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:47:17.869007 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:47:17.869007 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:47:17.869007 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:47:17.869007 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:17.869007 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:17.869007 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:17.869007 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:17.869007 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:17.869007 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:17.869007 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:17.869007 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:17.869007 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:17.869007 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:17.869007 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:17.869007 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:17.869881 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:17.869881 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:17.869881 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:17.869881 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:17.869881 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:47:17.869881 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:47:17.869881 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:47:17.869881 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:47:17.869881 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:47:17.869881 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:47:17.869881 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 15:47:17.869881 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:17.874288 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 470/931] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Aug 30 15:47:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:17.875498 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854532c-e847-4ae9-aeac-a729888daf09 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:17.875836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854532c-e847-4ae9-aeac-a729888daf09 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:17.876109 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854532c-e847-4ae9-aeac-a729888daf09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:17.895313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-7854532c-e847-4ae9-aeac-a729888daf09 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:17.896561 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7854532c-e847-4ae9-aeac-a729888daf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:17.935500 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b93cd-06c9-4ca9-8900-09e31410fd12 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:17.971141 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70498afd-74fe-4413-9624-33ea03064c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:17.971759 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70498afd-74fe-4413-9624-33ea03064c86 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:17.972042 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70498afd-74fe-4413-9624-33ea03064c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:17.972528 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 471/932] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:47:17.973255 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854532c-e847-4ae9-aeac-a729888daf09 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:17.980998 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70498afd-74fe-4413-9624-33ea03064c86 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:17.982606 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70498afd-74fe-4413-9624-33ea03064c86 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:17.983119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70498afd-74fe-4413-9624-33ea03064c86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:17.985282 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70498afd-74fe-4413-9624-33ea03064c86 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:17.998039 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 462/933] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Aug 30 15:47:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:18.000156 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70498afd-74fe-4413-9624-33ea03064c86 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:18.078314 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:18.081650 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854532c-e847-4ae9-aeac-a729888daf09 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:18.112572 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:18.129764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264059e-c957-417a-a5ce-1124626e3a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:18.130911 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264059e-c957-417a-a5ce-1124626e3a20 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:18.131391 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264059e-c957-417a-a5ce-1124626e3a20 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:18.131833 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264059e-c957-417a-a5ce-1124626e3a20 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:18.132274 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70498afd-74fe-4413-9624-33ea03064c86 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:18.132905 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264059e-c957-417a-a5ce-1124626e3a20 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:18.133527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264059e-c957-417a-a5ce-1124626e3a20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:18.136094 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264059e-c957-417a-a5ce-1124626e3a20 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:18.146745 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 472/934] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Aug 30 15:47:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:18.152361 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264059e-c957-417a-a5ce-1124626e3a20 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:18.178763 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf6406-ecb3-4918-bcac-67b2ce71d5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:18.179375 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf6406-ecb3-4918-bcac-67b2ce71d5db None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:18.179652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf6406-ecb3-4918-bcac-67b2ce71d5db None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:18.179923 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf6406-ecb3-4918-bcac-67b2ce71d5db None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:18.180560 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbf6406-ecb3-4918-bcac-67b2ce71d5db None admin] RBAC: Adding query filter params (type=compute) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:18.180885 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbf6406-ecb3-4918-bcac-67b2ce71d5db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:18.183427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbf6406-ecb3-4918-bcac-67b2ce71d5db None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:18.192870 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 463/935] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Aug 30 15:47:17 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:18.246495 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf6406-ecb3-4918-bcac-67b2ce71d5db None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:18.290758 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264059e-c957-417a-a5ce-1124626e3a20 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:18.339633 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5aecb9-483a-42d7-ae88-5cd3656f863f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:18.340286 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5aecb9-483a-42d7-ae88-5cd3656f863f None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:18.340562 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5aecb9-483a-42d7-ae88-5cd3656f863f None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:18.340865 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5aecb9-483a-42d7-ae88-5cd3656f863f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:18.356912 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5aecb9-483a-42d7-ae88-5cd3656f863f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:18.358848 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5aecb9-483a-42d7-ae88-5cd3656f863f None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:18.368118 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf6406-ecb3-4918-bcac-67b2ce71d5db None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:18.377663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-5b5aecb9-483a-42d7-ae88-5cd3656f863f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:47:18.377663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:18.377663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:18.377663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:18.377663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:18.377663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:18.377663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:18.377663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:18.377663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:18.377663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:18.377663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:18.377663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:18.377663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:47:18.377663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:47:18.377663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:47:18.377663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:47:18.378628 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:18.378628 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:18.378628 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:18.378628 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:18.378628 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:18.378628 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:18.378628 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:18.378628 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:18.378628 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:18.378628 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:18.378628 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:18.378628 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:18.378628 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:18.378628 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:18.378628 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:18.378628 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:18.378628 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:47:18.380644 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:47:18.380644 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:47:18.380644 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:18.380644 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 473/936] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:47:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:18.385715 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5aecb9-483a-42d7-ae88-5cd3656f863f None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:18.407472 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:18.418768 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd975d01-fa09-4065-88e3-53776319f8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:18.419413 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd975d01-fa09-4065-88e3-53776319f8ac None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:18.419696 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd975d01-fa09-4065-88e3-53776319f8ac None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:18.419970 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd975d01-fa09-4065-88e3-53776319f8ac None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:18.420566 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd975d01-fa09-4065-88e3-53776319f8ac None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:18.421988 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd975d01-fa09-4065-88e3-53776319f8ac None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:18.431220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-bd975d01-fa09-4065-88e3-53776319f8ac None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 15:47:18.431220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:18.431220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 15:47:18.431220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 15:47:18.431220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 15:47:18.431220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 15:47:18.431220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 15:47:18.431220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:47:18.431220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 15:47:18.431220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:18.431220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 15:47:18.431220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:18.431220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:18.431220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:18.431220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:18.431220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:18.431220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:18.432906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:18.432906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:18.432906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:18.432906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:18.432906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:18.432906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:18.432906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 15:47:18.432906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 15:47:18.432906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 15:47:18.432906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 15:47:18.432906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:18.432906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:18.432906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:18.432906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:18.432906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:18.432906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:18.433764 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:18.433764 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:18.433764 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:18.433764 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:18.433764 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:18.433764 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:18.433764 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:18.433764 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:18.433764 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:18.433764 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:18.433764 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 15:47:18.433764 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:47:18.433764 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 15:47:18.433764 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:18.433764 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 464/937] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Aug 30 15:47:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 15:47:18.439317 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd975d01-fa09-4065-88e3-53776319f8ac None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:18.452818 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:18.507660 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5aecb9-483a-42d7-ae88-5cd3656f863f None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:18.544143 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf534881-316f-404c-a2bf-4b9a42a95da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:18.544755 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf534881-316f-404c-a2bf-4b9a42a95da5 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:18.545056 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf534881-316f-404c-a2bf-4b9a42a95da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:18.545328 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf534881-316f-404c-a2bf-4b9a42a95da5 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:18.545965 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf534881-316f-404c-a2bf-4b9a42a95da5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:18.546260 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf534881-316f-404c-a2bf-4b9a42a95da5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:18.547542 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd975d01-fa09-4065-88e3-53776319f8ac None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:18.547660 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf534881-316f-404c-a2bf-4b9a42a95da5 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:18.565038 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 474/938] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:47:18.565038 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184151bc-5ba0-449f-8a9c-eedc66ed99ad None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:18.565038 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184151bc-5ba0-449f-8a9c-eedc66ed99ad None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:18.565038 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184151bc-5ba0-449f-8a9c-eedc66ed99ad None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:18.565038 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 475/939] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:47:18.566106 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184151bc-5ba0-449f-8a9c-eedc66ed99ad None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:18.595820 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223df2a-7233-4aac-9bad-892e3839afd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:18.596442 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223df2a-7233-4aac-9bad-892e3839afd1 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:18.596727 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223df2a-7233-4aac-9bad-892e3839afd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:18.597051 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223df2a-7233-4aac-9bad-892e3839afd1 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:18.597694 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f223df2a-7233-4aac-9bad-892e3839afd1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:18.598007 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f223df2a-7233-4aac-9bad-892e3839afd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:18.599398 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f223df2a-7233-4aac-9bad-892e3839afd1 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:18.604920 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 465/940] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Aug 30 15:47:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:18.609971 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537f0a5-7dff-4ec2-b27e-9b73590453d9 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:18.610256 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537f0a5-7dff-4ec2-b27e-9b73590453d9 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:18.610536 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537f0a5-7dff-4ec2-b27e-9b73590453d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:18.629087 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-f537f0a5-7dff-4ec2-b27e-9b73590453d9 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:18.630281 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-f537f0a5-7dff-4ec2-b27e-9b73590453d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:18.644970 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:18.673994 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184151bc-5ba0-449f-8a9c-eedc66ed99ad None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:18.708110 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 466/941] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:47:18.708110 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537f0a5-7dff-4ec2-b27e-9b73590453d9 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:18.714628 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:18.721080 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453a37c-ce5a-4f89-932f-ee9c0a8285e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:18.722217 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453a37c-ce5a-4f89-932f-ee9c0a8285e9 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:18.722310 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453a37c-ce5a-4f89-932f-ee9c0a8285e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:18.722626 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453a37c-ce5a-4f89-932f-ee9c0a8285e9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:18.731865 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d453a37c-ce5a-4f89-932f-ee9c0a8285e9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:18.733756 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d453a37c-ce5a-4f89-932f-ee9c0a8285e9 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:18.751539 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-d453a37c-ce5a-4f89-932f-ee9c0a8285e9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 15:47:18.751539 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:18.751539 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:18.751539 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:18.751539 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:18.751539 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:18.751539 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:18.751539 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:18.751539 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:18.751539 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:18.751539 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:18.751539 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:18.751539 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 15:47:18.751539 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 15:47:18.751539 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 15:47:18.751539 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 15:47:18.753237 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:18.753237 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:18.753237 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 15:47:18.753237 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:47:18.753237 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 15:47:18.753237 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:47:18.753237 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:18.753237 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:18.753237 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:18.753237 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:18.753237 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:18.753237 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:18.753237 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:18.753237 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:18.753237 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:18.753237 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:18.753237 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:18.753237 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:18.754200 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:18.754200 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:18.754200 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 15:47:18.754200 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 15:47:18.754200 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 15:47:18.754200 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 15:47:18.754200 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 15:47:18.754200 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 15:47:18.754200 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 15:47:18.754200 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:18.755560 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 476/942] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Aug 30 15:47:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:18.765735 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453a37c-ce5a-4f89-932f-ee9c0a8285e9 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:18.838982 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537f0a5-7dff-4ec2-b27e-9b73590453d9 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:18.869232 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453a37c-ce5a-4f89-932f-ee9c0a8285e9 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:18.876693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a68980-73bc-4e5c-883e-af724e62738f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:18.877521 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a68980-73bc-4e5c-883e-af724e62738f None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:18.877805 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a68980-73bc-4e5c-883e-af724e62738f None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:18.878079 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a68980-73bc-4e5c-883e-af724e62738f None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:18.878734 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a68980-73bc-4e5c-883e-af724e62738f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:18.879039 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a68980-73bc-4e5c-883e-af724e62738f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:18.880833 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a68980-73bc-4e5c-883e-af724e62738f None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:18.888061 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 467/943] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Aug 30 15:47:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:18.896324 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a68980-73bc-4e5c-883e-af724e62738f None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:18.913224 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d6ebc-2dca-497b-8eee-875c52b0cdd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:18.914050 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d6ebc-2dca-497b-8eee-875c52b0cdd9 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:18.914401 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d6ebc-2dca-497b-8eee-875c52b0cdd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:18.914747 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d6ebc-2dca-497b-8eee-875c52b0cdd9 None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:18.915546 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d6ebc-2dca-497b-8eee-875c52b0cdd9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:18.915919 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d6ebc-2dca-497b-8eee-875c52b0cdd9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:18.918273 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d6ebc-2dca-497b-8eee-875c52b0cdd9 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:18.919995 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:18.943407 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 477/944] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Aug 30 15:47:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:47:18.944516 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d6ebc-2dca-497b-8eee-875c52b0cdd9 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:18.978124 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:19.016934 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a68980-73bc-4e5c-883e-af724e62738f None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:19.053696 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae1f4a4-2e16-4edd-bf1f-80848c123cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:19.054309 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1f4a4-2e16-4edd-bf1f-80848c123cad None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:19.054418 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d6ebc-2dca-497b-8eee-875c52b0cdd9 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:19.054610 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1f4a4-2e16-4edd-bf1f-80848c123cad None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:19.054862 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1f4a4-2e16-4edd-bf1f-80848c123cad None admin] PATH_INFO: `/v3/endpoints` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:19.055567 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae1f4a4-2e16-4edd-bf1f-80848c123cad None admin] RBAC: Adding query filter params (interface=public, service_id=84178458efbe41dc8ff4f9d830a6e735, region_id=RegionOne) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:19.056043 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae1f4a4-2e16-4edd-bf1f-80848c123cad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:19.058234 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae1f4a4-2e16-4edd-bf1f-80848c123cad None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:19.068858 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 468/945] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Aug 30 15:47:18 2022] GET /identity/v3/endpoints?service_id=84178458efbe41dc8ff4f9d830a6e735&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:19.068858 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae1f4a4-2e16-4edd-bf1f-80848c123cad None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:19.090511 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e2063-3e74-4ce3-8ebf-e88b9ed0d4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:19.091150 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e2063-3e74-4ce3-8ebf-e88b9ed0d4f4 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:19.091425 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e2063-3e74-4ce3-8ebf-e88b9ed0d4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:19.091689 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e2063-3e74-4ce3-8ebf-e88b9ed0d4f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:19.101580 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e2063-3e74-4ce3-8ebf-e88b9ed0d4f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:19.103015 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e2063-3e74-4ce3-8ebf-e88b9ed0d4f4 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:19.117782 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-9a5e2063-3e74-4ce3-8ebf-e88b9ed0d4f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:47:19.117782 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:19.117782 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:19.117782 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:19.117782 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:19.117782 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:19.117782 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:19.117782 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:19.117782 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:19.117782 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:19.117782 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:19.117782 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:19.117782 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:47:19.117782 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:47:19.117782 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:47:19.117782 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:47:19.118773 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:19.118773 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:19.118773 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:19.118773 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:19.118773 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:19.118773 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:19.118773 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:19.118773 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:19.118773 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:19.118773 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:19.118773 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:19.118773 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:19.118773 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:19.118773 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:19.118773 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:19.118773 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:19.118773 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:47:19.119722 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:47:19.119722 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:47:19.119722 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:19.119722 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 478/946] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:47:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:19.120166 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e2063-3e74-4ce3-8ebf-e88b9ed0d4f4 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:19.167225 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:19.184942 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae1f4a4-2e16-4edd-bf1f-80848c123cad None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:19.216769 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:19.222689 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a9f52-cc04-4743-8af7-d83fcae739f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:19.223375 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a9f52-cc04-4743-8af7-d83fcae739f3 None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:19.223652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a9f52-cc04-4743-8af7-d83fcae739f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:19.223987 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a9f52-cc04-4743-8af7-d83fcae739f3 None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:19.224561 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a9f52-cc04-4743-8af7-d83fcae739f3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:19.226026 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a9f52-cc04-4743-8af7-d83fcae739f3 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:19.226141 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e2063-3e74-4ce3-8ebf-e88b9ed0d4f4 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:19.229246 dv-cinder-855058-1-smb devstack@keystone.service[81420]: WARNING keystone.server.flask.common [None req-8d4a9f52-cc04-4743-8af7-d83fcae739f3 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 30 15:47:19.246776 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.sql.core [None req-8d4a9f52-cc04-4743-8af7-d83fcae739f3 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 15:47:19.246776 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 30 15:47:19.246776 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [parameters: {'id': '4c2846147e8c470b805c84c6672a53d2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 30 15:47:19.246776 dv-cinder-855058-1-smb devstack@keystone.service[81420]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81420) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 15:47:19.264164 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-8d4a9f52-cc04-4743-8af7-d83fcae739f3 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4c2846147e8c470b805c84c6672a53d2.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4c2846147e8c470b805c84c6672a53d2. Aug 30 15:47:19.264164 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:19.264164 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 15:47:19.264164 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 15:47:19.264164 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 15:47:19.264164 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 15:47:19.264164 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 15:47:19.264164 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 15:47:19.264164 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 15:47:19.264164 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application conn.query(q) Aug 30 15:47:19.264164 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 15:47:19.264164 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 15:47:19.264164 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 15:47:19.265238 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application result.read() Aug 30 15:47:19.265238 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 15:47:19.265238 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 15:47:19.265238 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 15:47:19.265238 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 15:47:19.265238 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 15:47:19.265238 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 15:47:19.265238 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 15:47:19.265238 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 15:47:19.265238 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 15:47:19.265238 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:19.265238 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 15:47:19.265238 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:19.265238 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:19.265238 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 15:47:19.265238 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 15:47:19.265238 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 30 15:47:19.265238 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 30 15:47:19.266250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 15:47:19.266250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application next(self.gen) Aug 30 15:47:19.266250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 15:47:19.266250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application yield resource Aug 30 15:47:19.266250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 15:47:19.266250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application next(self.gen) Aug 30 15:47:19.266250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 15:47:19.266250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 15:47:19.266250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 15:47:19.266250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 15:47:19.266250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 15:47:19.266250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise self.value Aug 30 15:47:19.266250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 15:47:19.266250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 15:47:19.266250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 15:47:19.266250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application session.commit() Aug 30 15:47:19.266250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 15:47:19.267134 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 15:47:19.267134 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 15:47:19.267134 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 15:47:19.267134 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 15:47:19.267134 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application self.session.flush() Aug 30 15:47:19.267134 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 15:47:19.267134 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 15:47:19.267134 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 15:47:19.267134 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 15:47:19.267134 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 15:47:19.267134 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application compat.raise_( Aug 30 15:47:19.267134 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 15:47:19.267134 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception Aug 30 15:47:19.267134 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 15:47:19.267134 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 15:47:19.267134 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 15:47:19.267134 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 15:47:19.268380 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 15:47:19.268380 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 15:47:19.268380 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 15:47:19.268380 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 15:47:19.268380 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 30 15:47:19.268380 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 30 15:47:19.268380 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 15:47:19.268380 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 15:47:19.268380 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 15:47:19.268380 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 15:47:19.268380 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 15:47:19.268380 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 15:47:19.268380 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 15:47:19.268380 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 15:47:19.268380 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 15:47:19.269221 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 15:47:19.269221 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 15:47:19.269221 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception Aug 30 15:47:19.269221 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 15:47:19.269221 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 15:47:19.269221 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 15:47:19.269221 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 15:47:19.269221 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 15:47:19.269221 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 15:47:19.269221 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 15:47:19.269221 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application conn.query(q) Aug 30 15:47:19.269221 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 15:47:19.269221 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 15:47:19.269221 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 15:47:19.269221 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application result.read() Aug 30 15:47:19.269221 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 15:47:19.269221 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 15:47:19.270241 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 15:47:19.270241 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 15:47:19.270241 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 15:47:19.270241 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 15:47:19.270241 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 15:47:19.270241 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 15:47:19.270241 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 15:47:19.270241 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 30 15:47:19.270241 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [parameters: {'id': '4c2846147e8c470b805c84c6672a53d2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 30 15:47:19.270241 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 15:47:19.270241 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:19.270241 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 15:47:19.270241 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:19.270241 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:19.270241 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 30 15:47:19.272103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 30 15:47:19.272103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 15:47:19.272103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 15:47:19.272103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 30 15:47:19.272103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:19.272103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 15:47:19.272103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:19.272103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:19.272103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:19.272103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:19.272103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:19.272103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:19.272103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:19.272103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:19.272103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:19.272103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:19.272103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:19.273526 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:19.273526 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 30 15:47:19.273526 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 30 15:47:19.273526 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:19.273526 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:19.273526 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 30 15:47:19.273526 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 30 15:47:19.273526 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4c2846147e8c470b805c84c6672a53d2. Aug 30 15:47:19.273526 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:19.273526 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 469/947] 10.222.0.25 () {60 vars in 1140 bytes} [Tue Aug 30 15:47:19 2022] POST /identity/v3/projects => generated 262 bytes in 201 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:19.273526 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a9f52-cc04-4743-8af7-d83fcae739f3 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:19.277460 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716298c-1baa-47cf-9916-71c18f31ae9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:19.278713 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716298c-1baa-47cf-9916-71c18f31ae9c None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:19.279242 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716298c-1baa-47cf-9916-71c18f31ae9c None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:19.279664 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716298c-1baa-47cf-9916-71c18f31ae9c None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:19.280477 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716298c-1baa-47cf-9916-71c18f31ae9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:19.282109 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716298c-1baa-47cf-9916-71c18f31ae9c None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:19.288964 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 479/948] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Aug 30 15:47:19 2022] GET /identity/v3/services => generated 1497 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:47:19.289922 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716298c-1baa-47cf-9916-71c18f31ae9c None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:19.408290 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a9f52-cc04-4743-8af7-d83fcae739f3 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:19.415824 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716298c-1baa-47cf-9916-71c18f31ae9c None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:19.426610 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:19.448903 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e4b0d-3250-49fe-a0b2-f22a2cb13e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:19.449892 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e4b0d-3250-49fe-a0b2-f22a2cb13e72 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:19.450223 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e4b0d-3250-49fe-a0b2-f22a2cb13e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:19.450693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e4b0d-3250-49fe-a0b2-f22a2cb13e72 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:19.451101 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e4b0d-3250-49fe-a0b2-f22a2cb13e72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:19.451400 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e4b0d-3250-49fe-a0b2-f22a2cb13e72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:19.453208 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e4b0d-3250-49fe-a0b2-f22a2cb13e72 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:19.455998 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40bf0d0-ce67-48d5-934a-e7760691292b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:19.456642 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40bf0d0-ce67-48d5-934a-e7760691292b None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:19.456960 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40bf0d0-ce67-48d5-934a-e7760691292b None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:19.457236 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40bf0d0-ce67-48d5-934a-e7760691292b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:19.465620 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40bf0d0-ce67-48d5-934a-e7760691292b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:19.467351 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40bf0d0-ce67-48d5-934a-e7760691292b None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:19.472725 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 470/949] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:47:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:19.475001 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e4b0d-3250-49fe-a0b2-f22a2cb13e72 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:19.481361 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-c40bf0d0-ce67-48d5-934a-e7760691292b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:47:19.481361 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:19.481361 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:19.481361 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:19.481361 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:19.481361 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:19.481361 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:19.481361 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:19.481361 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:19.481361 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:19.481361 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:19.481361 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:19.481361 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 15:47:19.481361 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 15:47:19.481361 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 15:47:19.482303 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 15:47:19.482303 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:19.482303 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:19.482303 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:19.482303 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:19.482303 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:19.482303 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:19.482303 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:19.482303 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:19.482303 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:19.482303 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:19.482303 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:19.482303 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:19.482303 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:19.482303 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:19.482303 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:19.482303 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:19.483404 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 15:47:19.483404 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 15:47:19.483404 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 15:47:19.483404 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 15:47:19.483404 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 15:47:19.483404 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 15:47:19.483404 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:47:19.483404 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:19.483404 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 480/950] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:47:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:19.490499 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40bf0d0-ce67-48d5-934a-e7760691292b None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:19.535460 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:19.605167 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e4b0d-3250-49fe-a0b2-f22a2cb13e72 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:19.615747 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40bf0d0-ce67-48d5-934a-e7760691292b None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:19.642815 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8dcf3-7a00-41ff-9df5-4dad85ced846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:19.643443 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8dcf3-7a00-41ff-9df5-4dad85ced846 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:19.643717 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8dcf3-7a00-41ff-9df5-4dad85ced846 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:19.643984 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8dcf3-7a00-41ff-9df5-4dad85ced846 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:19.651693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8dcf3-7a00-41ff-9df5-4dad85ced846 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:19.653485 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6546d-d0e3-4e9f-bd5d-bbadf1aca834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:19.653632 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8dcf3-7a00-41ff-9df5-4dad85ced846 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:19.654218 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6546d-d0e3-4e9f-bd5d-bbadf1aca834 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:19.654606 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6546d-d0e3-4e9f-bd5d-bbadf1aca834 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:19.654946 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6546d-d0e3-4e9f-bd5d-bbadf1aca834 None admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:19.655761 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6546d-d0e3-4e9f-bd5d-bbadf1aca834 None admin] RBAC: Adding query filter params (name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:19.656134 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6546d-d0e3-4e9f-bd5d-bbadf1aca834 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:19.657706 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6546d-d0e3-4e9f-bd5d-bbadf1aca834 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:19.665168 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-72d8dcf3-7a00-41ff-9df5-4dad85ced846 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:47:19.665168 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:19.665168 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:19.665168 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:19.665168 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:19.665168 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:19.665168 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:19.665168 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:19.665168 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:19.665168 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:19.665168 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:19.665168 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:19.665168 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 15:47:19.665168 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 15:47:19.665168 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 15:47:19.666064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 15:47:19.666064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:19.666064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:19.666064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:19.666064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:19.666064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:19.666064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:19.666064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:19.666064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:19.666064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:19.666064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:19.666064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:19.666064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:19.666064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:19.666064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:19.666064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:19.666064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:19.667817 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 15:47:19.667817 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 15:47:19.667817 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 15:47:19.667817 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 15:47:19.667817 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 15:47:19.667817 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 15:47:19.667817 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:47:19.667817 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:19.667817 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 471/951] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:47:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:19.676495 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8dcf3-7a00-41ff-9df5-4dad85ced846 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:19.676670 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 481/952] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Aug 30 15:47:19 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:47:19.799518 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8dcf3-7a00-41ff-9df5-4dad85ced846 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:19.822028 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:19.841436 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265926b1-3f24-45c6-aff2-d8ee8b458db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:19.842066 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265926b1-3f24-45c6-aff2-d8ee8b458db3 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:19.842339 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265926b1-3f24-45c6-aff2-d8ee8b458db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:19.842610 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265926b1-3f24-45c6-aff2-d8ee8b458db3 None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:19.843315 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265926b1-3f24-45c6-aff2-d8ee8b458db3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:19.843695 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265926b1-3f24-45c6-aff2-d8ee8b458db3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:19.845197 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265926b1-3f24-45c6-aff2-d8ee8b458db3 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:19.860073 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 472/953] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 30 15:47:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:19.865794 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6546d-d0e3-4e9f-bd5d-bbadf1aca834 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:19.900213 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:19.977840 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6546d-d0e3-4e9f-bd5d-bbadf1aca834 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:20.015826 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d90621-5b35-416d-8498-0bb5b8586de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:20.016773 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d90621-5b35-416d-8498-0bb5b8586de9 None admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:20.017492 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d90621-5b35-416d-8498-0bb5b8586de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:20.017925 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d90621-5b35-416d-8498-0bb5b8586de9 None admin] PATH_INFO: `/v3/projects/51f312b4cd8b449aa2971993f68de9af/users/d7958b395d5e4f5da37927536b1856ae/roles/341b3ebd68374dd5bb372bc283d34fd7` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:20.020237 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d90621-5b35-416d-8498-0bb5b8586de9 None admin] RBAC: Authorizing `identity:create_grant(project_id=51f312b4cd8b449aa2971993f68de9af, user_id=d7958b395d5e4f5da37927536b1856ae, role_id=341b3ebd68374dd5bb372bc283d34fd7)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:20.021864 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d90621-5b35-416d-8498-0bb5b8586de9 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:20.037601 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 482/954] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 30 15:47:19 2022] PUT /identity/v3/projects/51f312b4cd8b449aa2971993f68de9af/users/d7958b395d5e4f5da37927536b1856ae/roles/341b3ebd68374dd5bb372bc283d34fd7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:47:20.223821 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8d7e4-a611-43ec-b8c9-f7ab8e71235d None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:20.224110 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8d7e4-a611-43ec-b8c9-f7ab8e71235d None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:20.224388 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8d7e4-a611-43ec-b8c9-f7ab8e71235d None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:20.226040 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 473/955] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:47:20.232099 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed47ba7-7ee8-4670-9137-2213fa35799c None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:20.232308 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed47ba7-7ee8-4670-9137-2213fa35799c None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:20.232590 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed47ba7-7ee8-4670-9137-2213fa35799c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:20.251174 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-3ed47ba7-7ee8-4670-9137-2213fa35799c None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:20.252368 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-3ed47ba7-7ee8-4670-9137-2213fa35799c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:20.322853 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 483/956] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:47:20.598142 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8d7e4-a611-43ec-b8c9-f7ab8e71235d None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:20.715110 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8d7e4-a611-43ec-b8c9-f7ab8e71235d None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:20.753008 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e31d6-a4b3-4d77-9535-87397e136696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:20.753622 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e31d6-a4b3-4d77-9535-87397e136696 None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:20.753900 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e31d6-a4b3-4d77-9535-87397e136696 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:20.754175 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e31d6-a4b3-4d77-9535-87397e136696 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:20.754841 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62e31d6-a4b3-4d77-9535-87397e136696 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:20.756212 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62e31d6-a4b3-4d77-9535-87397e136696 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:20.780775 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 474/957] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Aug 30 15:47:20 2022] POST /identity/v3/services => generated 242 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:47:21.385885 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74dd72d-0ae3-4c6d-bc0a-b2d00d9ab540 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:21.386415 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74dd72d-0ae3-4c6d-bc0a-b2d00d9ab540 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:21.386761 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74dd72d-0ae3-4c6d-bc0a-b2d00d9ab540 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:21.388525 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 484/958] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:47:21.394128 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b76388-4432-4d3a-b10c-d64c81253f7b None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:21.394525 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b76388-4432-4d3a-b10c-d64c81253f7b None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:21.394907 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b76388-4432-4d3a-b10c-d64c81253f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:21.415935 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-31b76388-4432-4d3a-b10c-d64c81253f7b None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:21.417592 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-31b76388-4432-4d3a-b10c-d64c81253f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:21.442362 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:21.498565 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 475/959] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:21 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:47:21.772633 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74dd72d-0ae3-4c6d-bc0a-b2d00d9ab540 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:21.792283 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8ab81-70e8-444b-8f21-a22d729d875b None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:21.792853 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8ab81-70e8-444b-8f21-a22d729d875b None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:21.793022 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8ab81-70e8-444b-8f21-a22d729d875b None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:21.794743 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 476/960] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 15:47:21.797471 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:21.802073 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410e603-92dc-4bd3-a3e4-3620b242ac67 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:21.802356 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410e603-92dc-4bd3-a3e4-3620b242ac67 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:21.802636 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410e603-92dc-4bd3-a3e4-3620b242ac67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:21.832317 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-a410e603-92dc-4bd3-a3e4-3620b242ac67 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:21.833673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-a410e603-92dc-4bd3-a3e4-3620b242ac67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:21.908643 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74dd72d-0ae3-4c6d-bc0a-b2d00d9ab540 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:21.923230 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 477/961] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:21 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:47:21.957000 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71a946-2c92-49a2-a867-054ecaef5682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:21.958021 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71a946-2c92-49a2-a867-054ecaef5682 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:21.958517 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71a946-2c92-49a2-a867-054ecaef5682 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:21.959000 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71a946-2c92-49a2-a867-054ecaef5682 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:21.959794 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71a946-2c92-49a2-a867-054ecaef5682 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:21.961596 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71a946-2c92-49a2-a867-054ecaef5682 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:21.970908 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-ea71a946-2c92-49a2-a867-054ecaef5682 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 15:47:21.970908 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:21.970908 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 15:47:21.970908 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 15:47:21.970908 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 15:47:21.970908 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 15:47:21.970908 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 15:47:21.970908 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:47:21.970908 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 15:47:21.970908 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:21.970908 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 15:47:21.970908 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:21.970908 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:21.970908 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:21.970908 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:21.970908 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:21.970908 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:21.972013 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:21.972013 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:21.972013 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:21.972013 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:21.972013 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:21.972013 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:21.972013 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 15:47:21.972013 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 15:47:21.972013 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 15:47:21.972013 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 15:47:21.972013 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:21.972013 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:21.972013 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:21.972013 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:21.972013 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:21.972013 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:21.972921 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:21.972921 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:21.972921 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:21.972921 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:21.972921 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:21.972921 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:21.972921 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:21.972921 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:21.972921 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:21.972921 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:21.972921 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 15:47:21.972921 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:47:21.972921 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 15:47:21.972921 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:21.975623 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 485/962] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Aug 30 15:47:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:21.982630 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a410e603-92dc-4bd3-a3e4-3620b242ac67 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:21.984381 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6f39b-38b1-48e8-8cf7-add039d5cdd3 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:21.984662 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6f39b-38b1-48e8-8cf7-add039d5cdd3 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:21.984964 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6f39b-38b1-48e8-8cf7-add039d5cdd3 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:21.986532 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 486/963] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 15:47:21.993807 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa6454-b309-4115-9b7a-9934d3e97d6c None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:21.994085 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa6454-b309-4115-9b7a-9934d3e97d6c None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:21.994359 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa6454-b309-4115-9b7a-9934d3e97d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:22.012393 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-30fa6454-b309-4115-9b7a-9934d3e97d6c None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:22.013592 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-30fa6454-b309-4115-9b7a-9934d3e97d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:22.081050 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:22.100813 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 487/964] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:21 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:47:22.102900 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a410e603-92dc-4bd3-a3e4-3620b242ac67 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:22.138404 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975e528-d189-4f6e-a35b-17f8afe8ac33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:22.139014 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975e528-d189-4f6e-a35b-17f8afe8ac33 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:22.139290 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975e528-d189-4f6e-a35b-17f8afe8ac33 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:22.139555 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975e528-d189-4f6e-a35b-17f8afe8ac33 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:22.140190 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f975e528-d189-4f6e-a35b-17f8afe8ac33 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:22.140488 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f975e528-d189-4f6e-a35b-17f8afe8ac33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:22.141892 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f975e528-d189-4f6e-a35b-17f8afe8ac33 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:22.147626 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 478/965] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Aug 30 15:47:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:22.157861 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa6454-b309-4115-9b7a-9934d3e97d6c None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:22.172526 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:22.226402 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975e528-d189-4f6e-a35b-17f8afe8ac33 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:22.268776 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa6454-b309-4115-9b7a-9934d3e97d6c None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:22.318074 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c9f7c-9db7-4ab0-b2fe-6110eed4f7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:22.319061 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c9f7c-9db7-4ab0-b2fe-6110eed4f7b5 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:22.319345 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c9f7c-9db7-4ab0-b2fe-6110eed4f7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:22.319617 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c9f7c-9db7-4ab0-b2fe-6110eed4f7b5 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:22.320253 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c9f7c-9db7-4ab0-b2fe-6110eed4f7b5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:22.320552 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c9f7c-9db7-4ab0-b2fe-6110eed4f7b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:22.322507 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c9f7c-9db7-4ab0-b2fe-6110eed4f7b5 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:22.330023 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 488/966] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Aug 30 15:47:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:22.334304 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975e528-d189-4f6e-a35b-17f8afe8ac33 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:22.335957 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c9f7c-9db7-4ab0-b2fe-6110eed4f7b5 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:22.372965 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae824ab-edfe-4638-8b70-3f03967beef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:22.373774 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae824ab-edfe-4638-8b70-3f03967beef8 None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:22.374144 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae824ab-edfe-4638-8b70-3f03967beef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:22.374512 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae824ab-edfe-4638-8b70-3f03967beef8 None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:22.375332 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae824ab-edfe-4638-8b70-3f03967beef8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:22.376949 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae824ab-edfe-4638-8b70-3f03967beef8 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:22.392570 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.sql.core [None req-8ae824ab-edfe-4638-8b70-3f03967beef8 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 15:47:22.392570 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 30 15:47:22.392570 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [parameters: {'user_id': 'c9a4f2f4cf414e02b26a4ea2aeffe2f1', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 30 15:47:22.392570 dv-cinder-855058-1-smb devstack@keystone.service[81420]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81420) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 15:47:22.399275 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-8ae824ab-edfe-4638-8b70-3f03967beef8 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 30 15:47:22.399275 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:22.399275 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 15:47:22.399275 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 15:47:22.399275 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 15:47:22.399275 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 15:47:22.399275 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 15:47:22.399275 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 15:47:22.399275 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 15:47:22.399275 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application conn.query(q) Aug 30 15:47:22.399275 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 15:47:22.399275 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 15:47:22.399275 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 15:47:22.399275 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application result.read() Aug 30 15:47:22.399275 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 15:47:22.400365 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 15:47:22.400365 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 15:47:22.400365 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 15:47:22.400365 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 15:47:22.400365 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 15:47:22.400365 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 15:47:22.400365 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 15:47:22.400365 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 15:47:22.400365 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:22.400365 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 15:47:22.400365 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:22.400365 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:22.400365 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 15:47:22.400365 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 15:47:22.400365 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 30 15:47:22.400365 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 30 15:47:22.400365 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 15:47:22.400365 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application next(self.gen) Aug 30 15:47:22.402845 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 15:47:22.402845 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application yield resource Aug 30 15:47:22.402845 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 15:47:22.402845 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application next(self.gen) Aug 30 15:47:22.402845 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 15:47:22.402845 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 15:47:22.402845 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 15:47:22.402845 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 15:47:22.402845 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 15:47:22.402845 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise self.value Aug 30 15:47:22.402845 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 15:47:22.402845 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 15:47:22.402845 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 15:47:22.402845 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application session.commit() Aug 30 15:47:22.402845 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 15:47:22.402845 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 15:47:22.402845 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 15:47:22.404018 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 15:47:22.404018 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 15:47:22.404018 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application self.session.flush() Aug 30 15:47:22.404018 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 15:47:22.404018 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 15:47:22.404018 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 15:47:22.404018 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 15:47:22.404018 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 15:47:22.404018 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application compat.raise_( Aug 30 15:47:22.404018 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 15:47:22.404018 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception Aug 30 15:47:22.404018 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 15:47:22.404018 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 15:47:22.404018 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 15:47:22.404018 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 15:47:22.404018 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 15:47:22.404018 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 15:47:22.405184 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 15:47:22.405184 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 15:47:22.405184 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 30 15:47:22.405184 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 30 15:47:22.405184 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 15:47:22.405184 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 15:47:22.405184 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 15:47:22.405184 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 15:47:22.405184 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 15:47:22.405184 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 15:47:22.405184 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 15:47:22.405184 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 15:47:22.405184 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 15:47:22.405184 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 15:47:22.405184 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 15:47:22.405184 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception Aug 30 15:47:22.407109 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 15:47:22.407109 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 15:47:22.407109 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 15:47:22.407109 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 15:47:22.407109 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 15:47:22.407109 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 15:47:22.407109 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 15:47:22.407109 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application conn.query(q) Aug 30 15:47:22.407109 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 15:47:22.407109 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 15:47:22.407109 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 15:47:22.407109 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application result.read() Aug 30 15:47:22.407109 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 15:47:22.407109 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 15:47:22.407109 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 15:47:22.407109 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 15:47:22.408348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 15:47:22.408348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 15:47:22.408348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 15:47:22.408348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 15:47:22.408348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 15:47:22.408348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 30 15:47:22.408348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [parameters: {'user_id': 'c9a4f2f4cf414e02b26a4ea2aeffe2f1', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 30 15:47:22.408348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 15:47:22.408348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:22.408348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 15:47:22.408348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:22.408348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:22.408348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:22.408348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:22.408348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:22.410307 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:22.410307 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:22.410307 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:22.410307 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:22.410307 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:22.410307 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:22.410307 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:22.410307 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 30 15:47:22.410307 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 30 15:47:22.410307 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:22.410307 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:22.410307 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 15:47:22.410307 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:47:22.410307 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 15:47:22.410307 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:47:22.410307 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 30 15:47:22.410307 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 30 15:47:22.412565 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 30 15:47:22.412565 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 30 15:47:22.412565 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 15:47:22.412565 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 15:47:22.412565 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 30 15:47:22.412565 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:22.412565 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 479/967] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Aug 30 15:47:22 2022] POST /identity/v3/users => generated 160 bytes in 180 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 30 15:47:22.412565 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae824ab-edfe-4638-8b70-3f03967beef8 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:22.423703 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:22.435875 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:22.461967 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c9f7c-9db7-4ab0-b2fe-6110eed4f7b5 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:22.503659 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdeccb5-eca2-46b8-a9b7-8cec3e62d2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:22.504325 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdeccb5-eca2-46b8-a9b7-8cec3e62d2d6 None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:22.504697 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdeccb5-eca2-46b8-a9b7-8cec3e62d2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:22.505107 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdeccb5-eca2-46b8-a9b7-8cec3e62d2d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:22.505859 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdeccb5-eca2-46b8-a9b7-8cec3e62d2d6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:22.507360 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdeccb5-eca2-46b8-a9b7-8cec3e62d2d6 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:22.519545 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae824ab-edfe-4638-8b70-3f03967beef8 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:22.536816 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 489/968] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:47:22 2022] POST /identity/v3/endpoints => generated 349 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:47:22.536816 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdeccb5-eca2-46b8-a9b7-8cec3e62d2d6 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:22.567769 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65425133-4d40-4c1b-9fcd-cc8b5685ff4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:22.568415 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65425133-4d40-4c1b-9fcd-cc8b5685ff4d None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:22.568689 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65425133-4d40-4c1b-9fcd-cc8b5685ff4d None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:22.568984 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65425133-4d40-4c1b-9fcd-cc8b5685ff4d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:22.581590 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65425133-4d40-4c1b-9fcd-cc8b5685ff4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:47:22.587301 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-65425133-4d40-4c1b-9fcd-cc8b5685ff4d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 15:47:22.587301 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:22.587301 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:22.587301 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:22.587301 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:22.587301 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:22.587301 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:22.587301 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:22.587301 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:22.587301 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:22.587301 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:22.587301 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:22.587301 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:47:22.587301 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:47:22.587301 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:47:22.587301 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:47:22.588898 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:47:22.588898 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:47:22.588898 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:47:22.588898 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:47:22.588898 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:22.588898 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:22.588898 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:22.588898 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:22.588898 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:22.588898 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:22.588898 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:22.588898 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:22.588898 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:22.588898 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:22.588898 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:22.588898 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:22.590386 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:22.590386 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:22.590386 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:22.590386 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:22.590386 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:47:22.590386 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:47:22.590386 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:47:22.590386 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:47:22.590386 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:47:22.590386 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:47:22.590386 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 15:47:22.590386 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:22.590386 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 480/969] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Aug 30 15:47:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:22.595329 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65425133-4d40-4c1b-9fcd-cc8b5685ff4d None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:22.675095 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdeccb5-eca2-46b8-a9b7-8cec3e62d2d6 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:22.693825 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:22.715130 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:22.726498 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16844a05-7dd1-48d2-a3f4-3bff98ff5c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:22.726498 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16844a05-7dd1-48d2-a3f4-3bff98ff5c0c None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:22.726775 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16844a05-7dd1-48d2-a3f4-3bff98ff5c0c None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:22.727002 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16844a05-7dd1-48d2-a3f4-3bff98ff5c0c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:22.740583 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16844a05-7dd1-48d2-a3f4-3bff98ff5c0c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:22.742065 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16844a05-7dd1-48d2-a3f4-3bff98ff5c0c None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:22.753400 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65425133-4d40-4c1b-9fcd-cc8b5685ff4d None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:22.755431 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-16844a05-7dd1-48d2-a3f4-3bff98ff5c0c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 15:47:22.755431 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:22.755431 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:22.755431 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:22.755431 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:22.755431 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:22.755431 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:22.755431 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:22.755431 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:22.755431 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:22.755431 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:22.755431 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:22.755431 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 15:47:22.755431 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 15:47:22.755431 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 15:47:22.755431 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 15:47:22.756393 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:22.756393 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:22.756393 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 15:47:22.756393 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:47:22.756393 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 15:47:22.756393 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:47:22.756393 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:22.756393 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:22.756393 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:22.756393 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:22.756393 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:22.756393 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:22.756393 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:22.756393 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:22.756393 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:22.756393 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:22.756393 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:22.756393 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:22.757406 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:22.757406 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:22.757406 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 15:47:22.757406 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 15:47:22.757406 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 15:47:22.757406 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 15:47:22.757406 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 15:47:22.757406 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 15:47:22.757406 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 15:47:22.757406 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:22.757406 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 490/970] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:47:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:22.758033 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ebc82-b1f5-4bb3-905f-a9a4baf427e1 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:22.759398 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ebc82-b1f5-4bb3-905f-a9a4baf427e1 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:22.759398 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ebc82-b1f5-4bb3-905f-a9a4baf427e1 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:22.764984 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 491/971] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:47:22.765238 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e96e7-a8b7-4743-ad94-9cba43f58912 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:22.765480 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e96e7-a8b7-4743-ad94-9cba43f58912 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:22.765756 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e96e7-a8b7-4743-ad94-9cba43f58912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:22.788452 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-460e96e7-a8b7-4743-ad94-9cba43f58912 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:22.791066 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-460e96e7-a8b7-4743-ad94-9cba43f58912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:22.794138 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6aa6a-3a88-4010-9a2b-dba408492407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:22.794766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6aa6a-3a88-4010-9a2b-dba408492407 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:22.795046 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6aa6a-3a88-4010-9a2b-dba408492407 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:22.795317 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6aa6a-3a88-4010-9a2b-dba408492407 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:22.795992 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca6aa6a-3a88-4010-9a2b-dba408492407 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:22.796839 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca6aa6a-3a88-4010-9a2b-dba408492407 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:22.798337 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca6aa6a-3a88-4010-9a2b-dba408492407 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:22.806697 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 481/972] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Aug 30 15:47:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:22.808261 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6aa6a-3a88-4010-9a2b-dba408492407 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:22.874633 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 492/973] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:22 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:47:22.875279 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e96e7-a8b7-4743-ad94-9cba43f58912 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:22.928043 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6aa6a-3a88-4010-9a2b-dba408492407 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:22.956253 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:22.966175 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c09ef-b13a-4bdf-88ca-58e2ece4d181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:22.967077 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c09ef-b13a-4bdf-88ca-58e2ece4d181 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:22.967563 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c09ef-b13a-4bdf-88ca-58e2ece4d181 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:22.968048 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c09ef-b13a-4bdf-88ca-58e2ece4d181 None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:22.969092 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c09ef-b13a-4bdf-88ca-58e2ece4d181 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:22.969603 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c09ef-b13a-4bdf-88ca-58e2ece4d181 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:22.971244 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c09ef-b13a-4bdf-88ca-58e2ece4d181 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:22.980877 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e96e7-a8b7-4743-ad94-9cba43f58912 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:23.005861 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:23.011409 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 482/974] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 30 15:47:22 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:23.020279 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253d21a-faec-4c3c-8c54-03602118962d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:23.021032 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253d21a-faec-4c3c-8c54-03602118962d None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:23.021315 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253d21a-faec-4c3c-8c54-03602118962d None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:23.021647 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253d21a-faec-4c3c-8c54-03602118962d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:23.034489 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253d21a-faec-4c3c-8c54-03602118962d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:23.035995 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253d21a-faec-4c3c-8c54-03602118962d None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:23.053791 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-b253d21a-faec-4c3c-8c54-03602118962d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:47:23.053791 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:23.053791 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:23.053791 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:23.053791 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:23.053791 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:23.053791 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:23.053791 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:23.053791 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:23.053791 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:23.053791 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:23.053791 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:23.053791 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:47:23.053791 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:47:23.053791 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:47:23.053791 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:47:23.054810 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:23.054810 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:23.054810 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:23.054810 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:23.054810 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:23.054810 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:23.054810 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:23.054810 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:23.054810 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:23.054810 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:23.054810 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:23.054810 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:23.054810 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:23.054810 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:23.054810 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:23.054810 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:23.054810 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:47:23.056293 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:47:23.056293 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:47:23.056293 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:23.056293 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 493/975] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:47:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:23.062229 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c09ef-b13a-4bdf-88ca-58e2ece4d181 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:23.176127 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c09ef-b13a-4bdf-88ca-58e2ece4d181 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:23.180374 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253d21a-faec-4c3c-8c54-03602118962d None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:23.216695 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2e734-2b4f-4b13-adfe-17d1ea6c038a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:23.217357 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2e734-2b4f-4b13-adfe-17d1ea6c038a None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:23.217852 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2e734-2b4f-4b13-adfe-17d1ea6c038a None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:23.217956 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2e734-2b4f-4b13-adfe-17d1ea6c038a None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:23.218562 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2e734-2b4f-4b13-adfe-17d1ea6c038a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:23.218866 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2e734-2b4f-4b13-adfe-17d1ea6c038a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:23.220244 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2e734-2b4f-4b13-adfe-17d1ea6c038a None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:23.233812 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 483/976] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:23.240029 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2e734-2b4f-4b13-adfe-17d1ea6c038a None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:23.299217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:23.314775 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253d21a-faec-4c3c-8c54-03602118962d None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:23.361288 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9510a4-f706-46fe-96c3-70bf8dcdfffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:23.362282 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9510a4-f706-46fe-96c3-70bf8dcdfffa None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:23.362730 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9510a4-f706-46fe-96c3-70bf8dcdfffa None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:23.363298 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9510a4-f706-46fe-96c3-70bf8dcdfffa None admin] PATH_INFO: `/v3/services/compute` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:23.364360 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9510a4-f706-46fe-96c3-70bf8dcdfffa None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:23.366327 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9510a4-f706-46fe-96c3-70bf8dcdfffa None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:23.366697 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2e734-2b4f-4b13-adfe-17d1ea6c038a None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:23.378646 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-ac9510a4-f706-46fe-96c3-70bf8dcdfffa None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 15:47:23.378646 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:23.378646 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 15:47:23.378646 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 15:47:23.378646 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 15:47:23.378646 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 15:47:23.378646 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 15:47:23.378646 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:47:23.378646 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 15:47:23.378646 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:23.378646 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 15:47:23.378646 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:23.378646 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:23.378646 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:23.378646 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:23.378646 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:23.378646 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:23.379873 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:23.379873 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:23.379873 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:23.379873 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:23.379873 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:23.379873 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:23.379873 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 15:47:23.379873 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 15:47:23.379873 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 15:47:23.379873 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 15:47:23.379873 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:23.379873 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:23.379873 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:23.379873 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:23.379873 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:23.379873 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:23.381045 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:23.381045 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:23.381045 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:23.381045 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:23.381045 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:23.381045 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:23.381045 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:23.381045 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:23.381045 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:23.381045 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:23.381045 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 15:47:23.381045 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:47:23.381045 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 15:47:23.381045 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:23.382340 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 494/977] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:47:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 15:47:23.388483 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9510a4-f706-46fe-96c3-70bf8dcdfffa None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:23.410116 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae772cc4-9697-4013-86f5-24dd7f9e5628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:23.411069 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae772cc4-9697-4013-86f5-24dd7f9e5628 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:23.411560 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae772cc4-9697-4013-86f5-24dd7f9e5628 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:23.411977 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae772cc4-9697-4013-86f5-24dd7f9e5628 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:23.419972 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae772cc4-9697-4013-86f5-24dd7f9e5628 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:23.421797 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae772cc4-9697-4013-86f5-24dd7f9e5628 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:23.430866 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:23.434003 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-ae772cc4-9697-4013-86f5-24dd7f9e5628 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 15:47:23.434003 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:23.434003 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:23.434003 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:23.434003 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:23.434003 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:23.434003 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:23.434003 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:23.434003 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:23.434003 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:23.434003 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:23.434003 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:23.434003 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 15:47:23.434003 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 15:47:23.434003 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 15:47:23.434003 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 15:47:23.440170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:23.440170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:23.440170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 15:47:23.440170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:47:23.440170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 15:47:23.440170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:47:23.440170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:23.440170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:23.440170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:23.440170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:23.440170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:23.440170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:23.440170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:23.440170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:23.440170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:23.440170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:23.440170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:23.440170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:23.441435 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:23.441435 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:23.441435 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 15:47:23.441435 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 15:47:23.441435 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 15:47:23.441435 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 15:47:23.441435 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 15:47:23.441435 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 15:47:23.441435 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 15:47:23.441435 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:23.441435 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 484/978] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Aug 30 15:47:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:23.441435 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae772cc4-9697-4013-86f5-24dd7f9e5628 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:23.505867 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9510a4-f706-46fe-96c3-70bf8dcdfffa None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:23.539481 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44280152-6ebb-4ea4-9ae5-5fdeddc28cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:23.540209 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44280152-6ebb-4ea4-9ae5-5fdeddc28cbb None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:23.540483 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44280152-6ebb-4ea4-9ae5-5fdeddc28cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:23.540750 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44280152-6ebb-4ea4-9ae5-5fdeddc28cbb None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:23.541950 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44280152-6ebb-4ea4-9ae5-5fdeddc28cbb None admin] RBAC: Adding query filter params (name=compute) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:23.542251 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44280152-6ebb-4ea4-9ae5-5fdeddc28cbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:23.543593 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44280152-6ebb-4ea4-9ae5-5fdeddc28cbb None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:23.547289 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae772cc4-9697-4013-86f5-24dd7f9e5628 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:23.548426 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 495/979] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Aug 30 15:47:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:47:23.554006 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44280152-6ebb-4ea4-9ae5-5fdeddc28cbb None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:23.554948 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:23.586495 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce35946-cc32-44ae-a58d-7a157747775e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:23.587375 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce35946-cc32-44ae-a58d-7a157747775e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:23.587657 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce35946-cc32-44ae-a58d-7a157747775e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:23.587950 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce35946-cc32-44ae-a58d-7a157747775e None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:23.588703 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce35946-cc32-44ae-a58d-7a157747775e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:23.589436 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce35946-cc32-44ae-a58d-7a157747775e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:23.591764 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce35946-cc32-44ae-a58d-7a157747775e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:23.619154 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 485/980] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Aug 30 15:47:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:47:23.621355 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce35946-cc32-44ae-a58d-7a157747775e None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:23.664836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44280152-6ebb-4ea4-9ae5-5fdeddc28cbb None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:23.667508 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:23.709217 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a087adb-0691-4f8f-acc3-bff1ab636526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:23.710193 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a087adb-0691-4f8f-acc3-bff1ab636526 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:23.710612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a087adb-0691-4f8f-acc3-bff1ab636526 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:23.711071 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a087adb-0691-4f8f-acc3-bff1ab636526 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:23.711701 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a087adb-0691-4f8f-acc3-bff1ab636526 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:23.711998 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a087adb-0691-4f8f-acc3-bff1ab636526 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:23.714405 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a087adb-0691-4f8f-acc3-bff1ab636526 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:23.728824 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 496/981] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Aug 30 15:47:23 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:47:23.730403 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a087adb-0691-4f8f-acc3-bff1ab636526 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:23.734050 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce35946-cc32-44ae-a58d-7a157747775e None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:23.771496 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63eb7c9-a7bf-4927-8fa9-97080a04d744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:23.772340 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63eb7c9-a7bf-4927-8fa9-97080a04d744 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:23.772810 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63eb7c9-a7bf-4927-8fa9-97080a04d744 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:23.773543 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63eb7c9-a7bf-4927-8fa9-97080a04d744 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:23.813171 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:23.834779 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a087adb-0691-4f8f-acc3-bff1ab636526 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:23.855233 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63eb7c9-a7bf-4927-8fa9-97080a04d744 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:23.856687 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63eb7c9-a7bf-4927-8fa9-97080a04d744 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:23.870104 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b7070-d3e6-4d0a-860c-fd08e7c67b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:23.870865 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b7070-d3e6-4d0a-860c-fd08e7c67b4e None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:23.871150 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b7070-d3e6-4d0a-860c-fd08e7c67b4e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:23.871423 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b7070-d3e6-4d0a-860c-fd08e7c67b4e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:23.872174 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b7070-d3e6-4d0a-860c-fd08e7c67b4e None admin] RBAC: Adding query filter params (interface=public, service_id=1c6c00a5e1fb48628ffd2b13943131f6, region_id=RegionOne) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:23.872480 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b7070-d3e6-4d0a-860c-fd08e7c67b4e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:23.873872 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b7070-d3e6-4d0a-860c-fd08e7c67b4e None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:23.879083 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 497/982] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Aug 30 15:47:23 2022] GET /identity/v3/endpoints?service_id=1c6c00a5e1fb48628ffd2b13943131f6&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:47:23.884330 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b7070-d3e6-4d0a-860c-fd08e7c67b4e None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:23.917199 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:23.962957 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 486/983] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:47:23 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 15:47:23.968434 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63eb7c9-a7bf-4927-8fa9-97080a04d744 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:23.998592 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b7070-d3e6-4d0a-860c-fd08e7c67b4e None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:24.033082 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:24.036445 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89dcff-35e6-4c87-af4c-222cb948e597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:24.037306 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89dcff-35e6-4c87-af4c-222cb948e597 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:24.037525 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89dcff-35e6-4c87-af4c-222cb948e597 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:24.037796 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89dcff-35e6-4c87-af4c-222cb948e597 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:24.038396 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89dcff-35e6-4c87-af4c-222cb948e597 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:24.039791 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89dcff-35e6-4c87-af4c-222cb948e597 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:24.056825 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 498/984] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Aug 30 15:47:23 2022] GET /identity/v3/services => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 15:47:24.088279 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63eb7c9-a7bf-4927-8fa9-97080a04d744 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:24.126582 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f03c0-867c-44fc-bc79-f7dcb7139465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:24.127248 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f03c0-867c-44fc-bc79-f7dcb7139465 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:24.127529 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f03c0-867c-44fc-bc79-f7dcb7139465 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:24.127804 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f03c0-867c-44fc-bc79-f7dcb7139465 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:24.140124 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4f03c0-867c-44fc-bc79-f7dcb7139465 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:24.141644 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4f03c0-867c-44fc-bc79-f7dcb7139465 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:24.157912 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-1b4f03c0-867c-44fc-bc79-f7dcb7139465 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:47:24.157912 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:24.157912 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:24.157912 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:24.157912 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:24.157912 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:24.157912 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:24.157912 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:24.157912 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:24.157912 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:24.157912 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:24.157912 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:24.157912 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:47:24.157912 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:47:24.157912 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:47:24.157912 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:47:24.158928 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:24.158928 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:24.158928 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:24.158928 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:24.158928 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:24.158928 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:24.158928 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:24.158928 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:24.158928 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:24.158928 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:24.158928 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:24.158928 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:24.158928 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:24.158928 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:24.158928 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:24.158928 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:24.158928 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:47:24.159800 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:47:24.159800 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:47:24.159800 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:24.159800 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 487/985] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:47:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 15:47:24.165037 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89dcff-35e6-4c87-af4c-222cb948e597 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:24.266256 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:24.274053 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89dcff-35e6-4c87-af4c-222cb948e597 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:24.311133 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782955a8-8160-41bf-bd11-c51057244f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:24.312028 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782955a8-8160-41bf-bd11-c51057244f3e None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:24.312457 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782955a8-8160-41bf-bd11-c51057244f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:24.312901 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782955a8-8160-41bf-bd11-c51057244f3e None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:24.313686 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782955a8-8160-41bf-bd11-c51057244f3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:24.314133 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782955a8-8160-41bf-bd11-c51057244f3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:24.315656 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782955a8-8160-41bf-bd11-c51057244f3e None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:24.332481 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 499/986] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:47:24.334044 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f03c0-867c-44fc-bc79-f7dcb7139465 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:24.440230 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f03c0-867c-44fc-bc79-f7dcb7139465 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:24.457647 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:24.477280 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d97bb-0b8c-4117-b505-71db2062cd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:24.478082 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d97bb-0b8c-4117-b505-71db2062cd76 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:24.478463 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d97bb-0b8c-4117-b505-71db2062cd76 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:24.478874 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d97bb-0b8c-4117-b505-71db2062cd76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:24.485953 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d97bb-0b8c-4117-b505-71db2062cd76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:24.487533 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d97bb-0b8c-4117-b505-71db2062cd76 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:24.499386 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-979d97bb-0b8c-4117-b505-71db2062cd76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:47:24.499386 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:24.499386 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:24.499386 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:24.499386 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:24.499386 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:24.499386 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:24.499386 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:24.499386 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:24.499386 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:24.499386 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:24.499386 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:24.499386 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 15:47:24.499386 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 15:47:24.499386 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 15:47:24.500444 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 15:47:24.500444 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:24.500444 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:24.500444 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:24.500444 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:24.500444 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:24.500444 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:24.500444 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:24.500444 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:24.500444 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:24.500444 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:24.500444 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:24.500444 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:24.500444 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:24.500444 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:24.500444 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:24.500444 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:24.501692 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 15:47:24.501692 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 15:47:24.501692 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 15:47:24.501692 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 15:47:24.501692 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 15:47:24.501692 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 15:47:24.501692 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:47:24.501692 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:24.503104 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 488/987] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:47:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:24.508683 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782955a8-8160-41bf-bd11-c51057244f3e None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:24.538841 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54b5fd-5079-4097-921e-16ca087ff9cc None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:24.539121 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54b5fd-5079-4097-921e-16ca087ff9cc None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:24.539402 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54b5fd-5079-4097-921e-16ca087ff9cc None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:24.540833 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 489/988] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 15:47:24.545797 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dda670-2262-4608-915f-9e11dcbeb28a None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:24.546075 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dda670-2262-4608-915f-9e11dcbeb28a None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:24.546348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dda670-2262-4608-915f-9e11dcbeb28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:24.567465 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-64dda670-2262-4608-915f-9e11dcbeb28a None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:24.569008 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-64dda670-2262-4608-915f-9e11dcbeb28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:24.615038 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782955a8-8160-41bf-bd11-c51057244f3e None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:24.643537 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 490/989] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:24 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:47:24.650500 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371693dc-d796-4c0e-92f1-b8a24d516c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:24.651136 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371693dc-d796-4c0e-92f1-b8a24d516c55 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:24.651418 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371693dc-d796-4c0e-92f1-b8a24d516c55 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:24.651686 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371693dc-d796-4c0e-92f1-b8a24d516c55 None admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:24.652378 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371693dc-d796-4c0e-92f1-b8a24d516c55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:24.652679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371693dc-d796-4c0e-92f1-b8a24d516c55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:24.654150 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371693dc-d796-4c0e-92f1-b8a24d516c55 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:24.667389 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 500/990] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 30 15:47:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:24.672636 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dda670-2262-4608-915f-9e11dcbeb28a None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:24.779407 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dda670-2262-4608-915f-9e11dcbeb28a None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:24.787727 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:24.819998 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312a939-8528-4694-89ea-06cbc2e48d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:24.820671 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312a939-8528-4694-89ea-06cbc2e48d78 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:24.820923 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312a939-8528-4694-89ea-06cbc2e48d78 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:24.821171 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312a939-8528-4694-89ea-06cbc2e48d78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:24.821893 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312a939-8528-4694-89ea-06cbc2e48d78 None admin] RBAC: Adding query filter params (role.id=341b3ebd68374dd5bb372bc283d34fd7, scope.project.id=51f312b4cd8b449aa2971993f68de9af, user.id=d7958b395d5e4f5da37927536b1856ae) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:24.822194 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312a939-8528-4694-89ea-06cbc2e48d78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:24.824295 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312a939-8528-4694-89ea-06cbc2e48d78 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:24.837025 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 491/991] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:47:24 2022] GET /identity/v3/role_assignments?user.id=d7958b395d5e4f5da37927536b1856ae&scope.project.id=51f312b4cd8b449aa2971993f68de9af&role.id=341b3ebd68374dd5bb372bc283d34fd7 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:47:24.934015 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371693dc-d796-4c0e-92f1-b8a24d516c55 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:24.950803 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:25.042434 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371693dc-d796-4c0e-92f1-b8a24d516c55 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:25.076263 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb8f92-36f6-4573-9b0e-9b870b81e99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:25.077002 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb8f92-36f6-4573-9b0e-9b870b81e99b None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:25.077327 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb8f92-36f6-4573-9b0e-9b870b81e99b None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:25.077606 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb8f92-36f6-4573-9b0e-9b870b81e99b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:25.078287 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eb8f92-36f6-4573-9b0e-9b870b81e99b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:25.079985 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eb8f92-36f6-4573-9b0e-9b870b81e99b None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:25.090173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-22eb8f92-36f6-4573-9b0e-9b870b81e99b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 15:47:25.090173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:25.090173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 15:47:25.090173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 15:47:25.090173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 15:47:25.090173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 15:47:25.090173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 15:47:25.090173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:47:25.090173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 15:47:25.090173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:25.090173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 15:47:25.090173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:25.090173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:25.090173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:25.090173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:25.090173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:25.090173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:25.091437 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:25.091437 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:25.091437 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:25.091437 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:25.091437 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:25.091437 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:25.091437 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 15:47:25.091437 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 15:47:25.091437 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 15:47:25.091437 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 15:47:25.091437 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:25.091437 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:25.091437 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:25.091437 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:25.091437 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:25.091437 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:25.093812 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:25.093812 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:25.093812 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:25.093812 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:25.093812 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:25.093812 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:25.093812 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:25.093812 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:25.093812 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:25.093812 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:25.093812 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 15:47:25.093812 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:47:25.093812 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 15:47:25.093812 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:25.093812 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 501/992] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Aug 30 15:47:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:25.098616 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312a939-8528-4694-89ea-06cbc2e48d78 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:25.201691 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312a939-8528-4694-89ea-06cbc2e48d78 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:25.235735 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466cf427-51ff-43b4-90fd-d7c42a9d16f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:25.236342 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cf427-51ff-43b4-90fd-d7c42a9d16f6 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:25.236615 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cf427-51ff-43b4-90fd-d7c42a9d16f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:25.236910 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cf427-51ff-43b4-90fd-d7c42a9d16f6 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:25.237539 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466cf427-51ff-43b4-90fd-d7c42a9d16f6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:25.237832 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466cf427-51ff-43b4-90fd-d7c42a9d16f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:25.239188 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466cf427-51ff-43b4-90fd-d7c42a9d16f6 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:25.244171 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 492/993] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Aug 30 15:47:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:47:25.250233 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb8f92-36f6-4573-9b0e-9b870b81e99b None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:25.329251 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:25.351339 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb8f92-36f6-4573-9b0e-9b870b81e99b None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:25.384637 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72fed2-42e3-41c4-8831-b67374ac6ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:25.385307 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72fed2-42e3-41c4-8831-b67374ac6ae0 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:25.385598 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72fed2-42e3-41c4-8831-b67374ac6ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:25.385883 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72fed2-42e3-41c4-8831-b67374ac6ae0 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:25.386469 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72fed2-42e3-41c4-8831-b67374ac6ae0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:25.386811 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72fed2-42e3-41c4-8831-b67374ac6ae0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:25.388172 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72fed2-42e3-41c4-8831-b67374ac6ae0 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:25.398036 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 502/994] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Aug 30 15:47:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:25.399593 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466cf427-51ff-43b4-90fd-d7c42a9d16f6 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:25.434726 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:25.503831 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466cf427-51ff-43b4-90fd-d7c42a9d16f6 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:25.538263 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe2468-3f03-48ca-9fa9-4665d63c797a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:25.538879 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe2468-3f03-48ca-9fa9-4665d63c797a None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:25.539154 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe2468-3f03-48ca-9fa9-4665d63c797a None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:25.539423 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe2468-3f03-48ca-9fa9-4665d63c797a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:25.540126 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe2468-3f03-48ca-9fa9-4665d63c797a None admin] RBAC: Adding query filter params (interface=admin, service_id=84178458efbe41dc8ff4f9d830a6e735, region_id=RegionOne) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:25.540428 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe2468-3f03-48ca-9fa9-4665d63c797a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:25.542528 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe2468-3f03-48ca-9fa9-4665d63c797a None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:25.552042 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 493/995] 10.222.0.25 () {56 vars in 1249 bytes} [Tue Aug 30 15:47:25 2022] GET /identity/v3/endpoints?service_id=84178458efbe41dc8ff4f9d830a6e735&interface=admin®ion_id=RegionOne => generated 193 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:47:25.553639 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72fed2-42e3-41c4-8831-b67374ac6ae0 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:25.652100 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72fed2-42e3-41c4-8831-b67374ac6ae0 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:25.684948 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0e801-4419-481b-88cd-ef1ba388336d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:25.685556 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0e801-4419-481b-88cd-ef1ba388336d None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:25.685828 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0e801-4419-481b-88cd-ef1ba388336d None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:25.686094 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0e801-4419-481b-88cd-ef1ba388336d None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:25.686691 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e0e801-4419-481b-88cd-ef1ba388336d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:25.688044 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e0e801-4419-481b-88cd-ef1ba388336d None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:25.700866 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 503/996] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Aug 30 15:47:25 2022] GET /identity/v3/services => generated 1727 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:47:26.020988 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0a588-c742-49f9-b852-b7baaaa04464 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:26.021495 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0a588-c742-49f9-b852-b7baaaa04464 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:26.021495 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0a588-c742-49f9-b852-b7baaaa04464 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:26.022923 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 494/997] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:47:26.028242 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829946e3-97f6-4127-a8bb-128d58e4ed07 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:26.028603 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829946e3-97f6-4127-a8bb-128d58e4ed07 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:26.028972 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829946e3-97f6-4127-a8bb-128d58e4ed07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:26.042646 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:26.049126 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-829946e3-97f6-4127-a8bb-128d58e4ed07 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:26.050685 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-829946e3-97f6-4127-a8bb-128d58e4ed07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:26.117871 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 504/998] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:26 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 15:47:26.381367 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0a588-c742-49f9-b852-b7baaaa04464 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:26.480798 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:26.487204 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0a588-c742-49f9-b852-b7baaaa04464 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:26.521222 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317202dd-043b-45c6-a5c4-eaadc64b525e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:26.521588 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317202dd-043b-45c6-a5c4-eaadc64b525e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:26.521866 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317202dd-043b-45c6-a5c4-eaadc64b525e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:26.522135 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317202dd-043b-45c6-a5c4-eaadc64b525e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:26.522715 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317202dd-043b-45c6-a5c4-eaadc64b525e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:26.524088 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317202dd-043b-45c6-a5c4-eaadc64b525e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:26.533962 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-317202dd-043b-45c6-a5c4-eaadc64b525e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 15:47:26.533962 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:26.533962 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 15:47:26.533962 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 15:47:26.533962 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 15:47:26.533962 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 15:47:26.533962 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 15:47:26.533962 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:47:26.533962 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 15:47:26.533962 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:26.533962 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 15:47:26.533962 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:26.533962 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:26.533962 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:26.533962 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:26.533962 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:26.533962 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:26.534947 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:26.534947 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:26.534947 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:26.534947 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:26.534947 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:26.534947 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:26.534947 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 15:47:26.534947 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 15:47:26.534947 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 15:47:26.534947 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 15:47:26.534947 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:26.534947 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:26.534947 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:26.534947 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:26.534947 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:26.534947 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:26.535766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:26.535766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:26.535766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:26.535766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:26.535766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:26.535766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:26.535766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:26.535766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:26.535766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:26.535766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:26.535766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 15:47:26.535766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:47:26.535766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 15:47:26.535766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:26.537449 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 495/999] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:47:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:26.540938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829946e3-97f6-4127-a8bb-128d58e4ed07 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:26.639424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829946e3-97f6-4127-a8bb-128d58e4ed07 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:26.675062 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b7102-7135-40f3-9a45-cbe982669c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:26.675671 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b7102-7135-40f3-9a45-cbe982669c87 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:26.675983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b7102-7135-40f3-9a45-cbe982669c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:26.676208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b7102-7135-40f3-9a45-cbe982669c87 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:26.676855 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b7102-7135-40f3-9a45-cbe982669c87 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:26.677152 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b7102-7135-40f3-9a45-cbe982669c87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:26.678497 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b7102-7135-40f3-9a45-cbe982669c87 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:26.680322 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:26.688941 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 505/1000] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Aug 30 15:47:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:26.690565 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317202dd-043b-45c6-a5c4-eaadc64b525e None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:26.785083 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf7930-cee4-40de-971f-1136f2be20fa None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:26.785373 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf7930-cee4-40de-971f-1136f2be20fa None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:26.785640 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf7930-cee4-40de-971f-1136f2be20fa None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:26.786964 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 506/1001] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 15:47:26.792675 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f3b65-5423-421d-87c4-5e50f32df325 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:26.792991 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f3b65-5423-421d-87c4-5e50f32df325 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:26.793269 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f3b65-5423-421d-87c4-5e50f32df325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:26.805744 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317202dd-043b-45c6-a5c4-eaadc64b525e None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:26.812446 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-e55f3b65-5423-421d-87c4-5e50f32df325 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:26.813676 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-e55f3b65-5423-421d-87c4-5e50f32df325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:26.843144 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc116de-273e-42e3-ad7c-73f00fa0a2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:26.843758 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc116de-273e-42e3-ad7c-73f00fa0a2b1 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:26.844040 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc116de-273e-42e3-ad7c-73f00fa0a2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:26.844315 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc116de-273e-42e3-ad7c-73f00fa0a2b1 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:26.844984 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc116de-273e-42e3-ad7c-73f00fa0a2b1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:26.845289 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc116de-273e-42e3-ad7c-73f00fa0a2b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:26.846664 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc116de-273e-42e3-ad7c-73f00fa0a2b1 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:26.851546 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 496/1002] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Aug 30 15:47:26 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:47:26.857620 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc116de-273e-42e3-ad7c-73f00fa0a2b1 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:26.885890 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:26.892878 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 507/1003] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:26 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 15:47:26.961775 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc116de-273e-42e3-ad7c-73f00fa0a2b1 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:26.995548 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70dd1f-5bdb-409e-990e-47598273b743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:26.996148 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70dd1f-5bdb-409e-990e-47598273b743 None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:26.996428 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70dd1f-5bdb-409e-990e-47598273b743 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:26.996726 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70dd1f-5bdb-409e-990e-47598273b743 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:26.997427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70dd1f-5bdb-409e-990e-47598273b743 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:26.998799 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70dd1f-5bdb-409e-990e-47598273b743 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:27.028821 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 497/1004] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:47:26 2022] POST /identity/v3/endpoints => generated 334 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:47:27.164963 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f3b65-5423-421d-87c4-5e50f32df325 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:27.271426 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f3b65-5423-421d-87c4-5e50f32df325 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:27.303434 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:27.317067 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ca56f-18e2-46d5-8e7d-c19891231f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:27.317706 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ca56f-18e2-46d5-8e7d-c19891231f9f None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:27.317987 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ca56f-18e2-46d5-8e7d-c19891231f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:27.318258 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ca56f-18e2-46d5-8e7d-c19891231f9f None admin] PATH_INFO: `/v3/services/image` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:27.318836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9ca56f-18e2-46d5-8e7d-c19891231f9f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:27.320190 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9ca56f-18e2-46d5-8e7d-c19891231f9f None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:27.329527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-6a9ca56f-18e2-46d5-8e7d-c19891231f9f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 15:47:27.329527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:27.329527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 15:47:27.329527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 15:47:27.329527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 15:47:27.329527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 15:47:27.329527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 15:47:27.329527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:47:27.329527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 15:47:27.329527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:27.329527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 15:47:27.329527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:27.329527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:27.329527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:27.329527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:27.329527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:27.329527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:27.330500 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:27.330500 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:27.330500 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:27.330500 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:27.330500 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:27.330500 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:27.330500 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 15:47:27.330500 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 15:47:27.330500 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 15:47:27.330500 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 15:47:27.330500 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:27.330500 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:27.330500 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:27.330500 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:27.330500 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:27.330500 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:27.331334 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:27.331334 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:27.331334 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:27.331334 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:27.331334 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:27.331334 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:27.331334 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:27.331334 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:27.331334 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:27.331334 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:27.331334 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 15:47:27.331334 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:47:27.331334 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 15:47:27.331334 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:27.332848 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 508/1005] 10.222.0.25 () {56 vars in 1105 bytes} [Tue Aug 30 15:47:27 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:27.336928 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70dd1f-5bdb-409e-990e-47598273b743 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:27.423508 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:27.445880 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70dd1f-5bdb-409e-990e-47598273b743 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:27.481592 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669128e2-561d-49ff-88ca-1cc72f95ef50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:27.482213 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669128e2-561d-49ff-88ca-1cc72f95ef50 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:27.482489 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669128e2-561d-49ff-88ca-1cc72f95ef50 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:27.482757 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669128e2-561d-49ff-88ca-1cc72f95ef50 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:27.483598 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669128e2-561d-49ff-88ca-1cc72f95ef50 None admin] RBAC: Adding query filter params (name=image) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:27.483902 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669128e2-561d-49ff-88ca-1cc72f95ef50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:27.485436 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669128e2-561d-49ff-88ca-1cc72f95ef50 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:27.495410 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 498/1006] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:47:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:27.496637 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ca56f-18e2-46d5-8e7d-c19891231f9f None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:27.601948 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ca56f-18e2-46d5-8e7d-c19891231f9f None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:27.612414 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fe22e-1aad-4ef0-b0ba-7713dc78ddef None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:27.612702 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fe22e-1aad-4ef0-b0ba-7713dc78ddef None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:27.613008 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fe22e-1aad-4ef0-b0ba-7713dc78ddef None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:27.614475 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 499/1007] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:47:27.619144 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608202e-3419-42d9-89ed-7b3d8f177d5a None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:27.620091 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608202e-3419-42d9-89ed-7b3d8f177d5a None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:27.620370 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608202e-3419-42d9-89ed-7b3d8f177d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:27.639262 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-4608202e-3419-42d9-89ed-7b3d8f177d5a None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:27.640466 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-4608202e-3419-42d9-89ed-7b3d8f177d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:27.640793 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc1ddc-55f6-498f-a1c0-27ecaee8b524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:27.641422 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc1ddc-55f6-498f-a1c0-27ecaee8b524 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:27.641704 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc1ddc-55f6-498f-a1c0-27ecaee8b524 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:27.641978 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc1ddc-55f6-498f-a1c0-27ecaee8b524 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:27.642868 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc1ddc-55f6-498f-a1c0-27ecaee8b524 None admin] RBAC: Adding query filter params (type=image) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:27.643169 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc1ddc-55f6-498f-a1c0-27ecaee8b524 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:27.644532 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc1ddc-55f6-498f-a1c0-27ecaee8b524 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:27.649256 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 509/1008] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:47:27 2022] GET /identity/v3/services?type=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:27.722571 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 500/1009] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:27 2022] POST /identity/v3/auth/tokens => generated 1726 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 15:47:27.992516 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc1ddc-55f6-498f-a1c0-27ecaee8b524 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:28.048804 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:28.096899 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc1ddc-55f6-498f-a1c0-27ecaee8b524 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:28.130965 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706fd2ce-75f5-492e-b332-0934773fafdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:28.131603 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706fd2ce-75f5-492e-b332-0934773fafdd None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:28.131885 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706fd2ce-75f5-492e-b332-0934773fafdd None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:28.132160 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706fd2ce-75f5-492e-b332-0934773fafdd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:28.132744 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706fd2ce-75f5-492e-b332-0934773fafdd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:28.134139 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706fd2ce-75f5-492e-b332-0934773fafdd None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:28.144096 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-706fd2ce-75f5-492e-b332-0934773fafdd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 15:47:28.144096 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:28.144096 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 15:47:28.144096 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 15:47:28.144096 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 15:47:28.144096 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 15:47:28.144096 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 15:47:28.144096 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:47:28.144096 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 15:47:28.144096 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:28.144096 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 15:47:28.144096 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:28.144096 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:28.144096 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:28.144096 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:28.144096 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:28.144096 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:28.145303 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:28.145303 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:28.145303 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:28.145303 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:28.145303 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:28.145303 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:28.145303 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 15:47:28.145303 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 15:47:28.145303 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 15:47:28.145303 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 15:47:28.145303 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:28.145303 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:28.145303 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:28.145303 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:28.145303 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:28.145303 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:28.146158 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:28.146158 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:28.146158 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:28.146158 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:28.146158 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:28.146158 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:28.146158 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:28.146158 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:28.146158 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:28.146158 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:28.146158 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 15:47:28.146158 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:47:28.146158 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 15:47:28.146158 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:28.149128 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 510/1010] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Aug 30 15:47:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:28.151314 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608202e-3419-42d9-89ed-7b3d8f177d5a None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:28.231117 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:28.256033 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608202e-3419-42d9-89ed-7b3d8f177d5a None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:28.290158 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148a0bf-4828-481c-8aab-629e5dc2dd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:28.290773 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148a0bf-4828-481c-8aab-629e5dc2dd23 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:28.291573 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148a0bf-4828-481c-8aab-629e5dc2dd23 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:28.291840 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148a0bf-4828-481c-8aab-629e5dc2dd23 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:28.292480 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148a0bf-4828-481c-8aab-629e5dc2dd23 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:28.292800 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148a0bf-4828-481c-8aab-629e5dc2dd23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:28.294214 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148a0bf-4828-481c-8aab-629e5dc2dd23 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:28.303656 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 501/1011] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Aug 30 15:47:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:28.305183 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706fd2ce-75f5-492e-b332-0934773fafdd None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:28.406881 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706fd2ce-75f5-492e-b332-0934773fafdd None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:28.423800 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:28.441584 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa756d85-4223-43c5-b2bf-91c2f774af41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:28.442186 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa756d85-4223-43c5-b2bf-91c2f774af41 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:28.442460 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa756d85-4223-43c5-b2bf-91c2f774af41 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:28.442726 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa756d85-4223-43c5-b2bf-91c2f774af41 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:28.443352 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa756d85-4223-43c5-b2bf-91c2f774af41 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:28.443647 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa756d85-4223-43c5-b2bf-91c2f774af41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:28.445022 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa756d85-4223-43c5-b2bf-91c2f774af41 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:28.449940 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 511/1012] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Aug 30 15:47:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:28.455536 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148a0bf-4828-481c-8aab-629e5dc2dd23 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:28.554985 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148a0bf-4828-481c-8aab-629e5dc2dd23 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:28.587612 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edf43f-0434-4998-980b-4211352cdc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:28.588744 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edf43f-0434-4998-980b-4211352cdc94 None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:28.589098 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edf43f-0434-4998-980b-4211352cdc94 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:28.589318 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edf43f-0434-4998-980b-4211352cdc94 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:28.589992 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14edf43f-0434-4998-980b-4211352cdc94 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:28.591360 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14edf43f-0434-4998-980b-4211352cdc94 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:28.603044 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:28.620810 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 502/1013] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:47:28 2022] POST /identity/v3/endpoints => generated 325 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:47:29.060404 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158cd3d-6250-4d13-8752-cec78f3ff575 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:29.060969 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158cd3d-6250-4d13-8752-cec78f3ff575 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:29.060969 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158cd3d-6250-4d13-8752-cec78f3ff575 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:29.062456 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 512/1014] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:47:29.067467 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63663a76-3ec6-4219-9df0-fa29f98ea0b9 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:29.067821 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63663a76-3ec6-4219-9df0-fa29f98ea0b9 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:29.068163 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63663a76-3ec6-4219-9df0-fa29f98ea0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:29.086543 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-63663a76-3ec6-4219-9df0-fa29f98ea0b9 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:29.087754 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-63663a76-3ec6-4219-9df0-fa29f98ea0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:29.168826 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 503/1015] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:29 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:47:29.434525 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158cd3d-6250-4d13-8752-cec78f3ff575 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:29.542413 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158cd3d-6250-4d13-8752-cec78f3ff575 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:29.568355 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c58c4-8652-41f1-a1e2-f215ca269501 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:29.568640 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c58c4-8652-41f1-a1e2-f215ca269501 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:29.568944 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c58c4-8652-41f1-a1e2-f215ca269501 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:29.570407 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 504/1016] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 15:47:29.575773 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66900ec9-d476-47b5-9b22-5d15a1f14c9f None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:29.576084 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66900ec9-d476-47b5-9b22-5d15a1f14c9f None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:29.576317 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66900ec9-d476-47b5-9b22-5d15a1f14c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:29.578060 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d6180a-d9c3-418c-81ea-c5941dcbc795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:29.578697 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6180a-d9c3-418c-81ea-c5941dcbc795 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:29.578968 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6180a-d9c3-418c-81ea-c5941dcbc795 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:29.579295 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6180a-d9c3-418c-81ea-c5941dcbc795 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:29.590663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d6180a-d9c3-418c-81ea-c5941dcbc795 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:47:29.594998 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-66900ec9-d476-47b5-9b22-5d15a1f14c9f None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:29.595436 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-78d6180a-d9c3-418c-81ea-c5941dcbc795 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 15:47:29.595436 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:29.595436 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:29.595436 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:29.595436 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:29.595436 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:29.595436 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:29.595436 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:29.595436 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:29.595436 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:29.595436 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:29.595436 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:29.595436 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:47:29.595436 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:47:29.595436 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:47:29.595436 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:47:29.596331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:47:29.596331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:47:29.596331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:47:29.596331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:47:29.596331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:29.596331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:29.596331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:29.596331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:29.596331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:29.596331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:29.596331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:29.596331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:29.596331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:29.596331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:29.596331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:29.596331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:29.598938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:29.598938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:29.598938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:29.598938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:29.598938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:47:29.598938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:47:29.598938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:47:29.598938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:47:29.598938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:47:29.598938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:47:29.598938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 15:47:29.598938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:29.599569 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-66900ec9-d476-47b5-9b22-5d15a1f14c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:29.599640 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 513/1017] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Aug 30 15:47:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:29.602419 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d6180a-d9c3-418c-81ea-c5941dcbc795 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:29.649793 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:29.679668 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 505/1018] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:29 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 15:47:29.715438 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d6180a-d9c3-418c-81ea-c5941dcbc795 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:29.765769 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d448a2c-3eca-4c0c-a712-31628dcc0941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:29.766408 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d448a2c-3eca-4c0c-a712-31628dcc0941 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:29.766689 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d448a2c-3eca-4c0c-a712-31628dcc0941 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:29.766963 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d448a2c-3eca-4c0c-a712-31628dcc0941 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:29.767906 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d448a2c-3eca-4c0c-a712-31628dcc0941 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:29.768210 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d448a2c-3eca-4c0c-a712-31628dcc0941 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:29.769636 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d448a2c-3eca-4c0c-a712-31628dcc0941 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:29.784438 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 514/1019] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Aug 30 15:47:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:47:29.785494 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66900ec9-d476-47b5-9b22-5d15a1f14c9f None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:29.842772 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:29.887200 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66900ec9-d476-47b5-9b22-5d15a1f14c9f None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:29.922703 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625cf2b4-1497-4394-8ffa-5745300628ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:29.923329 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cf2b4-1497-4394-8ffa-5745300628ec None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:29.923602 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cf2b4-1497-4394-8ffa-5745300628ec None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:29.923870 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cf2b4-1497-4394-8ffa-5745300628ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:29.933930 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625cf2b4-1497-4394-8ffa-5745300628ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:29.935373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625cf2b4-1497-4394-8ffa-5745300628ec None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:29.949747 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-625cf2b4-1497-4394-8ffa-5745300628ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:47:29.949747 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:29.949747 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:29.949747 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:29.949747 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:29.949747 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:29.949747 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:29.949747 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:29.949747 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:29.949747 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:29.949747 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:29.949747 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:29.949747 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:47:29.949747 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:47:29.949747 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:47:29.949747 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:47:29.950675 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:29.950675 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:29.950675 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:29.950675 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:29.950675 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:29.950675 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:29.950675 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:29.950675 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:29.950675 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:29.950675 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:29.950675 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:29.950675 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:29.950675 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:29.950675 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:29.950675 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:29.950675 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:29.950675 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:47:29.956729 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:47:29.956729 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:47:29.956729 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:29.956729 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 506/1020] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:47:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:29.957007 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d448a2c-3eca-4c0c-a712-31628dcc0941 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:29.957096 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625cf2b4-1497-4394-8ffa-5745300628ec None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:30.058648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d448a2c-3eca-4c0c-a712-31628dcc0941 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:30.060171 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625cf2b4-1497-4394-8ffa-5745300628ec None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:30.060945 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:30.070537 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:30.096034 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a1171-feda-412a-a7ec-17895eed8193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:30.096657 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a1171-feda-412a-a7ec-17895eed8193 None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:30.096971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a1171-feda-412a-a7ec-17895eed8193 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:30.097245 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a1171-feda-412a-a7ec-17895eed8193 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:30.097908 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a1171-feda-412a-a7ec-17895eed8193 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:30.099309 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a1171-feda-412a-a7ec-17895eed8193 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:30.100506 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bace87-2e84-465c-94e9-7fcede4e9073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:30.101148 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bace87-2e84-465c-94e9-7fcede4e9073 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:30.101430 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bace87-2e84-465c-94e9-7fcede4e9073 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:30.101701 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bace87-2e84-465c-94e9-7fcede4e9073 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:30.102453 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bace87-2e84-465c-94e9-7fcede4e9073 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:30.102769 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bace87-2e84-465c-94e9-7fcede4e9073 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:30.104691 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bace87-2e84-465c-94e9-7fcede4e9073 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:30.115582 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 515/1021] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Aug 30 15:47:29 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:47:30.124624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 507/1022] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:47:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:47:30.126161 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a1171-feda-412a-a7ec-17895eed8193 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:30.243045 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a1171-feda-412a-a7ec-17895eed8193 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:30.283135 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b03e72-ab9b-4250-a265-f75b7e6d16fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:30.283771 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b03e72-ab9b-4250-a265-f75b7e6d16fc None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:30.284054 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b03e72-ab9b-4250-a265-f75b7e6d16fc None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:30.284326 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b03e72-ab9b-4250-a265-f75b7e6d16fc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:30.292510 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b03e72-ab9b-4250-a265-f75b7e6d16fc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:30.293993 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b03e72-ab9b-4250-a265-f75b7e6d16fc None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:30.305535 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-e8b03e72-ab9b-4250-a265-f75b7e6d16fc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 15:47:30.305535 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:30.305535 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:30.305535 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:30.305535 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:30.305535 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:30.305535 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:30.305535 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:30.305535 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:30.305535 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:30.305535 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:30.305535 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:30.305535 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 15:47:30.305535 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 15:47:30.305535 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 15:47:30.305535 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 15:47:30.306655 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:30.306655 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:30.306655 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 15:47:30.306655 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:47:30.306655 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 15:47:30.306655 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:47:30.306655 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:30.306655 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:30.306655 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:30.306655 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:30.306655 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:30.306655 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:30.306655 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:30.306655 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:30.306655 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:30.306655 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:30.306655 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:30.306655 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:30.308407 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:30.308407 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:30.308407 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 15:47:30.308407 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 15:47:30.308407 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 15:47:30.308407 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 15:47:30.308407 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 15:47:30.308407 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 15:47:30.308407 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 15:47:30.308407 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:30.308407 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 516/1023] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Aug 30 15:47:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:30.315502 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bace87-2e84-465c-94e9-7fcede4e9073 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:30.418810 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bace87-2e84-465c-94e9-7fcede4e9073 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:30.453863 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c3a2f-3480-4c00-ab89-a924d3f65863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:30.454473 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c3a2f-3480-4c00-ab89-a924d3f65863 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:30.454752 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c3a2f-3480-4c00-ab89-a924d3f65863 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:30.455022 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c3a2f-3480-4c00-ab89-a924d3f65863 None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:30.455748 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c3a2f-3480-4c00-ab89-a924d3f65863 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:30.456048 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c3a2f-3480-4c00-ab89-a924d3f65863 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:30.457512 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c3a2f-3480-4c00-ab89-a924d3f65863 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:30.480504 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 508/1024] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Aug 30 15:47:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:47:30.481845 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b03e72-ab9b-4250-a265-f75b7e6d16fc None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:30.505075 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:30.572875 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49dc94-9885-4f4e-a6ee-d0160c5ddcb6 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:30.573367 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49dc94-9885-4f4e-a6ee-d0160c5ddcb6 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:30.573658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49dc94-9885-4f4e-a6ee-d0160c5ddcb6 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:30.575286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 509/1025] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 15:47:30.580296 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b3a35-a5b6-4b91-92a1-d46b313c09d0 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:30.580581 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b3a35-a5b6-4b91-92a1-d46b313c09d0 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:30.580893 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b3a35-a5b6-4b91-92a1-d46b313c09d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:30.591355 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b03e72-ab9b-4250-a265-f75b7e6d16fc None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:30.599675 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-951b3a35-a5b6-4b91-92a1-d46b313c09d0 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:30.601258 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-951b3a35-a5b6-4b91-92a1-d46b313c09d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:30.623293 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:30.628096 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43912f55-2906-4788-ac76-109b7038c86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:30.628722 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43912f55-2906-4788-ac76-109b7038c86e None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:30.629042 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43912f55-2906-4788-ac76-109b7038c86e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:30.629326 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43912f55-2906-4788-ac76-109b7038c86e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:30.674035 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 510/1026] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:30 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 15:47:30.703828 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43912f55-2906-4788-ac76-109b7038c86e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:30.705604 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43912f55-2906-4788-ac76-109b7038c86e None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:30.733633 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:30.814553 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 517/1027] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:47:30 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 15:47:30.820564 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b3a35-a5b6-4b91-92a1-d46b313c09d0 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:30.925204 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b3a35-a5b6-4b91-92a1-d46b313c09d0 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:30.943838 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43912f55-2906-4788-ac76-109b7038c86e None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:30.958780 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0963c-c373-4e4b-8f62-9d21def70587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:30.959413 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0963c-c373-4e4b-8f62-9d21def70587 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:30.959690 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0963c-c373-4e4b-8f62-9d21def70587 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:30.959954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0963c-c373-4e4b-8f62-9d21def70587 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:30.971644 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0963c-c373-4e4b-8f62-9d21def70587 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:30.973137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0963c-c373-4e4b-8f62-9d21def70587 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:30.989430 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-fdd0963c-c373-4e4b-8f62-9d21def70587 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:47:30.989430 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:30.989430 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:30.989430 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:30.989430 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:30.989430 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:30.989430 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:30.989430 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:30.989430 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:30.989430 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:30.989430 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:30.989430 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:30.989430 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:47:30.989430 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:47:30.989430 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:47:30.989430 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:47:30.990395 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:30.990395 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:30.990395 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:30.990395 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:30.990395 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:30.990395 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:30.990395 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:30.990395 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:30.990395 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:30.990395 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:30.990395 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:30.990395 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:30.990395 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:30.990395 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:30.990395 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:30.990395 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:30.990395 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:47:30.991969 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:47:30.991969 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:47:30.991969 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:30.991969 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 511/1028] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:47:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 15:47:30.996762 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0963c-c373-4e4b-8f62-9d21def70587 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:31.008219 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:31.051665 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43912f55-2906-4788-ac76-109b7038c86e None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:31.071944 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:31.090294 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24e122-a097-4d80-a7a1-1018ccb306be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:31.090938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24e122-a097-4d80-a7a1-1018ccb306be None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:31.091218 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24e122-a097-4d80-a7a1-1018ccb306be None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:31.091488 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24e122-a097-4d80-a7a1-1018ccb306be None admin] PATH_INFO: `/v3/domains/default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:31.092612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c24e122-a097-4d80-a7a1-1018ccb306be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:31.094695 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c24e122-a097-4d80-a7a1-1018ccb306be None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:31.096496 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 518/1029] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:47:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:47:31.102157 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24e122-a097-4d80-a7a1-1018ccb306be None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:31.112948 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0963c-c373-4e4b-8f62-9d21def70587 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:31.149659 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe5244-0556-493a-a979-b0afde6e48e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:31.150358 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe5244-0556-493a-a979-b0afde6e48e0 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:31.150767 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe5244-0556-493a-a979-b0afde6e48e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:31.151043 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe5244-0556-493a-a979-b0afde6e48e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:31.151703 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe5244-0556-493a-a979-b0afde6e48e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:31.152010 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe5244-0556-493a-a979-b0afde6e48e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:31.153422 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe5244-0556-493a-a979-b0afde6e48e0 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:31.165716 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 512/1030] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:31.171680 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe5244-0556-493a-a979-b0afde6e48e0 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:31.229262 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24e122-a097-4d80-a7a1-1018ccb306be None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:31.243061 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:31.266580 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02b6aa-c876-4fa8-8d17-7b48f8304192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:31.267754 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02b6aa-c876-4fa8-8d17-7b48f8304192 None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:31.268283 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02b6aa-c876-4fa8-8d17-7b48f8304192 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:31.268629 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02b6aa-c876-4fa8-8d17-7b48f8304192 None admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:31.269314 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02b6aa-c876-4fa8-8d17-7b48f8304192 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:31.270737 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02b6aa-c876-4fa8-8d17-7b48f8304192 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:31.280639 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe5244-0556-493a-a979-b0afde6e48e0 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:31.308821 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 519/1031] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Aug 30 15:47:31 2022] POST /identity/v3/projects => generated 311 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:47:31.317522 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52362d41-a98c-473d-99a9-bb26906e5706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:31.318190 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52362d41-a98c-473d-99a9-bb26906e5706 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:31.318472 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52362d41-a98c-473d-99a9-bb26906e5706 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:31.318746 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52362d41-a98c-473d-99a9-bb26906e5706 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:31.327056 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52362d41-a98c-473d-99a9-bb26906e5706 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:31.328571 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52362d41-a98c-473d-99a9-bb26906e5706 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:31.342320 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-52362d41-a98c-473d-99a9-bb26906e5706 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:47:31.342320 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:31.342320 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:31.342320 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:31.342320 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:31.342320 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:31.342320 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:31.342320 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:31.342320 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:31.342320 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:31.342320 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:31.342320 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:31.342320 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 15:47:31.342320 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 15:47:31.342320 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 15:47:31.343283 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 15:47:31.343283 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:31.343283 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:31.343283 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:31.343283 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:31.343283 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:31.343283 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:31.343283 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:31.343283 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:31.343283 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:31.343283 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:31.343283 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:31.343283 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:31.343283 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:31.343283 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:31.343283 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:31.343283 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:31.344208 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 15:47:31.344208 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 15:47:31.344208 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 15:47:31.344208 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 15:47:31.344208 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 15:47:31.344208 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 15:47:31.344208 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:47:31.344208 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:31.344208 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 513/1032] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:47:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:31.349366 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02b6aa-c876-4fa8-8d17-7b48f8304192 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:31.398833 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:31.468731 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02b6aa-c876-4fa8-8d17-7b48f8304192 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:31.512095 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe90f3-f8d0-4731-aeb3-1ad76be6c998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:31.513102 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe90f3-f8d0-4731-aeb3-1ad76be6c998 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:31.513375 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe90f3-f8d0-4731-aeb3-1ad76be6c998 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:31.513643 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe90f3-f8d0-4731-aeb3-1ad76be6c998 None admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:31.514331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe90f3-f8d0-4731-aeb3-1ad76be6c998 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:31.514629 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe90f3-f8d0-4731-aeb3-1ad76be6c998 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:31.516040 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe90f3-f8d0-4731-aeb3-1ad76be6c998 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:31.529421 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 520/1033] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 30 15:47:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:47:31.535810 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52362d41-a98c-473d-99a9-bb26906e5706 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:31.635583 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52362d41-a98c-473d-99a9-bb26906e5706 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:31.662264 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:31.672961 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e1e84-4316-4202-8957-e9db7d8d5e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:31.673571 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e1e84-4316-4202-8957-e9db7d8d5e6b None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:31.673907 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e1e84-4316-4202-8957-e9db7d8d5e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:31.674181 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e1e84-4316-4202-8957-e9db7d8d5e6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:31.674910 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e1e84-4316-4202-8957-e9db7d8d5e6b None admin] RBAC: Adding query filter params (role.id=341b3ebd68374dd5bb372bc283d34fd7, scope.project.id=51f312b4cd8b449aa2971993f68de9af, user.id=ebc80bf891614fb895af33ca1ded6b9d) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:31.675212 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e1e84-4316-4202-8957-e9db7d8d5e6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:31.676639 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e1e84-4316-4202-8957-e9db7d8d5e6b None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:31.682364 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 514/1034] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:47:31 2022] GET /identity/v3/role_assignments?user.id=ebc80bf891614fb895af33ca1ded6b9d&scope.project.id=51f312b4cd8b449aa2971993f68de9af&role.id=341b3ebd68374dd5bb372bc283d34fd7 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:32.054981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de3ce2-39d7-438f-bd81-a90671200815 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:32.055343 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de3ce2-39d7-438f-bd81-a90671200815 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:32.055532 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de3ce2-39d7-438f-bd81-a90671200815 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:32.057753 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 521/1035] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:47:32.062717 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15d1f9-1071-493b-acf0-c25abd2b9b4e None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:32.063011 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15d1f9-1071-493b-acf0-c25abd2b9b4e None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:32.063288 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15d1f9-1071-493b-acf0-c25abd2b9b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:32.081575 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-5d15d1f9-1071-493b-acf0-c25abd2b9b4e None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:32.082746 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-5d15d1f9-1071-493b-acf0-c25abd2b9b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:32.156465 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 515/1036] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:47:32.427514 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de3ce2-39d7-438f-bd81-a90671200815 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:32.528563 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:32.533533 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de3ce2-39d7-438f-bd81-a90671200815 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:32.568889 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182fbe8-7ddb-4609-8cd4-4ca869cbffc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:32.569518 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182fbe8-7ddb-4609-8cd4-4ca869cbffc4 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:32.569796 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182fbe8-7ddb-4609-8cd4-4ca869cbffc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:32.570069 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182fbe8-7ddb-4609-8cd4-4ca869cbffc4 None admin] PATH_INFO: `/v3/services/image` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:32.570646 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2182fbe8-7ddb-4609-8cd4-4ca869cbffc4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:32.572041 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2182fbe8-7ddb-4609-8cd4-4ca869cbffc4 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:32.581021 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-2182fbe8-7ddb-4609-8cd4-4ca869cbffc4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 15:47:32.581021 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:32.581021 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 15:47:32.581021 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 15:47:32.581021 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 15:47:32.581021 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 15:47:32.581021 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 15:47:32.581021 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:47:32.581021 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 15:47:32.581021 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:32.581021 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 15:47:32.581021 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:32.581021 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:32.581021 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:32.581021 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:32.581021 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:32.581021 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:32.582085 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:32.582085 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:32.582085 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:32.582085 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:32.582085 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:32.582085 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:32.582085 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 15:47:32.582085 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 15:47:32.582085 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 15:47:32.582085 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 15:47:32.582085 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:32.582085 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:32.582085 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:32.582085 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:32.582085 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:32.582085 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:32.583509 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:32.583509 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:32.583509 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:32.583509 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:32.583509 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:32.583509 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:32.583509 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:32.583509 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:32.583509 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:32.583509 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:32.583509 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 15:47:32.583509 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:47:32.583509 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 15:47:32.583509 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:32.584662 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 522/1037] 10.222.0.25 () {56 vars in 1105 bytes} [Tue Aug 30 15:47:32 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:32.588259 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15d1f9-1071-493b-acf0-c25abd2b9b4e None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:32.689373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15d1f9-1071-493b-acf0-c25abd2b9b4e None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:32.713650 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:32.735053 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee32be2-f1ea-4fa6-a112-7372179903d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:32.735673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee32be2-f1ea-4fa6-a112-7372179903d2 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:32.735954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee32be2-f1ea-4fa6-a112-7372179903d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:32.736227 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee32be2-f1ea-4fa6-a112-7372179903d2 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:32.736902 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee32be2-f1ea-4fa6-a112-7372179903d2 None admin] RBAC: Adding query filter params (name=image) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:32.737204 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee32be2-f1ea-4fa6-a112-7372179903d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:32.738598 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee32be2-f1ea-4fa6-a112-7372179903d2 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:32.749306 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 516/1038] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:47:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:32.750664 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182fbe8-7ddb-4609-8cd4-4ca869cbffc4 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:32.854255 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182fbe8-7ddb-4609-8cd4-4ca869cbffc4 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:32.888233 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d418b-f81d-408e-a0b3-3ee22240c309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:32.889203 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d418b-f81d-408e-a0b3-3ee22240c309 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:32.889685 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d418b-f81d-408e-a0b3-3ee22240c309 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:32.890149 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d418b-f81d-408e-a0b3-3ee22240c309 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:32.890972 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d418b-f81d-408e-a0b3-3ee22240c309 None admin] RBAC: Adding query filter params (type=image) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:32.891465 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d418b-f81d-408e-a0b3-3ee22240c309 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:32.893361 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d418b-f81d-408e-a0b3-3ee22240c309 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:32.903775 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 523/1039] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:47:32 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:32.905219 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee32be2-f1ea-4fa6-a112-7372179903d2 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:33.008201 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee32be2-f1ea-4fa6-a112-7372179903d2 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:33.043208 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2943d-8490-4d10-b98a-6bb432ed854c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:33.043832 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2943d-8490-4d10-b98a-6bb432ed854c None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:33.044113 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2943d-8490-4d10-b98a-6bb432ed854c None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:33.044388 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2943d-8490-4d10-b98a-6bb432ed854c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:33.045120 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a2943d-8490-4d10-b98a-6bb432ed854c None admin] RBAC: Adding query filter params (interface=public, service_id=f2a1bc2af4a844a0b849113d393784e4, region_id=RegionOne) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:33.045431 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a2943d-8490-4d10-b98a-6bb432ed854c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:33.046810 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a2943d-8490-4d10-b98a-6bb432ed854c None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:33.056968 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 517/1040] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Aug 30 15:47:32 2022] GET /identity/v3/endpoints?service_id=f2a1bc2af4a844a0b849113d393784e4&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:33.058293 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d418b-f81d-408e-a0b3-3ee22240c309 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:33.090608 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:33.164225 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d418b-f81d-408e-a0b3-3ee22240c309 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:33.200197 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef55992-49a3-45d9-8d99-ef7a6c8a0181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:33.200830 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef55992-49a3-45d9-8d99-ef7a6c8a0181 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:33.201111 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef55992-49a3-45d9-8d99-ef7a6c8a0181 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:33.201430 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef55992-49a3-45d9-8d99-ef7a6c8a0181 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:33.202035 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef55992-49a3-45d9-8d99-ef7a6c8a0181 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:33.203384 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef55992-49a3-45d9-8d99-ef7a6c8a0181 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:33.216822 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 524/1041] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Aug 30 15:47:33 2022] GET /identity/v3/services => generated 1957 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:47:33.292053 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99dcfad-4346-4478-aab7-48a01d9026ae None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:33.292354 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99dcfad-4346-4478-aab7-48a01d9026ae None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:33.292543 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99dcfad-4346-4478-aab7-48a01d9026ae None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:33.294078 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 518/1042] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:47:33.299664 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6aed9-2f1f-47f0-b433-3a4984cf1776 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:33.299950 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6aed9-2f1f-47f0-b433-3a4984cf1776 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:33.300225 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6aed9-2f1f-47f0-b433-3a4984cf1776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:33.319478 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-add6aed9-2f1f-47f0-b433-3a4984cf1776 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:33.320717 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-add6aed9-2f1f-47f0-b433-3a4984cf1776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:33.398710 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 525/1043] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:33 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:47:33.591719 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a50ae-854b-4927-b2e8-fab64df27234 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:33.592272 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a50ae-854b-4927-b2e8-fab64df27234 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:33.592272 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a50ae-854b-4927-b2e8-fab64df27234 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:33.593780 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 519/1044] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:47:33.599004 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59bce51-cabc-47d6-9b41-c77f2ee9f34a None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:33.599425 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59bce51-cabc-47d6-9b41-c77f2ee9f34a None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:33.599590 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59bce51-cabc-47d6-9b41-c77f2ee9f34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:33.618696 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-c59bce51-cabc-47d6-9b41-c77f2ee9f34a None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:33.619910 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c59bce51-cabc-47d6-9b41-c77f2ee9f34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:33.637009 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:33.690834 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 526/1045] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:33 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:47:33.709975 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a50ae-854b-4927-b2e8-fab64df27234 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:33.762572 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:33.824190 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a50ae-854b-4927-b2e8-fab64df27234 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:33.859161 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdb09f-e3bc-4ff4-b2b4-b234fca70f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:33.859708 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdb09f-e3bc-4ff4-b2b4-b234fca70f43 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:33.859982 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdb09f-e3bc-4ff4-b2b4-b234fca70f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:33.860249 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdb09f-e3bc-4ff4-b2b4-b234fca70f43 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:33.861375 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bdb09f-e3bc-4ff4-b2b4-b234fca70f43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:33.862811 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bdb09f-e3bc-4ff4-b2b4-b234fca70f43 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:33.864572 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 520/1046] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:47:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:33.869989 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59bce51-cabc-47d6-9b41-c77f2ee9f34a None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:33.969273 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59bce51-cabc-47d6-9b41-c77f2ee9f34a None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:33.969614 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdb09f-e3bc-4ff4-b2b4-b234fca70f43 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:34.002929 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027dea3-c39a-4e9d-9946-e6739373a56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:34.003531 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027dea3-c39a-4e9d-9946-e6739373a56a None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:34.003806 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027dea3-c39a-4e9d-9946-e6739373a56a None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:34.004071 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027dea3-c39a-4e9d-9946-e6739373a56a None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:34.004716 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a027dea3-c39a-4e9d-9946-e6739373a56a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:34.006163 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a027dea3-c39a-4e9d-9946-e6739373a56a None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:34.036016 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 527/1047] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Aug 30 15:47:33 2022] POST /identity/v3/users => generated 285 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:47:34.078436 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdb09f-e3bc-4ff4-b2b4-b234fca70f43 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:34.098610 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:34.118107 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf919a-8c23-4847-aa2e-6289312fa149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:34.118662 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf919a-8c23-4847-aa2e-6289312fa149 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:34.119031 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf919a-8c23-4847-aa2e-6289312fa149 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:34.119372 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf919a-8c23-4847-aa2e-6289312fa149 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:34.130730 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cf919a-8c23-4847-aa2e-6289312fa149 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:47:34.136220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-02cf919a-8c23-4847-aa2e-6289312fa149 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 15:47:34.136220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:34.136220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:34.136220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:34.136220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:34.136220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:34.136220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:34.136220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:34.136220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:34.136220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:34.136220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:34.136220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:34.136220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:47:34.136220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:47:34.136220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:47:34.136220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:47:34.137427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:47:34.137427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:47:34.137427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:47:34.137427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:47:34.137427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:34.137427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:34.137427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:34.137427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:34.137427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:34.137427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:34.137427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:34.137427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:34.137427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:34.137427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:34.137427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:34.137427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:34.141846 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:34.141846 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:34.141846 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:34.141846 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:34.141846 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:47:34.141846 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:47:34.141846 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:47:34.141846 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:47:34.141846 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:47:34.141846 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:47:34.141846 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 15:47:34.141846 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:34.141846 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 521/1048] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Aug 30 15:47:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 15:47:34.144373 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027dea3-c39a-4e9d-9946-e6739373a56a None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:34.159254 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:34.256739 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027dea3-c39a-4e9d-9946-e6739373a56a None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:34.292844 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deec97a-6a18-486f-9885-ce4f9543100d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:34.293465 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deec97a-6a18-486f-9885-ce4f9543100d None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:34.293745 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deec97a-6a18-486f-9885-ce4f9543100d None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:34.294017 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deec97a-6a18-486f-9885-ce4f9543100d None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:34.294687 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deec97a-6a18-486f-9885-ce4f9543100d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:34.294990 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deec97a-6a18-486f-9885-ce4f9543100d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:34.296387 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deec97a-6a18-486f-9885-ce4f9543100d None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:34.304821 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 528/1049] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Aug 30 15:47:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:34.310883 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf919a-8c23-4847-aa2e-6289312fa149 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:34.414590 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf919a-8c23-4847-aa2e-6289312fa149 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:34.449539 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a25a2f-c392-4af2-aee3-b0bcd8db0f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:34.450179 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a25a2f-c392-4af2-aee3-b0bcd8db0f38 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:34.450459 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a25a2f-c392-4af2-aee3-b0bcd8db0f38 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:34.450732 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a25a2f-c392-4af2-aee3-b0bcd8db0f38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:34.460724 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a25a2f-c392-4af2-aee3-b0bcd8db0f38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:34.462208 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a25a2f-c392-4af2-aee3-b0bcd8db0f38 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:34.476600 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-c8a25a2f-c392-4af2-aee3-b0bcd8db0f38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:47:34.476600 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:34.476600 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:34.476600 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:34.476600 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:34.476600 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:34.476600 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:34.476600 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:34.476600 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:34.476600 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:34.476600 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:34.476600 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:34.476600 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:47:34.476600 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:47:34.476600 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:47:34.476600 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:47:34.477690 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:34.477690 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:34.477690 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:34.477690 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:34.477690 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:34.477690 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:34.477690 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:34.477690 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:34.477690 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:34.477690 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:34.477690 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:34.477690 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:34.477690 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:34.477690 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:34.477690 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:34.477690 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:34.477690 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:47:34.478735 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:47:34.478735 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:47:34.478735 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:34.479429 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 522/1050] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:47:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:34.483665 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deec97a-6a18-486f-9885-ce4f9543100d None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:34.554934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:34.589773 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deec97a-6a18-486f-9885-ce4f9543100d None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:34.623783 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86d71c-7057-41de-a0b2-5683e8120216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:34.624497 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86d71c-7057-41de-a0b2-5683e8120216 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:34.624733 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86d71c-7057-41de-a0b2-5683e8120216 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:34.624947 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86d71c-7057-41de-a0b2-5683e8120216 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:34.625600 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f86d71c-7057-41de-a0b2-5683e8120216 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:34.625902 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f86d71c-7057-41de-a0b2-5683e8120216 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:34.627272 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f86d71c-7057-41de-a0b2-5683e8120216 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:34.639709 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 529/1051] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:47:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:34.645420 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a25a2f-c392-4af2-aee3-b0bcd8db0f38 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:34.676909 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:34.759361 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a25a2f-c392-4af2-aee3-b0bcd8db0f38 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:34.793525 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83346b-eb6d-4da9-bb1f-1f4c1670febf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:34.794156 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83346b-eb6d-4da9-bb1f-1f4c1670febf None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:34.794429 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83346b-eb6d-4da9-bb1f-1f4c1670febf None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:34.794694 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83346b-eb6d-4da9-bb1f-1f4c1670febf None admin] PATH_INFO: `/v3/users/nova` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:34.802174 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b83346b-eb6d-4da9-bb1f-1f4c1670febf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:34.803614 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b83346b-eb6d-4da9-bb1f-1f4c1670febf None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:34.815517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-0b83346b-eb6d-4da9-bb1f-1f4c1670febf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 15:47:34.815517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:34.815517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:34.815517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:34.815517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:34.815517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:34.815517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:34.815517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:34.815517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:34.815517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:34.815517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:34.815517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:34.815517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 15:47:34.815517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 15:47:34.815517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 15:47:34.815517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 15:47:34.816509 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:34.816509 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:34.816509 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 15:47:34.816509 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:47:34.816509 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 15:47:34.816509 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:47:34.816509 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:34.816509 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:34.816509 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:34.816509 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:34.816509 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:34.816509 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:34.816509 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:34.816509 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:34.816509 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:34.816509 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:34.816509 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:34.816509 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:34.822077 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:34.822077 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:34.822077 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 15:47:34.822077 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 15:47:34.822077 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 15:47:34.822077 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 15:47:34.822077 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 15:47:34.822077 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 15:47:34.822077 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 15:47:34.822077 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:34.822077 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 523/1052] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Aug 30 15:47:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 15:47:34.824641 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86d71c-7057-41de-a0b2-5683e8120216 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:34.928537 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86d71c-7057-41de-a0b2-5683e8120216 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:34.957518 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:34.964543 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca8607d-0593-477b-a734-792e4a43ed60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:34.965184 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8607d-0593-477b-a734-792e4a43ed60 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:34.965470 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8607d-0593-477b-a734-792e4a43ed60 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:34.965745 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8607d-0593-477b-a734-792e4a43ed60 None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:34.966477 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca8607d-0593-477b-a734-792e4a43ed60 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:34.966783 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca8607d-0593-477b-a734-792e4a43ed60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:34.968242 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca8607d-0593-477b-a734-792e4a43ed60 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:34.990514 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 530/1053] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Aug 30 15:47:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:34.992246 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83346b-eb6d-4da9-bb1f-1f4c1670febf None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:35.089667 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:35.100399 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83346b-eb6d-4da9-bb1f-1f4c1670febf None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:35.134900 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8dbbdd-7f58-465c-a980-a7630edeb509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:35.135538 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8dbbdd-7f58-465c-a980-a7630edeb509 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:35.135818 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8dbbdd-7f58-465c-a980-a7630edeb509 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:35.136091 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8dbbdd-7f58-465c-a980-a7630edeb509 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:35.146965 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8dbbdd-7f58-465c-a980-a7630edeb509 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:35.148424 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8dbbdd-7f58-465c-a980-a7630edeb509 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:35.163029 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-fb8dbbdd-7f58-465c-a980-a7630edeb509 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:47:35.163029 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:35.163029 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:35.163029 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:35.163029 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:35.163029 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:35.163029 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:35.163029 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:35.163029 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:35.163029 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:35.163029 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:35.163029 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:35.163029 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:47:35.163029 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:47:35.163029 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:47:35.163029 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:47:35.164071 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:35.164071 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:35.164071 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:35.164071 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:35.164071 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:35.164071 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:35.164071 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:35.164071 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:35.164071 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:35.164071 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:35.164071 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:35.164071 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:35.164071 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:35.164071 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:35.164071 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:35.164071 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:35.164071 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:47:35.165399 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:47:35.165399 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:47:35.165399 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:35.168984 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 524/1054] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:47:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 15:47:35.170963 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca8607d-0593-477b-a734-792e4a43ed60 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:35.190694 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b9ace-5c2f-49aa-8d99-e366d4e7efa1 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:35.190890 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b9ace-5c2f-49aa-8d99-e366d4e7efa1 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:35.191144 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b9ace-5c2f-49aa-8d99-e366d4e7efa1 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:35.192549 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 525/1055] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 15:47:35.198734 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94643e-bc86-4413-8fdb-87cdd5f8c081 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:35.199009 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94643e-bc86-4413-8fdb-87cdd5f8c081 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:35.199341 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94643e-bc86-4413-8fdb-87cdd5f8c081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:35.217283 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-3f94643e-bc86-4413-8fdb-87cdd5f8c081 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:35.218473 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-3f94643e-bc86-4413-8fdb-87cdd5f8c081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:35.278198 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca8607d-0593-477b-a734-792e4a43ed60 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:35.287436 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 526/1056] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:35 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 15:47:35.313781 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55683925-9e5f-4716-90c3-d9fcb6b044ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:35.314387 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55683925-9e5f-4716-90c3-d9fcb6b044ea None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:35.314662 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55683925-9e5f-4716-90c3-d9fcb6b044ea None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:35.314931 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55683925-9e5f-4716-90c3-d9fcb6b044ea None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:35.315560 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55683925-9e5f-4716-90c3-d9fcb6b044ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:35.315857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55683925-9e5f-4716-90c3-d9fcb6b044ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:35.317240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55683925-9e5f-4716-90c3-d9fcb6b044ea None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:35.329062 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 531/1057] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:47:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:35.334426 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94643e-bc86-4413-8fdb-87cdd5f8c081 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:35.403321 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:35.433630 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94643e-bc86-4413-8fdb-87cdd5f8c081 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:35.467703 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3a404-3f27-4566-bf48-26064e2ad3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:35.468262 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3a404-3f27-4566-bf48-26064e2ad3df None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:35.468539 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3a404-3f27-4566-bf48-26064e2ad3df None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:35.468826 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3a404-3f27-4566-bf48-26064e2ad3df None admin] PATH_INFO: `/v3/projects/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:35.475342 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd3a404-3f27-4566-bf48-26064e2ad3df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:35.476776 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd3a404-3f27-4566-bf48-26064e2ad3df None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:35.488571 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-afd3a404-3f27-4566-bf48-26064e2ad3df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:47:35.488571 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:35.488571 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:35.488571 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:35.488571 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:35.488571 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:35.488571 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:35.488571 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:35.488571 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:35.488571 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:35.488571 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:35.488571 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:35.488571 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 15:47:35.488571 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 15:47:35.488571 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 15:47:35.489626 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 15:47:35.489626 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:35.489626 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:35.489626 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:35.489626 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:35.489626 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:35.489626 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:35.489626 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:35.489626 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:35.489626 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:35.489626 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:35.489626 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:35.489626 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:35.489626 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:35.489626 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:35.489626 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:35.489626 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:35.490569 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 15:47:35.490569 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 15:47:35.490569 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 15:47:35.490569 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 15:47:35.490569 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 15:47:35.490569 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 15:47:35.490569 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:47:35.490569 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:35.493163 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 527/1058] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:47:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:35.496554 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55683925-9e5f-4716-90c3-d9fcb6b044ea None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:35.549825 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:35.559095 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3a404-3f27-4566-bf48-26064e2ad3df None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:35.608933 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55683925-9e5f-4716-90c3-d9fcb6b044ea None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:35.645098 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66bbaa-9b97-4513-94c6-06da48ea7ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:35.645765 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66bbaa-9b97-4513-94c6-06da48ea7ccc None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:35.645987 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66bbaa-9b97-4513-94c6-06da48ea7ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:35.646514 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66bbaa-9b97-4513-94c6-06da48ea7ccc None admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:35.646910 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa66bbaa-9b97-4513-94c6-06da48ea7ccc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:35.647208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa66bbaa-9b97-4513-94c6-06da48ea7ccc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:35.648617 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa66bbaa-9b97-4513-94c6-06da48ea7ccc None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:35.665515 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 532/1059] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 30 15:47:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:47:35.671124 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3a404-3f27-4566-bf48-26064e2ad3df None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:35.671957 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66bbaa-9b97-4513-94c6-06da48ea7ccc None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:35.702154 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:35.708365 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31a25e-034c-470c-a18a-690f65bf7e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:35.709037 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31a25e-034c-470c-a18a-690f65bf7e1d None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:35.709314 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31a25e-034c-470c-a18a-690f65bf7e1d None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:35.709584 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31a25e-034c-470c-a18a-690f65bf7e1d None admin] PATH_INFO: `/v3/services/image` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:35.710177 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31a25e-034c-470c-a18a-690f65bf7e1d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:35.711552 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31a25e-034c-470c-a18a-690f65bf7e1d None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:35.721120 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-8f31a25e-034c-470c-a18a-690f65bf7e1d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 15:47:35.721120 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:35.721120 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 15:47:35.721120 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 15:47:35.721120 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 15:47:35.721120 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 15:47:35.721120 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 15:47:35.721120 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:47:35.721120 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 15:47:35.721120 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:35.721120 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 15:47:35.721120 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:35.721120 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:35.721120 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:35.721120 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:35.721120 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:35.721120 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:35.722125 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:35.722125 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:35.722125 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:35.722125 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:35.722125 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:35.722125 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:35.722125 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 15:47:35.722125 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 15:47:35.722125 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 15:47:35.722125 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 15:47:35.722125 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:35.722125 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:35.722125 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:35.722125 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:35.722125 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:35.722125 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:35.723610 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:35.723610 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:35.723610 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:35.723610 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:35.723610 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:35.723610 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:35.723610 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:35.723610 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:35.723610 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:35.723610 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:35.723610 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 15:47:35.723610 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:47:35.723610 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 15:47:35.723610 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:35.727389 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 528/1060] 10.222.0.25 () {56 vars in 1105 bytes} [Tue Aug 30 15:47:35 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 15:47:35.728927 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31a25e-034c-470c-a18a-690f65bf7e1d None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:35.791650 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66bbaa-9b97-4513-94c6-06da48ea7ccc None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:35.801756 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:35.829201 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2a9ca-345a-4d98-a8bd-475c905e87bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:35.830013 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2a9ca-345a-4d98-a8bd-475c905e87bb None admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:35.830290 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2a9ca-345a-4d98-a8bd-475c905e87bb None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:35.830672 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2a9ca-345a-4d98-a8bd-475c905e87bb None admin] PATH_INFO: `/v3/projects/51f312b4cd8b449aa2971993f68de9af/users/ebc80bf891614fb895af33ca1ded6b9d/roles/341b3ebd68374dd5bb372bc283d34fd7` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:35.832948 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2a9ca-345a-4d98-a8bd-475c905e87bb None admin] RBAC: Authorizing `identity:create_grant(project_id=51f312b4cd8b449aa2971993f68de9af, user_id=ebc80bf891614fb895af33ca1ded6b9d, role_id=341b3ebd68374dd5bb372bc283d34fd7)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:35.834495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2a9ca-345a-4d98-a8bd-475c905e87bb None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:35.836479 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31a25e-034c-470c-a18a-690f65bf7e1d None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:35.848990 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 533/1061] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 30 15:47:35 2022] PUT /identity/v3/projects/51f312b4cd8b449aa2971993f68de9af/users/ebc80bf891614fb895af33ca1ded6b9d/roles/341b3ebd68374dd5bb372bc283d34fd7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:47:35.876188 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e1176-d394-4726-b403-b83238eeea26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:35.876861 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e1176-d394-4726-b403-b83238eeea26 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:35.877146 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e1176-d394-4726-b403-b83238eeea26 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:35.877412 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e1176-d394-4726-b403-b83238eeea26 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:35.878072 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e1176-d394-4726-b403-b83238eeea26 None admin] RBAC: Adding query filter params (name=image) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:35.878523 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e1176-d394-4726-b403-b83238eeea26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:35.880164 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e1176-d394-4726-b403-b83238eeea26 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:35.886857 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 529/1062] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:47:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:35.892667 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2a9ca-345a-4d98-a8bd-475c905e87bb None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:36.001318 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2a9ca-345a-4d98-a8bd-475c905e87bb None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:36.032270 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed14fa7-44d6-4984-9637-98ef96ab9be1 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:36.032554 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed14fa7-44d6-4984-9637-98ef96ab9be1 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:36.032893 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed14fa7-44d6-4984-9637-98ef96ab9be1 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:36.034363 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 530/1063] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 15:47:36.039685 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affea5e2-4840-41b1-8ba2-12211c24b3d9 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:36.040174 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affea5e2-4840-41b1-8ba2-12211c24b3d9 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:36.040679 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affea5e2-4840-41b1-8ba2-12211c24b3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:36.042506 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df241679-1ba6-4a01-8bcd-7919caa3bf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:36.043125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df241679-1ba6-4a01-8bcd-7919caa3bf7e None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:36.043403 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df241679-1ba6-4a01-8bcd-7919caa3bf7e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:36.043671 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df241679-1ba6-4a01-8bcd-7919caa3bf7e None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:36.044310 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df241679-1ba6-4a01-8bcd-7919caa3bf7e None admin] RBAC: Adding query filter params (type=image) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:36.044611 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df241679-1ba6-4a01-8bcd-7919caa3bf7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:36.046002 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df241679-1ba6-4a01-8bcd-7919caa3bf7e None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:36.051114 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 534/1064] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:47:35 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:47:36.057044 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df241679-1ba6-4a01-8bcd-7919caa3bf7e None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:36.060356 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-affea5e2-4840-41b1-8ba2-12211c24b3d9 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:36.061680 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-affea5e2-4840-41b1-8ba2-12211c24b3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:36.089991 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:36.121514 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:36.134220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 531/1065] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:36 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:47:36.169852 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df241679-1ba6-4a01-8bcd-7919caa3bf7e None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:36.210157 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5211c-1180-46cc-817b-7f578abaa9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:36.210782 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5211c-1180-46cc-817b-7f578abaa9d3 None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:36.211057 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5211c-1180-46cc-817b-7f578abaa9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:36.211327 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5211c-1180-46cc-817b-7f578abaa9d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:36.212006 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee5211c-1180-46cc-817b-7f578abaa9d3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:36.213648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee5211c-1180-46cc-817b-7f578abaa9d3 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:36.240862 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 535/1066] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:47:36 2022] POST /identity/v3/endpoints => generated 327 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:47:36.406285 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affea5e2-4840-41b1-8ba2-12211c24b3d9 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:36.508005 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affea5e2-4840-41b1-8ba2-12211c24b3d9 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:36.549698 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792a15d-60b2-4d4f-ac1b-61711c347b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:36.550342 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792a15d-60b2-4d4f-ac1b-61711c347b3a None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:36.550620 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792a15d-60b2-4d4f-ac1b-61711c347b3a None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:36.550889 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792a15d-60b2-4d4f-ac1b-61711c347b3a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:36.561855 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792a15d-60b2-4d4f-ac1b-61711c347b3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:47:36.566635 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-2792a15d-60b2-4d4f-ac1b-61711c347b3a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:47:36.566635 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:36.566635 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:36.566635 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:36.566635 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:36.566635 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:36.566635 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:36.566635 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:36.566635 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:36.566635 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:36.566635 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:36.566635 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:36.566635 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:47:36.566635 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:47:36.566635 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:47:36.566635 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:47:36.567601 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:47:36.567601 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:47:36.567601 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:47:36.567601 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:47:36.567601 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:36.567601 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:36.567601 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:36.567601 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:36.567601 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:36.567601 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:36.567601 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:36.567601 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:36.567601 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:36.567601 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:36.567601 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:36.567601 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:36.568445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:36.568445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:36.568445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:36.568445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:36.568445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:47:36.568445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:47:36.568445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:47:36.568445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:47:36.568445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:47:36.568445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:47:36.568445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:47:36.568445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:36.572926 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 532/1067] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 30 15:47:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:36.574547 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5211c-1180-46cc-817b-7f578abaa9d3 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:36.663460 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:36.678257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5211c-1180-46cc-817b-7f578abaa9d3 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:36.714173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2d15c-77ee-499a-a5c4-0a0b4f79db71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:36.714789 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2d15c-77ee-499a-a5c4-0a0b4f79db71 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:36.715067 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2d15c-77ee-499a-a5c4-0a0b4f79db71 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:36.715338 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2d15c-77ee-499a-a5c4-0a0b4f79db71 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:36.716014 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2d15c-77ee-499a-a5c4-0a0b4f79db71 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:36.716314 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2d15c-77ee-499a-a5c4-0a0b4f79db71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:36.717725 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2d15c-77ee-499a-a5c4-0a0b4f79db71 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:36.736120 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 536/1068] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:47:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:36.737391 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792a15d-60b2-4d4f-ac1b-61711c347b3a None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:36.786927 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:36.843382 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792a15d-60b2-4d4f-ac1b-61711c347b3a None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:36.879608 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a61d4-dc28-41fb-bfff-ff04f59549d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:36.880251 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a61d4-dc28-41fb-bfff-ff04f59549d0 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:36.880531 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a61d4-dc28-41fb-bfff-ff04f59549d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:36.880836 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a61d4-dc28-41fb-bfff-ff04f59549d0 None admin] PATH_INFO: `/v3/users/21336492420f49a6b6d562df11f1ff1f` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:36.895732 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a61d4-dc28-41fb-bfff-ff04f59549d0 None admin] RBAC: Authorizing `identity:get_user(user_id=21336492420f49a6b6d562df11f1ff1f)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:36.897223 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a61d4-dc28-41fb-bfff-ff04f59549d0 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:36.899103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 533/1069] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:47:36 2022] GET /identity/v3/users/21336492420f49a6b6d562df11f1ff1f => generated 285 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:36.904931 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2d15c-77ee-499a-a5c4-0a0b4f79db71 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:37.007819 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2d15c-77ee-499a-a5c4-0a0b4f79db71 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:37.042268 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0fe23-747f-48dd-a00f-c3f8e7a9c080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:37.042874 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0fe23-747f-48dd-a00f-c3f8e7a9c080 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:37.043151 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0fe23-747f-48dd-a00f-c3f8e7a9c080 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:37.043419 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0fe23-747f-48dd-a00f-c3f8e7a9c080 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:37.062124 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:37.112473 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b0fe23-747f-48dd-a00f-c3f8e7a9c080 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:37.113957 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b0fe23-747f-48dd-a00f-c3f8e7a9c080 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:37.216399 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 537/1070] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:47:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 15:47:37.217685 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a61d4-dc28-41fb-bfff-ff04f59549d0 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:37.322324 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a61d4-dc28-41fb-bfff-ff04f59549d0 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:37.324680 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:37.361927 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179bf478-4b13-415d-827d-b62d4b07cdc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:37.362569 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179bf478-4b13-415d-827d-b62d4b07cdc9 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:37.362851 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179bf478-4b13-415d-827d-b62d4b07cdc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:37.363124 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179bf478-4b13-415d-827d-b62d4b07cdc9 None admin] PATH_INFO: `/v3/projects/592c069f466d408ca641f3c665c08a5d` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:37.364256 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179bf478-4b13-415d-827d-b62d4b07cdc9 None admin] RBAC: Authorizing `identity:get_project(project_id=592c069f466d408ca641f3c665c08a5d)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:37.365726 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179bf478-4b13-415d-827d-b62d4b07cdc9 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:37.367969 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 534/1071] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:47:37 2022] GET /identity/v3/projects/592c069f466d408ca641f3c665c08a5d => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:37.373485 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0fe23-747f-48dd-a00f-c3f8e7a9c080 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:37.425614 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:37.475615 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0fe23-747f-48dd-a00f-c3f8e7a9c080 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:37.510353 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0b658-c761-4474-ae61-9dfc6c0487f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:37.510955 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0b658-c761-4474-ae61-9dfc6c0487f3 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:37.511227 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0b658-c761-4474-ae61-9dfc6c0487f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:37.511492 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0b658-c761-4474-ae61-9dfc6c0487f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:37.512206 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db0b658-c761-4474-ae61-9dfc6c0487f3 None admin] RBAC: Adding query filter params (role.id=676938e69210499ca11ee75dd572d0dc, scope.project.id=592c069f466d408ca641f3c665c08a5d, user.id=21336492420f49a6b6d562df11f1ff1f) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:37.512513 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db0b658-c761-4474-ae61-9dfc6c0487f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:37.513963 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db0b658-c761-4474-ae61-9dfc6c0487f3 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:37.524807 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 538/1072] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:47:37 2022] GET /identity/v3/role_assignments?user.id=21336492420f49a6b6d562df11f1ff1f&scope.project.id=592c069f466d408ca641f3c665c08a5d&role.id=676938e69210499ca11ee75dd572d0dc => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:47:37.803576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471032e-40d2-4981-9124-d85b499311c5 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:37.804084 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471032e-40d2-4981-9124-d85b499311c5 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:37.804187 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471032e-40d2-4981-9124-d85b499311c5 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:37.805625 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 535/1073] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:47:37.811802 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f619ea8-97f5-4d16-ad81-73d1ab29d9e3 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:37.812250 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f619ea8-97f5-4d16-ad81-73d1ab29d9e3 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:37.812330 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f619ea8-97f5-4d16-ad81-73d1ab29d9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:37.830902 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-5f619ea8-97f5-4d16-ad81-73d1ab29d9e3 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:37.832072 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-5f619ea8-97f5-4d16-ad81-73d1ab29d9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:37.903331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 539/1074] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 15:47:38.171972 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471032e-40d2-4981-9124-d85b499311c5 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:38.191878 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce501bd-0d27-412d-99a1-a29ee73dbaa8 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:38.192215 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce501bd-0d27-412d-99a1-a29ee73dbaa8 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:38.192439 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce501bd-0d27-412d-99a1-a29ee73dbaa8 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:38.194008 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 540/1075] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:47:38.202117 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bea3c0-231b-4d3c-b211-8934d0739588 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:38.202579 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bea3c0-231b-4d3c-b211-8934d0739588 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:38.203035 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bea3c0-231b-4d3c-b211-8934d0739588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:38.221326 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-85bea3c0-231b-4d3c-b211-8934d0739588 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:38.222519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-85bea3c0-231b-4d3c-b211-8934d0739588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:38.265215 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:38.277567 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471032e-40d2-4981-9124-d85b499311c5 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:38.295188 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 541/1076] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:47:38.311061 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e504e91-7e72-48ae-8ce5-e6470bfd40ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:38.311689 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e504e91-7e72-48ae-8ce5-e6470bfd40ad None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:38.311966 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e504e91-7e72-48ae-8ce5-e6470bfd40ad None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:38.312235 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e504e91-7e72-48ae-8ce5-e6470bfd40ad None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:38.322646 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e504e91-7e72-48ae-8ce5-e6470bfd40ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:47:38.327384 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-0e504e91-7e72-48ae-8ce5-e6470bfd40ad None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 15:47:38.327384 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:38.327384 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:38.327384 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:38.327384 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:38.327384 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:38.327384 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:38.327384 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:38.327384 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:38.327384 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:38.327384 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:38.327384 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:38.327384 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:47:38.327384 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:47:38.327384 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:47:38.327384 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:47:38.328297 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:47:38.328297 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:47:38.328297 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:47:38.328297 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:47:38.328297 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:38.328297 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:38.328297 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:38.328297 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:38.328297 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:38.328297 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:38.328297 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:38.328297 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:38.328297 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:38.328297 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:38.328297 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:38.328297 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:38.329191 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:38.329191 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:38.329191 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:38.329191 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:38.329191 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:47:38.329191 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:47:38.329191 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:47:38.329191 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:47:38.329191 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:47:38.329191 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:47:38.329191 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 15:47:38.329191 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:38.329191 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 536/1077] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Aug 30 15:47:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 15:47:38.335881 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bea3c0-231b-4d3c-b211-8934d0739588 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:38.433689 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bea3c0-231b-4d3c-b211-8934d0739588 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:38.470369 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b41c9-85b1-4344-ad4c-b7d0ef7ba7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:38.470977 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b41c9-85b1-4344-ad4c-b7d0ef7ba7b3 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:38.471251 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b41c9-85b1-4344-ad4c-b7d0ef7ba7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:38.471516 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b41c9-85b1-4344-ad4c-b7d0ef7ba7b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:38.472177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324b41c9-85b1-4344-ad4c-b7d0ef7ba7b3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:38.472471 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324b41c9-85b1-4344-ad4c-b7d0ef7ba7b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:38.473860 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324b41c9-85b1-4344-ad4c-b7d0ef7ba7b3 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:38.482610 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 542/1078] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Aug 30 15:47:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:38.487973 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e504e91-7e72-48ae-8ce5-e6470bfd40ad None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:38.519869 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:38.565367 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b41c9-85b1-4344-ad4c-b7d0ef7ba7b3 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:38.594104 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e504e91-7e72-48ae-8ce5-e6470bfd40ad None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:38.603703 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:38.630666 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc443e5-aab4-4332-8d5d-d99ec560763c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:38.631265 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc443e5-aab4-4332-8d5d-d99ec560763c None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:38.631547 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc443e5-aab4-4332-8d5d-d99ec560763c None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:38.631823 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc443e5-aab4-4332-8d5d-d99ec560763c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:38.643139 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc443e5-aab4-4332-8d5d-d99ec560763c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:38.644611 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc443e5-aab4-4332-8d5d-d99ec560763c None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:38.662975 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-3bc443e5-aab4-4332-8d5d-d99ec560763c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:47:38.662975 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:38.662975 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:38.662975 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:38.662975 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:38.662975 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:38.662975 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:38.662975 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:38.662975 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:38.662975 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:38.662975 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:38.662975 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:38.662975 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:47:38.662975 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:47:38.662975 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:47:38.662975 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:47:38.663954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:38.663954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:38.663954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:38.663954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:38.663954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:38.663954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:38.663954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:38.663954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:38.663954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:38.663954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:38.663954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:38.663954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:38.663954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:38.663954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:38.663954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:38.663954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:38.663954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:47:38.665135 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:47:38.665135 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:47:38.665135 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:38.665135 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 537/1079] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:47:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:38.670781 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc443e5-aab4-4332-8d5d-d99ec560763c None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:38.679639 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b41c9-85b1-4344-ad4c-b7d0ef7ba7b3 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:38.717362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f90a1-18d2-454e-b4f4-2235111cb8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:38.718204 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f90a1-18d2-454e-b4f4-2235111cb8b2 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:38.718631 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f90a1-18d2-454e-b4f4-2235111cb8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:38.719046 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f90a1-18d2-454e-b4f4-2235111cb8b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:38.795458 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:38.805639 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27f90a1-18d2-454e-b4f4-2235111cb8b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:38.807834 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27f90a1-18d2-454e-b4f4-2235111cb8b2 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:38.823097 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc443e5-aab4-4332-8d5d-d99ec560763c None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:38.847205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:38.862315 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13179f75-5e09-47b4-a587-70dcac96e493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:38.863061 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13179f75-5e09-47b4-a587-70dcac96e493 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:38.863458 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13179f75-5e09-47b4-a587-70dcac96e493 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:38.863901 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13179f75-5e09-47b4-a587-70dcac96e493 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:38.864622 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13179f75-5e09-47b4-a587-70dcac96e493 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:38.865022 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13179f75-5e09-47b4-a587-70dcac96e493 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:38.866595 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13179f75-5e09-47b4-a587-70dcac96e493 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:38.885225 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 538/1080] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:47:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:47:38.892065 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13179f75-5e09-47b4-a587-70dcac96e493 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:38.939060 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 543/1081] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:47:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 15:47:38.940520 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f90a1-18d2-454e-b4f4-2235111cb8b2 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:39.009244 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13179f75-5e09-47b4-a587-70dcac96e493 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:39.048962 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f1de64-4c01-475b-a3c5-29b022aec2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:39.049598 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1de64-4c01-475b-a3c5-29b022aec2e7 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:39.049881 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1de64-4c01-475b-a3c5-29b022aec2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:39.050155 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1de64-4c01-475b-a3c5-29b022aec2e7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:39.058107 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f1de64-4c01-475b-a3c5-29b022aec2e7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:39.058414 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f90a1-18d2-454e-b4f4-2235111cb8b2 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:39.059574 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f1de64-4c01-475b-a3c5-29b022aec2e7 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:39.073003 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-12f1de64-4c01-475b-a3c5-29b022aec2e7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 15:47:39.073003 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:39.073003 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:39.073003 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:39.073003 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:39.073003 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:39.073003 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:39.073003 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:39.073003 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:39.073003 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:39.073003 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:39.073003 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:39.073003 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 15:47:39.073003 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 15:47:39.073003 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 15:47:39.073003 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 15:47:39.074065 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:39.074065 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:39.074065 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 15:47:39.074065 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:47:39.074065 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 15:47:39.074065 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:47:39.074065 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:39.074065 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:39.074065 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:39.074065 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:39.074065 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:39.074065 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:39.074065 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:39.074065 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:39.074065 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:39.074065 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:39.074065 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:39.074065 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:39.075028 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:39.075028 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:39.075028 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 15:47:39.075028 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 15:47:39.075028 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 15:47:39.075028 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 15:47:39.075028 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 15:47:39.075028 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 15:47:39.075028 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 15:47:39.075028 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:39.075028 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 539/1082] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Aug 30 15:47:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:39.080772 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f1de64-4c01-475b-a3c5-29b022aec2e7 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:39.086703 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:39.116844 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54ae1a-92cb-43e3-abe3-4f317c6336f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:39.118577 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54ae1a-92cb-43e3-abe3-4f317c6336f6 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:39.119879 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54ae1a-92cb-43e3-abe3-4f317c6336f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:39.120166 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54ae1a-92cb-43e3-abe3-4f317c6336f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:39.126942 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:39.137737 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc54ae1a-92cb-43e3-abe3-4f317c6336f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:39.139438 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc54ae1a-92cb-43e3-abe3-4f317c6336f6 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:39.155230 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-dc54ae1a-92cb-43e3-abe3-4f317c6336f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:47:39.155230 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:39.155230 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:39.155230 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:39.155230 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:39.155230 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:39.155230 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:39.155230 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:39.155230 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:39.155230 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:39.155230 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:39.155230 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:39.155230 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:47:39.155230 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:47:39.155230 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:47:39.155230 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:47:39.156190 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:39.156190 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:39.156190 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:39.156190 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:39.156190 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:39.156190 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:39.156190 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:39.156190 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:39.156190 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:39.156190 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:39.156190 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:39.156190 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:39.156190 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:39.156190 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:39.156190 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:39.156190 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:39.156190 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:47:39.157560 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:47:39.157560 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:47:39.157560 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:39.157560 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 544/1083] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:47:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:39.162565 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54ae1a-92cb-43e3-abe3-4f317c6336f6 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:39.222178 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f1de64-4c01-475b-a3c5-29b022aec2e7 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:39.262364 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5adf8-f627-4753-b9b0-700ad28da4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:39.262896 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5adf8-f627-4753-b9b0-700ad28da4b1 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:39.263177 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5adf8-f627-4753-b9b0-700ad28da4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:39.263450 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5adf8-f627-4753-b9b0-700ad28da4b1 None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:39.264316 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5adf8-f627-4753-b9b0-700ad28da4b1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:39.264684 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5adf8-f627-4753-b9b0-700ad28da4b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:39.266301 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5adf8-f627-4753-b9b0-700ad28da4b1 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:39.285673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 540/1084] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Aug 30 15:47:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:39.286731 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54ae1a-92cb-43e3-abe3-4f317c6336f6 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:39.291646 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5adf8-f627-4753-b9b0-700ad28da4b1 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:39.324596 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4bdacf-e287-4f38-ba62-70a2e4467823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:39.325253 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bdacf-e287-4f38-ba62-70a2e4467823 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:39.325534 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bdacf-e287-4f38-ba62-70a2e4467823 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:39.325808 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bdacf-e287-4f38-ba62-70a2e4467823 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:39.326448 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4bdacf-e287-4f38-ba62-70a2e4467823 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:39.326758 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4bdacf-e287-4f38-ba62-70a2e4467823 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:39.328104 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4bdacf-e287-4f38-ba62-70a2e4467823 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:39.342153 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 545/1085] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:47:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:39.371158 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:39.415946 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5adf8-f627-4753-b9b0-700ad28da4b1 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:39.432210 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825011b1-b5c2-4357-918a-d9758b289bda None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:39.432449 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825011b1-b5c2-4357-918a-d9758b289bda None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:39.432659 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825011b1-b5c2-4357-918a-d9758b289bda None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:39.434210 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 546/1086] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 15:47:39.439520 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3695d2-9219-470b-b395-c09ae1ebb782 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:39.439811 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3695d2-9219-470b-b395-c09ae1ebb782 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:39.440061 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3695d2-9219-470b-b395-c09ae1ebb782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:39.456218 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ff59c-3ee3-4c6f-b6c4-24f75f61de6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:39.456875 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ff59c-3ee3-4c6f-b6c4-24f75f61de6e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:39.457156 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ff59c-3ee3-4c6f-b6c4-24f75f61de6e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:39.457422 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ff59c-3ee3-4c6f-b6c4-24f75f61de6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:39.459443 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-0d3695d2-9219-470b-b395-c09ae1ebb782 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:39.460675 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-0d3695d2-9219-470b-b395-c09ae1ebb782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:39.515378 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:39.539761 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ff59c-3ee3-4c6f-b6c4-24f75f61de6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:39.541788 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ff59c-3ee3-4c6f-b6c4-24f75f61de6e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:39.543329 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 547/1087] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 15:47:39.609312 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:39.653380 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 541/1088] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:47:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 15:47:39.659315 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3695d2-9219-470b-b395-c09ae1ebb782 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:39.761121 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3695d2-9219-470b-b395-c09ae1ebb782 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:39.794489 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd07021-b943-4067-a205-7f9886ac5809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:39.795052 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd07021-b943-4067-a205-7f9886ac5809 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:39.795329 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd07021-b943-4067-a205-7f9886ac5809 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:39.795599 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd07021-b943-4067-a205-7f9886ac5809 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:39.805387 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd07021-b943-4067-a205-7f9886ac5809 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:39.807836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd07021-b943-4067-a205-7f9886ac5809 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:39.811021 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ff59c-3ee3-4c6f-b6c4-24f75f61de6e None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:39.823492 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-6cd07021-b943-4067-a205-7f9886ac5809 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:47:39.823492 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:39.823492 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:39.823492 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:39.823492 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:39.823492 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:39.823492 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:39.823492 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:39.823492 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:39.823492 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:39.823492 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:39.823492 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:39.823492 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:47:39.823492 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:47:39.823492 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:47:39.823492 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:47:39.824422 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:39.824422 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:39.824422 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:39.824422 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:39.824422 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:39.824422 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:39.824422 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:39.824422 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:39.824422 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:39.824422 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:39.824422 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:39.824422 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:39.824422 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:39.824422 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:39.824422 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:39.824422 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:39.824422 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:47:39.825334 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:47:39.825334 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:47:39.825334 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:39.825334 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 548/1089] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:47:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:39.830208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd07021-b943-4067-a205-7f9886ac5809 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:39.860988 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:39.911894 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ff59c-3ee3-4c6f-b6c4-24f75f61de6e None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:39.930301 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd07021-b943-4067-a205-7f9886ac5809 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:39.947801 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a01a3d-4220-4fa7-a1ff-5d5913782ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:39.948457 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a01a3d-4220-4fa7-a1ff-5d5913782ae4 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:39.948739 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a01a3d-4220-4fa7-a1ff-5d5913782ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:39.949043 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a01a3d-4220-4fa7-a1ff-5d5913782ae4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:39.958938 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a01a3d-4220-4fa7-a1ff-5d5913782ae4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:47:39.964080 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d73844-26a9-4cee-bf7a-fd36948227f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:39.964259 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-e2a01a3d-4220-4fa7-a1ff-5d5913782ae4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:47:39.964259 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:39.964259 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:39.964259 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:39.964259 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:39.964259 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:39.964259 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:39.964259 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:39.964259 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:39.964259 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:39.964259 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:39.964259 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:39.964259 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:47:39.964259 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:47:39.964259 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:47:39.964259 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:47:39.965272 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:47:39.965272 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:47:39.965272 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:47:39.965272 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:47:39.965272 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:39.965272 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:39.965272 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:39.965272 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:39.965272 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:39.965272 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:39.965272 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:39.965272 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:39.965272 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:39.965272 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:39.965272 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:39.965272 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:39.966129 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:39.966129 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:39.966129 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:39.966129 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:39.966129 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:47:39.966129 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:47:39.966129 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:47:39.966129 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:47:39.966129 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:47:39.966129 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:47:39.966129 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:47:39.966129 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:47:39.966966 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d73844-26a9-4cee-bf7a-fd36948227f2 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:39.966966 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d73844-26a9-4cee-bf7a-fd36948227f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:39.966966 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d73844-26a9-4cee-bf7a-fd36948227f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:39.967161 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 542/1090] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 30 15:47:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 15:47:39.967230 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d73844-26a9-4cee-bf7a-fd36948227f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:39.967230 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d73844-26a9-4cee-bf7a-fd36948227f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:39.967512 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d73844-26a9-4cee-bf7a-fd36948227f2 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:39.971262 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a01a3d-4220-4fa7-a1ff-5d5913782ae4 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:39.979901 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 549/1091] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:47:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:47:39.985639 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d73844-26a9-4cee-bf7a-fd36948227f2 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:39.997214 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:40.073246 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a01a3d-4220-4fa7-a1ff-5d5913782ae4 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:40.075827 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:40.086204 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d73844-26a9-4cee-bf7a-fd36948227f2 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:40.109083 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc037175-7fe3-4f20-aa37-52c1e4540647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:40.109689 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc037175-7fe3-4f20-aa37-52c1e4540647 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:40.109965 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc037175-7fe3-4f20-aa37-52c1e4540647 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:40.110234 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc037175-7fe3-4f20-aa37-52c1e4540647 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:40.110894 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc037175-7fe3-4f20-aa37-52c1e4540647 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:40.111194 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc037175-7fe3-4f20-aa37-52c1e4540647 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:40.112563 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc037175-7fe3-4f20-aa37-52c1e4540647 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:40.121759 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d68a7-4f50-4c23-a3db-4ba8cc595930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:40.122272 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 543/1092] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:47:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:47:40.122479 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d68a7-4f50-4c23-a3db-4ba8cc595930 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:40.122767 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d68a7-4f50-4c23-a3db-4ba8cc595930 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:40.123102 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d68a7-4f50-4c23-a3db-4ba8cc595930 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:40.127605 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc037175-7fe3-4f20-aa37-52c1e4540647 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:40.129958 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d68a7-4f50-4c23-a3db-4ba8cc595930 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:40.131389 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d68a7-4f50-4c23-a3db-4ba8cc595930 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:40.142988 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-709d68a7-4f50-4c23-a3db-4ba8cc595930 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:47:40.142988 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:40.142988 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:40.142988 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:40.142988 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:40.142988 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:40.142988 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:40.142988 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:40.142988 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:40.142988 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:40.142988 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:40.142988 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:40.142988 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 15:47:40.142988 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 15:47:40.142988 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 15:47:40.144061 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 15:47:40.144061 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:40.144061 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:40.144061 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:40.144061 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:40.144061 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:40.144061 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:40.144061 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:40.144061 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:40.144061 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:40.144061 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:40.144061 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:40.144061 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:40.144061 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:40.144061 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:40.144061 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:40.144061 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:40.145213 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 15:47:40.145213 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 15:47:40.145213 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 15:47:40.145213 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 15:47:40.145213 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 15:47:40.145213 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 15:47:40.145213 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:47:40.145213 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:40.148932 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 550/1093] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:47:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 15:47:40.149915 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d68a7-4f50-4c23-a3db-4ba8cc595930 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:40.210280 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:40.226357 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc037175-7fe3-4f20-aa37-52c1e4540647 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:40.248270 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d68a7-4f50-4c23-a3db-4ba8cc595930 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:40.261207 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e85808-80e3-4f43-b990-563aa3f042bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:40.261831 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e85808-80e3-4f43-b990-563aa3f042bb None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:40.262103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e85808-80e3-4f43-b990-563aa3f042bb None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:40.262369 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e85808-80e3-4f43-b990-563aa3f042bb None admin] PATH_INFO: `/v3/users/21336492420f49a6b6d562df11f1ff1f` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:40.263490 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e85808-80e3-4f43-b990-563aa3f042bb None admin] RBAC: Authorizing `identity:get_user(user_id=21336492420f49a6b6d562df11f1ff1f)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:40.264948 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e85808-80e3-4f43-b990-563aa3f042bb None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:40.266513 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 544/1094] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:47:40 2022] GET /identity/v3/users/21336492420f49a6b6d562df11f1ff1f => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:47:40.272365 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e85808-80e3-4f43-b990-563aa3f042bb None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:40.284912 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75985e25-044f-4aff-b0a8-ce7b634be973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:40.285526 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75985e25-044f-4aff-b0a8-ce7b634be973 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:40.285799 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75985e25-044f-4aff-b0a8-ce7b634be973 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:40.286065 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75985e25-044f-4aff-b0a8-ce7b634be973 None admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:40.286757 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75985e25-044f-4aff-b0a8-ce7b634be973 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:40.287058 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75985e25-044f-4aff-b0a8-ce7b634be973 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:40.288501 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75985e25-044f-4aff-b0a8-ce7b634be973 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:40.300850 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 551/1095] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 30 15:47:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:40.307521 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75985e25-044f-4aff-b0a8-ce7b634be973 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:40.318689 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:40.372809 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e85808-80e3-4f43-b990-563aa3f042bb None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:40.406716 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75985e25-044f-4aff-b0a8-ce7b634be973 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:40.407353 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f20613-5b49-4c84-b72c-394c25ce711a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:40.407990 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f20613-5b49-4c84-b72c-394c25ce711a None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:40.408276 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f20613-5b49-4c84-b72c-394c25ce711a None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:40.408551 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f20613-5b49-4c84-b72c-394c25ce711a None admin] PATH_INFO: `/v3/projects/592c069f466d408ca641f3c665c08a5d` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:40.409714 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f20613-5b49-4c84-b72c-394c25ce711a None admin] RBAC: Authorizing `identity:get_project(project_id=592c069f466d408ca641f3c665c08a5d)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:40.411161 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f20613-5b49-4c84-b72c-394c25ce711a None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:40.412972 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 545/1096] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:47:40 2022] GET /identity/v3/projects/592c069f466d408ca641f3c665c08a5d => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:47:40.419283 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f20613-5b49-4c84-b72c-394c25ce711a None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:40.440809 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:40.445925 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b41367-4dd2-4926-9595-db390b2c452c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:40.446529 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b41367-4dd2-4926-9595-db390b2c452c None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:40.447088 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b41367-4dd2-4926-9595-db390b2c452c None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:40.447277 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b41367-4dd2-4926-9595-db390b2c452c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:40.448004 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b41367-4dd2-4926-9595-db390b2c452c None admin] RBAC: Adding query filter params (role.id=341b3ebd68374dd5bb372bc283d34fd7, scope.project.id=51f312b4cd8b449aa2971993f68de9af, user.id=ebc80bf891614fb895af33ca1ded6b9d) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:40.448311 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b41367-4dd2-4926-9595-db390b2c452c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:40.449765 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b41367-4dd2-4926-9595-db390b2c452c None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:40.455570 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 552/1097] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:47:40 2022] GET /identity/v3/role_assignments?user.id=ebc80bf891614fb895af33ca1ded6b9d&scope.project.id=51f312b4cd8b449aa2971993f68de9af&role.id=341b3ebd68374dd5bb372bc283d34fd7 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:47:40.523011 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f20613-5b49-4c84-b72c-394c25ce711a None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:40.559477 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8cb2bf-8b52-41cd-9c1d-9b88b974542a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:40.560168 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cb2bf-8b52-41cd-9c1d-9b88b974542a None admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:40.560446 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cb2bf-8b52-41cd-9c1d-9b88b974542a None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:40.560717 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cb2bf-8b52-41cd-9c1d-9b88b974542a None admin] PATH_INFO: `/v3/projects/592c069f466d408ca641f3c665c08a5d/users/21336492420f49a6b6d562df11f1ff1f/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:40.562717 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8cb2bf-8b52-41cd-9c1d-9b88b974542a None admin] RBAC: Authorizing `identity:create_grant(project_id=592c069f466d408ca641f3c665c08a5d, user_id=21336492420f49a6b6d562df11f1ff1f, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:40.564192 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8cb2bf-8b52-41cd-9c1d-9b88b974542a None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:40.578264 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 546/1098] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 30 15:47:40 2022] PUT /identity/v3/projects/592c069f466d408ca641f3c665c08a5d/users/21336492420f49a6b6d562df11f1ff1f/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:47:42.471132 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982aa51e-0bb3-4964-9b36-28c3a2bc9b82 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:42.471657 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982aa51e-0bb3-4964-9b36-28c3a2bc9b82 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:42.471657 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982aa51e-0bb3-4964-9b36-28c3a2bc9b82 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:42.473031 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 553/1099] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:47:42.478159 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c192c-407b-4c9d-b663-42f7bf69d3f2 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:42.478629 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c192c-407b-4c9d-b663-42f7bf69d3f2 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:42.478734 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c192c-407b-4c9d-b663-42f7bf69d3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:42.496358 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-2d9c192c-407b-4c9d-b663-42f7bf69d3f2 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:42.497558 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-2d9c192c-407b-4c9d-b663-42f7bf69d3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:42.562040 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 547/1100] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:47:42.825835 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982aa51e-0bb3-4964-9b36-28c3a2bc9b82 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:42.898958 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:42.924485 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982aa51e-0bb3-4964-9b36-28c3a2bc9b82 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:42.959342 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf12611-b34b-415d-b6a8-86d76f8f1ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:42.959959 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf12611-b34b-415d-b6a8-86d76f8f1ca8 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:42.960233 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf12611-b34b-415d-b6a8-86d76f8f1ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:42.960498 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf12611-b34b-415d-b6a8-86d76f8f1ca8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:42.970437 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf12611-b34b-415d-b6a8-86d76f8f1ca8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:47:42.975172 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-edf12611-b34b-415d-b6a8-86d76f8f1ca8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:47:42.975172 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:47:42.975172 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:47:42.975172 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:47:42.975172 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:47:42.975172 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:47:42.975172 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:47:42.975172 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:47:42.975172 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:47:42.975172 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:47:42.975172 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:47:42.975172 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:47:42.975172 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:47:42.975172 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:47:42.975172 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:47:42.975172 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:47:42.976233 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:47:42.976233 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:47:42.976233 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:47:42.976233 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:47:42.976233 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:47:42.976233 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:47:42.976233 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:47:42.976233 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:47:42.976233 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:47:42.976233 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:47:42.976233 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:47:42.976233 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:47:42.976233 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:47:42.976233 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:47:42.976233 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:47:42.976233 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:47:42.977535 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:47:42.977535 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:47:42.977535 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:47:42.977535 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:47:42.977535 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:47:42.977535 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:47:42.977535 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:47:42.977535 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:47:42.977535 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:47:42.977535 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:47:42.977535 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:47:42.977535 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:47:42.977535 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 554/1101] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 30 15:47:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:47:42.982901 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c192c-407b-4c9d-b663-42f7bf69d3f2 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:42.994884 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:43.079513 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c192c-407b-4c9d-b663-42f7bf69d3f2 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:43.114176 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c17258-e99d-4576-9575-cdcc637b978e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:43.114786 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c17258-e99d-4576-9575-cdcc637b978e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:43.115071 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c17258-e99d-4576-9575-cdcc637b978e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:43.115344 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c17258-e99d-4576-9575-cdcc637b978e None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:43.116014 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c17258-e99d-4576-9575-cdcc637b978e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:43.116318 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c17258-e99d-4576-9575-cdcc637b978e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:43.117718 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c17258-e99d-4576-9575-cdcc637b978e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:43.126187 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 548/1102] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:47:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:43.131889 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf12611-b34b-415d-b6a8-86d76f8f1ca8 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:43.228382 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf12611-b34b-415d-b6a8-86d76f8f1ca8 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:43.260710 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7e824-a340-470a-9aa7-736481b5a958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:43.261346 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7e824-a340-470a-9aa7-736481b5a958 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:43.261622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7e824-a340-470a-9aa7-736481b5a958 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:43.261890 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7e824-a340-470a-9aa7-736481b5a958 None admin] PATH_INFO: `/v3/users/21336492420f49a6b6d562df11f1ff1f` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:43.262992 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f7e824-a340-470a-9aa7-736481b5a958 None admin] RBAC: Authorizing `identity:get_user(user_id=21336492420f49a6b6d562df11f1ff1f)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:43.264402 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f7e824-a340-470a-9aa7-736481b5a958 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:43.265961 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 555/1103] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:47:43 2022] GET /identity/v3/users/21336492420f49a6b6d562df11f1ff1f => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:43.271945 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c17258-e99d-4576-9575-cdcc637b978e None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:43.342596 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:43.372400 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c17258-e99d-4576-9575-cdcc637b978e None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:43.405475 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01901d0-fcf6-4a61-b1e9-8d654051253a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:43.406078 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01901d0-fcf6-4a61-b1e9-8d654051253a None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:43.406356 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01901d0-fcf6-4a61-b1e9-8d654051253a None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:43.406628 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01901d0-fcf6-4a61-b1e9-8d654051253a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:43.470976 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01901d0-fcf6-4a61-b1e9-8d654051253a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:43.472420 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01901d0-fcf6-4a61-b1e9-8d654051253a None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:43.537701 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:43.567762 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 549/1104] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:47:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 15:47:43.573754 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7e824-a340-470a-9aa7-736481b5a958 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:43.576633 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:43.672274 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7e824-a340-470a-9aa7-736481b5a958 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:43.704484 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee3863-219a-4e98-8f5b-9ff66fbd0d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:43.705133 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee3863-219a-4e98-8f5b-9ff66fbd0d05 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:43.705412 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee3863-219a-4e98-8f5b-9ff66fbd0d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:43.705684 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee3863-219a-4e98-8f5b-9ff66fbd0d05 None admin] PATH_INFO: `/v3/projects/592c069f466d408ca641f3c665c08a5d` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:43.706787 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee3863-219a-4e98-8f5b-9ff66fbd0d05 None admin] RBAC: Authorizing `identity:get_project(project_id=592c069f466d408ca641f3c665c08a5d)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:43.708474 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee3863-219a-4e98-8f5b-9ff66fbd0d05 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:43.710094 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 556/1105] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:47:43 2022] GET /identity/v3/projects/592c069f466d408ca641f3c665c08a5d => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:43.717254 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01901d0-fcf6-4a61-b1e9-8d654051253a None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:43.815925 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01901d0-fcf6-4a61-b1e9-8d654051253a None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:43.849522 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168203e-ae30-4108-8433-51703149c07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:43.850119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168203e-ae30-4108-8433-51703149c07f None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:43.850399 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168203e-ae30-4108-8433-51703149c07f None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:43.850670 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168203e-ae30-4108-8433-51703149c07f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:43.851390 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168203e-ae30-4108-8433-51703149c07f None admin] RBAC: Adding query filter params (role.id=676938e69210499ca11ee75dd572d0dc, scope.project.id=592c069f466d408ca641f3c665c08a5d, user.id=21336492420f49a6b6d562df11f1ff1f) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:43.851698 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168203e-ae30-4108-8433-51703149c07f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:43.853517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168203e-ae30-4108-8433-51703149c07f None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:43.859228 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 550/1106] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:47:43 2022] GET /identity/v3/role_assignments?user.id=21336492420f49a6b6d562df11f1ff1f&scope.project.id=592c069f466d408ca641f3c665c08a5d&role.id=676938e69210499ca11ee75dd572d0dc => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:45.812970 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72014fa7-de49-46b2-9ddc-11e2a092e0d5 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:45.813519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72014fa7-de49-46b2-9ddc-11e2a092e0d5 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:45.813519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72014fa7-de49-46b2-9ddc-11e2a092e0d5 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:45.814844 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 557/1107] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:47:45.819904 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b3e75-8453-4a86-9979-5663826b42af None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:45.820278 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b3e75-8453-4a86-9979-5663826b42af None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:45.820464 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b3e75-8453-4a86-9979-5663826b42af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:45.839350 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-849b3e75-8453-4a86-9979-5663826b42af None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:45.840514 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-849b3e75-8453-4a86-9979-5663826b42af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:45.868798 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:45.905955 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 551/1108] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:47:46.185115 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72014fa7-de49-46b2-9ddc-11e2a092e0d5 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:46.253654 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:46.285983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72014fa7-de49-46b2-9ddc-11e2a092e0d5 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:46.317922 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43ce0b-e27d-4ebf-bed2-e83ece30a804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:46.318544 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43ce0b-e27d-4ebf-bed2-e83ece30a804 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:46.318821 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43ce0b-e27d-4ebf-bed2-e83ece30a804 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:46.319090 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43ce0b-e27d-4ebf-bed2-e83ece30a804 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:46.320189 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43ce0b-e27d-4ebf-bed2-e83ece30a804 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:46.322349 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43ce0b-e27d-4ebf-bed2-e83ece30a804 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:46.323895 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 558/1109] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:47:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:46.329641 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b3e75-8453-4a86-9979-5663826b42af None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:46.424593 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b3e75-8453-4a86-9979-5663826b42af None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:46.457898 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b570f-10f0-41ca-bb02-96935d69203c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:46.458430 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b570f-10f0-41ca-bb02-96935d69203c None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:46.458705 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b570f-10f0-41ca-bb02-96935d69203c None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:46.458970 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b570f-10f0-41ca-bb02-96935d69203c None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:46.459609 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b570f-10f0-41ca-bb02-96935d69203c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:46.461056 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b570f-10f0-41ca-bb02-96935d69203c None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:46.481530 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 552/1110] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Aug 30 15:47:46 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:47:48.441652 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5b992-3184-41aa-b458-129d509d435a None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:48.442174 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5b992-3184-41aa-b458-129d509d435a None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:48.442174 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5b992-3184-41aa-b458-129d509d435a None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:48.443519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 559/1111] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:47:48.449471 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019b789-c473-427c-b938-600b96a7f8f5 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:48.449885 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019b789-c473-427c-b938-600b96a7f8f5 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:48.450021 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019b789-c473-427c-b938-600b96a7f8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:48.468254 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-3019b789-c473-427c-b938-600b96a7f8f5 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:48.469459 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-3019b789-c473-427c-b938-600b96a7f8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:48.485311 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:48.535827 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 553/1112] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:47:48.804925 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe5b992-3184-41aa-b458-129d509d435a None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:48.905591 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe5b992-3184-41aa-b458-129d509d435a None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:48.938380 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b29fac-ccf3-485e-b2bf-efd878958170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:48.939029 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b29fac-ccf3-485e-b2bf-efd878958170 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:48.939312 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b29fac-ccf3-485e-b2bf-efd878958170 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:48.939587 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b29fac-ccf3-485e-b2bf-efd878958170 None admin] PATH_INFO: `/v3/roles/3e70c1b76757442a9bddbeab151c6fc6` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:48.941020 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b29fac-ccf3-485e-b2bf-efd878958170 None admin] RBAC: Authorizing `identity:get_role(role_id=3e70c1b76757442a9bddbeab151c6fc6)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:48.942388 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b29fac-ccf3-485e-b2bf-efd878958170 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:48.943697 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 560/1113] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:47:48 2022] GET /identity/v3/roles/3e70c1b76757442a9bddbeab151c6fc6 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:48.950316 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3019b789-c473-427c-b938-600b96a7f8f5 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:49.045622 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3019b789-c473-427c-b938-600b96a7f8f5 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:49.077899 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec0214-7b93-46fa-bf5d-8d1c2fdacd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:49.078519 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec0214-7b93-46fa-bf5d-8d1c2fdacd61 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:49.078860 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec0214-7b93-46fa-bf5d-8d1c2fdacd61 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:49.079209 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec0214-7b93-46fa-bf5d-8d1c2fdacd61 None admin] PATH_INFO: `/v3/users/f03b8fc80012471f8dfee30d7cf5eab2` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:49.093068 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec0214-7b93-46fa-bf5d-8d1c2fdacd61 None admin] RBAC: Authorizing `identity:get_user(user_id=f03b8fc80012471f8dfee30d7cf5eab2)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:49.094523 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec0214-7b93-46fa-bf5d-8d1c2fdacd61 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:49.096147 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 554/1114] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:47:48 2022] GET /identity/v3/users/f03b8fc80012471f8dfee30d7cf5eab2 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:49.101894 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b29fac-ccf3-485e-b2bf-efd878958170 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:49.111450 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:49.202160 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b29fac-ccf3-485e-b2bf-efd878958170 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:49.234921 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58caf7-3aa6-4cd2-a32e-e9d81de6f85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:49.235526 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58caf7-3aa6-4cd2-a32e-e9d81de6f85e None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:49.235811 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58caf7-3aa6-4cd2-a32e-e9d81de6f85e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:49.236084 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58caf7-3aa6-4cd2-a32e-e9d81de6f85e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:49.301033 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d58caf7-3aa6-4cd2-a32e-e9d81de6f85e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:49.302414 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d58caf7-3aa6-4cd2-a32e-e9d81de6f85e None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:49.311054 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:49.400160 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 561/1115] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:47:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 15:47:49.406102 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec0214-7b93-46fa-bf5d-8d1c2fdacd61 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:49.418151 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:49.502437 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec0214-7b93-46fa-bf5d-8d1c2fdacd61 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:49.535357 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3a1c6-5d16-40aa-a5e8-83cd3a5c6955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:49.535972 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3a1c6-5d16-40aa-a5e8-83cd3a5c6955 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:49.536247 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3a1c6-5d16-40aa-a5e8-83cd3a5c6955 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:49.536512 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3a1c6-5d16-40aa-a5e8-83cd3a5c6955 None admin] PATH_INFO: `/v3/projects/592c069f466d408ca641f3c665c08a5d` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:49.537653 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d3a1c6-5d16-40aa-a5e8-83cd3a5c6955 None admin] RBAC: Authorizing `identity:get_project(project_id=592c069f466d408ca641f3c665c08a5d)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:49.539076 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d3a1c6-5d16-40aa-a5e8-83cd3a5c6955 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:49.540933 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 555/1116] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:47:49 2022] GET /identity/v3/projects/592c069f466d408ca641f3c665c08a5d => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:49.547123 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58caf7-3aa6-4cd2-a32e-e9d81de6f85e None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:49.645211 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58caf7-3aa6-4cd2-a32e-e9d81de6f85e None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:49.652255 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:49.678694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8acd267-673a-481b-bdfd-acad0cf89c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:49.679289 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acd267-673a-481b-bdfd-acad0cf89c67 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:49.679568 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acd267-673a-481b-bdfd-acad0cf89c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:49.679843 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acd267-673a-481b-bdfd-acad0cf89c67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:49.681099 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8acd267-673a-481b-bdfd-acad0cf89c67 None admin] RBAC: Adding query filter params (role.id=3e70c1b76757442a9bddbeab151c6fc6, scope.project.id=592c069f466d408ca641f3c665c08a5d, user.id=f03b8fc80012471f8dfee30d7cf5eab2) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:49.681407 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8acd267-673a-481b-bdfd-acad0cf89c67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:49.682902 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8acd267-673a-481b-bdfd-acad0cf89c67 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:49.688133 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 562/1117] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:47:49 2022] GET /identity/v3/role_assignments?user.id=f03b8fc80012471f8dfee30d7cf5eab2&scope.project.id=592c069f466d408ca641f3c665c08a5d&role.id=3e70c1b76757442a9bddbeab151c6fc6 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:51.561881 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08abde-e06d-4703-acae-e31bacfe3731 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:51.562482 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08abde-e06d-4703-acae-e31bacfe3731 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:51.562482 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08abde-e06d-4703-acae-e31bacfe3731 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:51.563756 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 556/1118] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:47:51.569159 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8aaee-ae95-4ee7-b2da-0ab09f1d9f44 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:51.569703 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8aaee-ae95-4ee7-b2da-0ab09f1d9f44 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:51.569703 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8aaee-ae95-4ee7-b2da-0ab09f1d9f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:51.588307 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-2ac8aaee-ae95-4ee7-b2da-0ab09f1d9f44 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:51.589526 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-2ac8aaee-ae95-4ee7-b2da-0ab09f1d9f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:51.654848 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 563/1119] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:47:51.919213 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e08abde-e06d-4703-acae-e31bacfe3731 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:51.996008 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:52.018250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e08abde-e06d-4703-acae-e31bacfe3731 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:52.051074 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac77981-4061-48f9-b302-f29e0c081c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:52.051690 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac77981-4061-48f9-b302-f29e0c081c28 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:52.051966 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac77981-4061-48f9-b302-f29e0c081c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:52.052234 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac77981-4061-48f9-b302-f29e0c081c28 None admin] PATH_INFO: `/v3/roles/3e70c1b76757442a9bddbeab151c6fc6` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:52.053627 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac77981-4061-48f9-b302-f29e0c081c28 None admin] RBAC: Authorizing `identity:get_role(role_id=3e70c1b76757442a9bddbeab151c6fc6)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:52.054993 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac77981-4061-48f9-b302-f29e0c081c28 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:52.056416 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 557/1120] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:47:51 2022] GET /identity/v3/roles/3e70c1b76757442a9bddbeab151c6fc6 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:52.062174 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8aaee-ae95-4ee7-b2da-0ab09f1d9f44 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:52.157893 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:52.160758 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8aaee-ae95-4ee7-b2da-0ab09f1d9f44 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:52.194458 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be46f1-f96a-4bfd-a9b8-814a5df381c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:52.195015 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be46f1-f96a-4bfd-a9b8-814a5df381c0 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:52.195290 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be46f1-f96a-4bfd-a9b8-814a5df381c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:52.195557 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be46f1-f96a-4bfd-a9b8-814a5df381c0 None admin] PATH_INFO: `/v3/users/f03b8fc80012471f8dfee30d7cf5eab2` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:52.197414 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be46f1-f96a-4bfd-a9b8-814a5df381c0 None admin] RBAC: Authorizing `identity:get_user(user_id=f03b8fc80012471f8dfee30d7cf5eab2)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:52.198895 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be46f1-f96a-4bfd-a9b8-814a5df381c0 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:52.200430 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 564/1121] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:47:52 2022] GET /identity/v3/users/f03b8fc80012471f8dfee30d7cf5eab2 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:52.206100 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac77981-4061-48f9-b302-f29e0c081c28 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:52.303672 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac77981-4061-48f9-b302-f29e0c081c28 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:52.336964 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df6fb5-6b66-47c7-ac64-766c4e7e09fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:52.337746 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df6fb5-6b66-47c7-ac64-766c4e7e09fb None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:52.338026 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df6fb5-6b66-47c7-ac64-766c4e7e09fb None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:52.338302 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df6fb5-6b66-47c7-ac64-766c4e7e09fb None admin] PATH_INFO: `/v3/projects/592c069f466d408ca641f3c665c08a5d` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:52.339415 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df6fb5-6b66-47c7-ac64-766c4e7e09fb None admin] RBAC: Authorizing `identity:get_project(project_id=592c069f466d408ca641f3c665c08a5d)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:52.340870 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df6fb5-6b66-47c7-ac64-766c4e7e09fb None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:52.342485 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 558/1122] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:47:52 2022] GET /identity/v3/projects/592c069f466d408ca641f3c665c08a5d => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:52.348451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be46f1-f96a-4bfd-a9b8-814a5df381c0 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:52.448153 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be46f1-f96a-4bfd-a9b8-814a5df381c0 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:52.479922 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd893e-0a74-42fa-ac40-1d139d5b002f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:52.480562 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd893e-0a74-42fa-ac40-1d139d5b002f None admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:52.480865 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd893e-0a74-42fa-ac40-1d139d5b002f None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:52.481140 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd893e-0a74-42fa-ac40-1d139d5b002f None admin] PATH_INFO: `/v3/projects/592c069f466d408ca641f3c665c08a5d/users/f03b8fc80012471f8dfee30d7cf5eab2/roles/3e70c1b76757442a9bddbeab151c6fc6` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:52.483235 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd893e-0a74-42fa-ac40-1d139d5b002f None admin] RBAC: Authorizing `identity:create_grant(project_id=592c069f466d408ca641f3c665c08a5d, user_id=f03b8fc80012471f8dfee30d7cf5eab2, role_id=3e70c1b76757442a9bddbeab151c6fc6)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:52.484646 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd893e-0a74-42fa-ac40-1d139d5b002f None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:52.497414 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 565/1123] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 30 15:47:52 2022] PUT /identity/v3/projects/592c069f466d408ca641f3c665c08a5d/users/f03b8fc80012471f8dfee30d7cf5eab2/roles/3e70c1b76757442a9bddbeab151c6fc6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:47:54.358842 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993de9c-9827-4f63-b613-79ad67419cbb None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:54.359393 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993de9c-9827-4f63-b613-79ad67419cbb None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:54.359393 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993de9c-9827-4f63-b613-79ad67419cbb None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:54.360739 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 559/1124] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:47:54.365739 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b1488-9a0e-4bab-9166-6f4997dcef69 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:54.366125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b1488-9a0e-4bab-9166-6f4997dcef69 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:54.366285 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b1488-9a0e-4bab-9166-6f4997dcef69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:54.384492 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-440b1488-9a0e-4bab-9166-6f4997dcef69 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:54.385693 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-440b1488-9a0e-4bab-9166-6f4997dcef69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:54.407382 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:54.451233 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 566/1125] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:47:54.719858 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993de9c-9827-4f63-b613-79ad67419cbb None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:54.735994 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:54.820687 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993de9c-9827-4f63-b613-79ad67419cbb None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:54.854571 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab24a3-bcad-4c3c-83f6-15969c76ac7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:54.855196 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab24a3-bcad-4c3c-83f6-15969c76ac7d None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:54.855477 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab24a3-bcad-4c3c-83f6-15969c76ac7d None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:54.855751 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab24a3-bcad-4c3c-83f6-15969c76ac7d None admin] PATH_INFO: `/v3/roles/3e70c1b76757442a9bddbeab151c6fc6` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:54.857171 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab24a3-bcad-4c3c-83f6-15969c76ac7d None admin] RBAC: Authorizing `identity:get_role(role_id=3e70c1b76757442a9bddbeab151c6fc6)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:54.858575 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab24a3-bcad-4c3c-83f6-15969c76ac7d None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:54.859892 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 560/1126] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:47:54 2022] GET /identity/v3/roles/3e70c1b76757442a9bddbeab151c6fc6 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:54.865612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b1488-9a0e-4bab-9166-6f4997dcef69 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:54.963448 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b1488-9a0e-4bab-9166-6f4997dcef69 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:54.996279 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6eb69-461d-4aff-aa77-3369001883bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:54.996872 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6eb69-461d-4aff-aa77-3369001883bc None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:54.997149 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6eb69-461d-4aff-aa77-3369001883bc None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:54.997416 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6eb69-461d-4aff-aa77-3369001883bc None admin] PATH_INFO: `/v3/users/f03b8fc80012471f8dfee30d7cf5eab2` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:54.998522 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6eb69-461d-4aff-aa77-3369001883bc None admin] RBAC: Authorizing `identity:get_user(user_id=f03b8fc80012471f8dfee30d7cf5eab2)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:54.999940 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6eb69-461d-4aff-aa77-3369001883bc None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:55.001537 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 567/1127] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:47:54 2022] GET /identity/v3/users/f03b8fc80012471f8dfee30d7cf5eab2 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:55.007286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab24a3-bcad-4c3c-83f6-15969c76ac7d None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:55.087282 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:55.105110 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab24a3-bcad-4c3c-83f6-15969c76ac7d None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:55.138599 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65ef15-d923-49b8-bcc5-d98240c18c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:55.139200 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65ef15-d923-49b8-bcc5-d98240c18c35 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:55.139473 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65ef15-d923-49b8-bcc5-d98240c18c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:55.139739 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65ef15-d923-49b8-bcc5-d98240c18c35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:55.203458 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad65ef15-d923-49b8-bcc5-d98240c18c35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:55.204964 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad65ef15-d923-49b8-bcc5-d98240c18c35 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:55.281775 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:55.300089 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 561/1128] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:47:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 15:47:55.306565 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6eb69-461d-4aff-aa77-3369001883bc None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:55.333176 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:55.403557 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6eb69-461d-4aff-aa77-3369001883bc None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:55.436538 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5993ad1f-e5d5-4a56-ac8a-badc88bc3c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:55.437199 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993ad1f-e5d5-4a56-ac8a-badc88bc3c38 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:55.437481 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993ad1f-e5d5-4a56-ac8a-badc88bc3c38 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:55.437755 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993ad1f-e5d5-4a56-ac8a-badc88bc3c38 None admin] PATH_INFO: `/v3/projects/592c069f466d408ca641f3c665c08a5d` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:55.438872 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5993ad1f-e5d5-4a56-ac8a-badc88bc3c38 None admin] RBAC: Authorizing `identity:get_project(project_id=592c069f466d408ca641f3c665c08a5d)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:55.440288 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5993ad1f-e5d5-4a56-ac8a-badc88bc3c38 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:55.441913 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 568/1129] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:47:55 2022] GET /identity/v3/projects/592c069f466d408ca641f3c665c08a5d => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:55.448616 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65ef15-d923-49b8-bcc5-d98240c18c35 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:55.544225 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65ef15-d923-49b8-bcc5-d98240c18c35 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:55.576894 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1077c9b-1a5c-4631-a55d-78d26fa2fc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:55.577485 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1077c9b-1a5c-4631-a55d-78d26fa2fc31 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:55.577758 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1077c9b-1a5c-4631-a55d-78d26fa2fc31 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:55.578026 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1077c9b-1a5c-4631-a55d-78d26fa2fc31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:55.578741 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1077c9b-1a5c-4631-a55d-78d26fa2fc31 None admin] RBAC: Adding query filter params (role.id=3e70c1b76757442a9bddbeab151c6fc6, scope.project.id=592c069f466d408ca641f3c665c08a5d, user.id=f03b8fc80012471f8dfee30d7cf5eab2) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:47:55.579041 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1077c9b-1a5c-4631-a55d-78d26fa2fc31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:55.580497 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1077c9b-1a5c-4631-a55d-78d26fa2fc31 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:55.586001 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 562/1130] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:47:55 2022] GET /identity/v3/role_assignments?user.id=f03b8fc80012471f8dfee30d7cf5eab2&scope.project.id=592c069f466d408ca641f3c665c08a5d&role.id=3e70c1b76757442a9bddbeab151c6fc6 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:57.495845 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee9b9b-7228-4fe5-a599-27b42fc247db None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:57.496366 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee9b9b-7228-4fe5-a599-27b42fc247db None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:57.496366 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee9b9b-7228-4fe5-a599-27b42fc247db None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:57.497752 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 569/1131] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:47:57.502768 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fd95a-e76e-4626-b191-1aaac8ec980e None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:57.503188 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fd95a-e76e-4626-b191-1aaac8ec980e None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:57.503311 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fd95a-e76e-4626-b191-1aaac8ec980e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:57.521728 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-a38fd95a-e76e-4626-b191-1aaac8ec980e None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:47:57.523254 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-a38fd95a-e76e-4626-b191-1aaac8ec980e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:47:57.564387 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:57.589501 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 563/1132] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:47:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:47:57.870530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee9b9b-7228-4fe5-a599-27b42fc247db None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:57.965237 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:47:57.973063 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee9b9b-7228-4fe5-a599-27b42fc247db None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:58.007451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92719652-429d-4cff-91d7-b0cd444b0e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:58.008069 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92719652-429d-4cff-91d7-b0cd444b0e4a None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:58.008841 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92719652-429d-4cff-91d7-b0cd444b0e4a None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:58.009122 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92719652-429d-4cff-91d7-b0cd444b0e4a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:58.010239 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92719652-429d-4cff-91d7-b0cd444b0e4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:58.011660 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92719652-429d-4cff-91d7-b0cd444b0e4a None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:58.013229 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 570/1133] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:47:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:47:58.019260 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38fd95a-e76e-4626-b191-1aaac8ec980e None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:47:58.114602 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38fd95a-e76e-4626-b191-1aaac8ec980e None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:47:58.147677 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe144830-b703-4c8a-aead-ff9a8c1f8996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:47:58.148220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe144830-b703-4c8a-aead-ff9a8c1f8996 None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:47:58.148495 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe144830-b703-4c8a-aead-ff9a8c1f8996 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:47:58.149036 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe144830-b703-4c8a-aead-ff9a8c1f8996 None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:47:58.149704 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe144830-b703-4c8a-aead-ff9a8c1f8996 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:47:58.151125 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe144830-b703-4c8a-aead-ff9a8c1f8996 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:47:58.177798 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 564/1134] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Aug 30 15:47:58 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:48:00.090332 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef447df7-71e3-44e7-a151-1505bd14aa8f None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:00.090847 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef447df7-71e3-44e7-a151-1505bd14aa8f None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:00.090959 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef447df7-71e3-44e7-a151-1505bd14aa8f None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:00.092208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 571/1135] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:48:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:48:00.097373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423d9bb-4237-4c26-a7dd-00fbc77eec89 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:00.097799 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423d9bb-4237-4c26-a7dd-00fbc77eec89 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:00.097931 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423d9bb-4237-4c26-a7dd-00fbc77eec89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:00.116249 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-e423d9bb-4237-4c26-a7dd-00fbc77eec89 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:48:00.117487 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-e423d9bb-4237-4c26-a7dd-00fbc77eec89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:48:00.139547 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:48:00.184048 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 565/1136] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:48:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:48:00.453168 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef447df7-71e3-44e7-a151-1505bd14aa8f None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:48:00.550168 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef447df7-71e3-44e7-a151-1505bd14aa8f None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:48:00.583564 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13a9d6-43c5-49a9-8c92-b1cc8e08d579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:48:00.584199 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13a9d6-43c5-49a9-8c92-b1cc8e08d579 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:00.584520 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13a9d6-43c5-49a9-8c92-b1cc8e08d579 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:00.585013 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13a9d6-43c5-49a9-8c92-b1cc8e08d579 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:00.586968 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d13a9d6-43c5-49a9-8c92-b1cc8e08d579 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:48:00.589574 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d13a9d6-43c5-49a9-8c92-b1cc8e08d579 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:48:00.592194 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 572/1137] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:48:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:48:00.598042 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423d9bb-4237-4c26-a7dd-00fbc77eec89 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:48:00.693834 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423d9bb-4237-4c26-a7dd-00fbc77eec89 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:48:00.727622 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99610d6f-1edb-4090-b614-bd66fbca5d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:48:00.728230 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99610d6f-1edb-4090-b614-bd66fbca5d9e None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:00.728509 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99610d6f-1edb-4090-b614-bd66fbca5d9e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:00.728795 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99610d6f-1edb-4090-b614-bd66fbca5d9e None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:00.729466 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99610d6f-1edb-4090-b614-bd66fbca5d9e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:48:00.730919 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99610d6f-1edb-4090-b614-bd66fbca5d9e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:48:00.751682 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 566/1138] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Aug 30 15:48:00 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:48:02.671831 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3d9c4-2d5a-4821-95a6-06a8013262c1 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:02.672422 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3d9c4-2d5a-4821-95a6-06a8013262c1 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:02.672422 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3d9c4-2d5a-4821-95a6-06a8013262c1 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:02.673747 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 573/1139] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:48:02.678960 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac4d50-6af7-49dd-9bdd-f8e314461205 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:02.679374 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac4d50-6af7-49dd-9bdd-f8e314461205 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:02.679518 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac4d50-6af7-49dd-9bdd-f8e314461205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:02.697852 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-edac4d50-6af7-49dd-9bdd-f8e314461205 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:48:02.699318 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-edac4d50-6af7-49dd-9bdd-f8e314461205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:48:02.708369 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:48:02.767276 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 567/1140] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:48:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:48:03.036826 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3d9c4-2d5a-4821-95a6-06a8013262c1 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:48:03.067412 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:48:03.137931 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3d9c4-2d5a-4821-95a6-06a8013262c1 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:48:03.170474 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31317695-5acc-4587-8560-9e6e31fd3e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:48:03.171095 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31317695-5acc-4587-8560-9e6e31fd3e2e None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:03.171375 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31317695-5acc-4587-8560-9e6e31fd3e2e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:03.171646 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31317695-5acc-4587-8560-9e6e31fd3e2e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:03.182071 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31317695-5acc-4587-8560-9e6e31fd3e2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:48:03.186838 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-31317695-5acc-4587-8560-9e6e31fd3e2e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:48:03.186838 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:48:03.186838 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:48:03.186838 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:48:03.186838 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:48:03.186838 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:48:03.186838 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:48:03.186838 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:48:03.186838 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:48:03.186838 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:48:03.186838 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:48:03.186838 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:48:03.186838 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:48:03.186838 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:48:03.186838 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:48:03.186838 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:48:03.187981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:48:03.187981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:48:03.187981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:48:03.187981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:48:03.187981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:48:03.187981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:48:03.187981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:48:03.187981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:48:03.187981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:48:03.187981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:48:03.187981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:48:03.187981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:48:03.187981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:48:03.187981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:48:03.187981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:48:03.187981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:48:03.189091 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:48:03.189091 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:48:03.189091 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:48:03.189091 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:48:03.189091 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:48:03.189091 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:48:03.189091 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:48:03.189091 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:48:03.189091 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:48:03.189091 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:48:03.189091 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:48:03.189091 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:48:03.189091 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 574/1141] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 30 15:48:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:48:03.193945 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac4d50-6af7-49dd-9bdd-f8e314461205 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:48:03.292240 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac4d50-6af7-49dd-9bdd-f8e314461205 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:48:03.325129 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156faa4b-4bcc-4321-ada9-71a578933b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:48:03.325733 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156faa4b-4bcc-4321-ada9-71a578933b0c None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:03.326009 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156faa4b-4bcc-4321-ada9-71a578933b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:03.326274 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156faa4b-4bcc-4321-ada9-71a578933b0c None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:03.326932 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156faa4b-4bcc-4321-ada9-71a578933b0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:48:03.327228 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156faa4b-4bcc-4321-ada9-71a578933b0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:48:03.328584 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156faa4b-4bcc-4321-ada9-71a578933b0c None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:48:03.336354 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 568/1142] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:48:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:48:03.342160 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31317695-5acc-4587-8560-9e6e31fd3e2e None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:48:03.429599 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:48:03.439905 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31317695-5acc-4587-8560-9e6e31fd3e2e None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:48:03.472504 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482fdbbc-0200-4f9e-8dba-62f6f8afde09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:48:03.473146 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482fdbbc-0200-4f9e-8dba-62f6f8afde09 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:03.473420 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482fdbbc-0200-4f9e-8dba-62f6f8afde09 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:03.473683 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482fdbbc-0200-4f9e-8dba-62f6f8afde09 None admin] PATH_INFO: `/v3/users/118b05221ec04207944e6defb23062db` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:03.486694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482fdbbc-0200-4f9e-8dba-62f6f8afde09 None admin] RBAC: Authorizing `identity:get_user(user_id=118b05221ec04207944e6defb23062db)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:48:03.488111 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482fdbbc-0200-4f9e-8dba-62f6f8afde09 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:48:03.489678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 575/1143] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:48:03 2022] GET /identity/v3/users/118b05221ec04207944e6defb23062db => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:48:03.496635 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156faa4b-4bcc-4321-ada9-71a578933b0c None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:48:03.505757 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:48:03.595075 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156faa4b-4bcc-4321-ada9-71a578933b0c None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:48:03.627692 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46d862-e12d-4d0f-9335-9a8e757607ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:48:03.628287 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46d862-e12d-4d0f-9335-9a8e757607ce None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:03.628564 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46d862-e12d-4d0f-9335-9a8e757607ce None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:03.628857 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46d862-e12d-4d0f-9335-9a8e757607ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:03.694950 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d46d862-e12d-4d0f-9335-9a8e757607ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:48:03.696881 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d46d862-e12d-4d0f-9335-9a8e757607ce None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:48:03.704164 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:48:03.795361 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 569/1144] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:48:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 15:48:03.801325 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482fdbbc-0200-4f9e-8dba-62f6f8afde09 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:48:03.895962 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482fdbbc-0200-4f9e-8dba-62f6f8afde09 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:48:03.929287 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813e314-4cd7-4e99-911e-a81dbbb34bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:48:03.930014 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813e314-4cd7-4e99-911e-a81dbbb34bb1 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:03.930363 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813e314-4cd7-4e99-911e-a81dbbb34bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:03.930641 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813e314-4cd7-4e99-911e-a81dbbb34bb1 None admin] PATH_INFO: `/v3/projects/e0b111a0d60b44dcb6ebe19b7cc25ee9` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:03.931737 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c813e314-4cd7-4e99-911e-a81dbbb34bb1 None admin] RBAC: Authorizing `identity:get_project(project_id=e0b111a0d60b44dcb6ebe19b7cc25ee9)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:48:03.933181 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c813e314-4cd7-4e99-911e-a81dbbb34bb1 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:48:03.934741 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 576/1145] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:48:03 2022] GET /identity/v3/projects/e0b111a0d60b44dcb6ebe19b7cc25ee9 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:48:03.940759 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46d862-e12d-4d0f-9335-9a8e757607ce None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:48:04.038029 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46d862-e12d-4d0f-9335-9a8e757607ce None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:48:04.045951 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:48:04.073349 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754fbf6a-db6d-4b7e-9da3-d910af59d18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:48:04.073947 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fbf6a-db6d-4b7e-9da3-d910af59d18c None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:04.074222 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fbf6a-db6d-4b7e-9da3-d910af59d18c None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:04.074490 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fbf6a-db6d-4b7e-9da3-d910af59d18c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:04.075212 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754fbf6a-db6d-4b7e-9da3-d910af59d18c None admin] RBAC: Adding query filter params (role.id=676938e69210499ca11ee75dd572d0dc, scope.project.id=e0b111a0d60b44dcb6ebe19b7cc25ee9, user.id=118b05221ec04207944e6defb23062db) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:48:04.075514 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754fbf6a-db6d-4b7e-9da3-d910af59d18c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:48:04.076959 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754fbf6a-db6d-4b7e-9da3-d910af59d18c None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:48:04.082110 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 570/1146] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:48:03 2022] GET /identity/v3/role_assignments?user.id=118b05221ec04207944e6defb23062db&scope.project.id=e0b111a0d60b44dcb6ebe19b7cc25ee9&role.id=676938e69210499ca11ee75dd572d0dc => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:48:05.946688 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8756ad0-4d7e-48a7-9720-ddbfb2501fa9 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:05.947197 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8756ad0-4d7e-48a7-9720-ddbfb2501fa9 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:05.947323 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8756ad0-4d7e-48a7-9720-ddbfb2501fa9 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:05.948557 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 577/1147] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:48:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:48:05.953734 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7282582-2d28-4751-baa1-2deae1b5707f None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:05.954146 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7282582-2d28-4751-baa1-2deae1b5707f None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:05.954286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7282582-2d28-4751-baa1-2deae1b5707f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:05.972493 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-e7282582-2d28-4751-baa1-2deae1b5707f None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:48:05.973792 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-e7282582-2d28-4751-baa1-2deae1b5707f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:48:06.039607 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 571/1148] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:48:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:48:06.306288 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8756ad0-4d7e-48a7-9720-ddbfb2501fa9 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:48:06.324323 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:48:06.405434 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8756ad0-4d7e-48a7-9720-ddbfb2501fa9 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:48:06.437365 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef3635-8406-42ee-879e-8751900ad39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:48:06.437980 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef3635-8406-42ee-879e-8751900ad39f None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:06.438259 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef3635-8406-42ee-879e-8751900ad39f None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:06.438528 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef3635-8406-42ee-879e-8751900ad39f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:06.448617 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef3635-8406-42ee-879e-8751900ad39f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:48:06.453306 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-5bef3635-8406-42ee-879e-8751900ad39f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:48:06.453306 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:48:06.453306 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:48:06.453306 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:48:06.453306 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:48:06.453306 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:48:06.453306 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:48:06.453306 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:48:06.453306 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:48:06.453306 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:48:06.453306 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:48:06.453306 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:48:06.453306 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:48:06.453306 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:48:06.453306 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:48:06.453306 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:48:06.454370 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:48:06.454370 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:48:06.454370 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:48:06.454370 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:48:06.454370 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:48:06.454370 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:48:06.454370 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:48:06.454370 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:48:06.454370 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:48:06.454370 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:48:06.454370 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:48:06.454370 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:48:06.454370 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:48:06.454370 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:48:06.454370 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:48:06.454370 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:48:06.455619 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:48:06.455619 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:48:06.455619 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:48:06.455619 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:48:06.455619 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:48:06.455619 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:48:06.455619 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:48:06.455619 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:48:06.455619 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:48:06.455619 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:48:06.455619 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:48:06.455619 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:48:06.455619 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 578/1149] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 30 15:48:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:48:06.460344 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7282582-2d28-4751-baa1-2deae1b5707f None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:48:06.554325 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:48:06.557906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7282582-2d28-4751-baa1-2deae1b5707f None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:48:06.590918 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f22e94-468c-468d-b6cf-a624bdd7544e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:48:06.591523 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f22e94-468c-468d-b6cf-a624bdd7544e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:06.591803 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f22e94-468c-468d-b6cf-a624bdd7544e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:06.592076 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f22e94-468c-468d-b6cf-a624bdd7544e None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:06.592742 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f22e94-468c-468d-b6cf-a624bdd7544e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:48:06.593081 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f22e94-468c-468d-b6cf-a624bdd7544e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:48:06.594452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f22e94-468c-468d-b6cf-a624bdd7544e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:48:06.602318 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 572/1150] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:48:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:48:06.608021 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef3635-8406-42ee-879e-8751900ad39f None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:48:06.683446 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:48:06.705975 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef3635-8406-42ee-879e-8751900ad39f None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:48:06.738905 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685cbf0-c8e8-498e-8281-1ec89a5b6d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:48:06.739531 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685cbf0-c8e8-498e-8281-1ec89a5b6d66 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:06.739804 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685cbf0-c8e8-498e-8281-1ec89a5b6d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:06.740068 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685cbf0-c8e8-498e-8281-1ec89a5b6d66 None admin] PATH_INFO: `/v3/users/118b05221ec04207944e6defb23062db` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:06.741201 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685cbf0-c8e8-498e-8281-1ec89a5b6d66 None admin] RBAC: Authorizing `identity:get_user(user_id=118b05221ec04207944e6defb23062db)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:48:06.743268 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685cbf0-c8e8-498e-8281-1ec89a5b6d66 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:48:06.744818 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 579/1151] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:48:06 2022] GET /identity/v3/users/118b05221ec04207944e6defb23062db => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:48:06.750594 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f22e94-468c-468d-b6cf-a624bdd7544e None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:48:06.848349 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f22e94-468c-468d-b6cf-a624bdd7544e None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:48:06.881211 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f80c23-7cbb-46b1-b869-7ca7b7b9643f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:48:06.881824 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f80c23-7cbb-46b1-b869-7ca7b7b9643f None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:06.882102 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f80c23-7cbb-46b1-b869-7ca7b7b9643f None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:06.882372 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f80c23-7cbb-46b1-b869-7ca7b7b9643f None admin] PATH_INFO: `/v3/projects/e0b111a0d60b44dcb6ebe19b7cc25ee9` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:06.884287 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f80c23-7cbb-46b1-b869-7ca7b7b9643f None admin] RBAC: Authorizing `identity:get_project(project_id=e0b111a0d60b44dcb6ebe19b7cc25ee9)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:48:06.885745 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f80c23-7cbb-46b1-b869-7ca7b7b9643f None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:48:06.887342 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 573/1152] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:48:06 2022] GET /identity/v3/projects/e0b111a0d60b44dcb6ebe19b7cc25ee9 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:48:06.893408 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685cbf0-c8e8-498e-8281-1ec89a5b6d66 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:48:06.990221 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685cbf0-c8e8-498e-8281-1ec89a5b6d66 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:48:07.022826 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12760b1-936d-4187-a3d6-0594aa680540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:48:07.023495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12760b1-936d-4187-a3d6-0594aa680540 None admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:07.023770 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12760b1-936d-4187-a3d6-0594aa680540 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:07.024039 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12760b1-936d-4187-a3d6-0594aa680540 None admin] PATH_INFO: `/v3/projects/e0b111a0d60b44dcb6ebe19b7cc25ee9/users/118b05221ec04207944e6defb23062db/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:07.025931 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12760b1-936d-4187-a3d6-0594aa680540 None admin] RBAC: Authorizing `identity:create_grant(project_id=e0b111a0d60b44dcb6ebe19b7cc25ee9, user_id=118b05221ec04207944e6defb23062db, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:48:07.027351 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12760b1-936d-4187-a3d6-0594aa680540 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:48:07.040719 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 580/1153] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 30 15:48:06 2022] PUT /identity/v3/projects/e0b111a0d60b44dcb6ebe19b7cc25ee9/users/118b05221ec04207944e6defb23062db/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:48:08.947078 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d59c1c-66e0-46a2-b50d-f41eb74ad3ca None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:08.947669 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d59c1c-66e0-46a2-b50d-f41eb74ad3ca None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:08.947669 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d59c1c-66e0-46a2-b50d-f41eb74ad3ca None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:08.948996 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 574/1154] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:48:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:48:08.954292 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41af3e1-b8eb-425b-9fff-e36fd068bde2 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:08.954715 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41af3e1-b8eb-425b-9fff-e36fd068bde2 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:08.954843 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41af3e1-b8eb-425b-9fff-e36fd068bde2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:08.962973 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:48:08.975475 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-f41af3e1-b8eb-425b-9fff-e36fd068bde2 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:48:08.977720 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-f41af3e1-b8eb-425b-9fff-e36fd068bde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:48:09.042936 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 581/1155] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:48:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 15:48:09.311173 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d59c1c-66e0-46a2-b50d-f41eb74ad3ca None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:48:09.342467 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:48:09.410803 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d59c1c-66e0-46a2-b50d-f41eb74ad3ca None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:48:09.442142 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d112658-806d-47f2-8a51-98826c2b09cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:48:09.442785 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d112658-806d-47f2-8a51-98826c2b09cc None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:09.443053 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d112658-806d-47f2-8a51-98826c2b09cc None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:09.443321 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d112658-806d-47f2-8a51-98826c2b09cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:09.453858 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d112658-806d-47f2-8a51-98826c2b09cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:48:09.458573 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-1d112658-806d-47f2-8a51-98826c2b09cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:48:09.458573 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:48:09.458573 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:48:09.458573 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:48:09.458573 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:48:09.458573 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:48:09.458573 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:48:09.458573 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:48:09.458573 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:48:09.458573 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:48:09.458573 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:48:09.458573 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:48:09.458573 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:48:09.458573 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:48:09.458573 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:48:09.458573 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:48:09.459766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:48:09.459766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:48:09.459766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:48:09.459766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:48:09.459766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:48:09.459766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:48:09.459766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:48:09.459766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:48:09.459766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:48:09.459766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:48:09.459766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:48:09.459766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:48:09.459766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:48:09.459766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:48:09.459766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:48:09.459766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:48:09.461394 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:48:09.461394 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:48:09.461394 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:48:09.461394 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:48:09.461394 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:48:09.461394 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:48:09.461394 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:48:09.461394 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:48:09.461394 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:48:09.461394 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:48:09.461394 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:48:09.461394 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:48:09.461394 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 575/1156] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 30 15:48:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:48:09.466151 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41af3e1-b8eb-425b-9fff-e36fd068bde2 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:48:09.562463 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41af3e1-b8eb-425b-9fff-e36fd068bde2 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:48:09.595481 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897a3e2-9e60-42fa-9100-951e3bdcd920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:48:09.596076 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897a3e2-9e60-42fa-9100-951e3bdcd920 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:09.596355 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897a3e2-9e60-42fa-9100-951e3bdcd920 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:09.596622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897a3e2-9e60-42fa-9100-951e3bdcd920 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:09.597311 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897a3e2-9e60-42fa-9100-951e3bdcd920 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:48:09.597610 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897a3e2-9e60-42fa-9100-951e3bdcd920 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:48:09.598959 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897a3e2-9e60-42fa-9100-951e3bdcd920 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:48:09.600250 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:48:09.607728 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 582/1157] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:48:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:48:09.613449 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d112658-806d-47f2-8a51-98826c2b09cc None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:48:09.703518 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:48:09.713625 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d112658-806d-47f2-8a51-98826c2b09cc None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:48:09.747271 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce47281-09b9-4e4c-82cb-2a9133a1d77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:48:09.747899 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce47281-09b9-4e4c-82cb-2a9133a1d77b None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:09.748178 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce47281-09b9-4e4c-82cb-2a9133a1d77b None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:09.748450 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce47281-09b9-4e4c-82cb-2a9133a1d77b None admin] PATH_INFO: `/v3/users/118b05221ec04207944e6defb23062db` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:09.749608 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce47281-09b9-4e4c-82cb-2a9133a1d77b None admin] RBAC: Authorizing `identity:get_user(user_id=118b05221ec04207944e6defb23062db)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:48:09.751036 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce47281-09b9-4e4c-82cb-2a9133a1d77b None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:48:09.752603 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 576/1158] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:48:09 2022] GET /identity/v3/users/118b05221ec04207944e6defb23062db => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:48:09.759035 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897a3e2-9e60-42fa-9100-951e3bdcd920 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:48:09.857951 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897a3e2-9e60-42fa-9100-951e3bdcd920 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:48:09.890331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5dd48-6cfe-4434-8ede-c64df0473d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:48:09.890934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5dd48-6cfe-4434-8ede-c64df0473d2e None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:09.891469 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5dd48-6cfe-4434-8ede-c64df0473d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:09.891742 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5dd48-6cfe-4434-8ede-c64df0473d2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:09.951609 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:48:09.958398 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd5dd48-6cfe-4434-8ede-c64df0473d2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:48:09.959842 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd5dd48-6cfe-4434-8ede-c64df0473d2e None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:48:10.054755 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 583/1159] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:48:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 15:48:10.060638 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce47281-09b9-4e4c-82cb-2a9133a1d77b None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:48:10.159274 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce47281-09b9-4e4c-82cb-2a9133a1d77b None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:48:10.190805 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f59308-a65a-4254-90d4-352c2915b683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:48:10.191422 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f59308-a65a-4254-90d4-352c2915b683 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:10.191700 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f59308-a65a-4254-90d4-352c2915b683 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:10.191972 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f59308-a65a-4254-90d4-352c2915b683 None admin] PATH_INFO: `/v3/projects/e0b111a0d60b44dcb6ebe19b7cc25ee9` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:10.193098 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f59308-a65a-4254-90d4-352c2915b683 None admin] RBAC: Authorizing `identity:get_project(project_id=e0b111a0d60b44dcb6ebe19b7cc25ee9)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:48:10.194533 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f59308-a65a-4254-90d4-352c2915b683 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:48:10.196659 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 577/1160] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:48:10 2022] GET /identity/v3/projects/e0b111a0d60b44dcb6ebe19b7cc25ee9 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:48:10.202624 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5dd48-6cfe-4434-8ede-c64df0473d2e None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:48:10.293191 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:48:10.299045 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5dd48-6cfe-4434-8ede-c64df0473d2e None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:48:10.331988 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd65626-8a71-4459-af0b-c322011f4468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:48:10.332579 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd65626-8a71-4459-af0b-c322011f4468 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:10.332881 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd65626-8a71-4459-af0b-c322011f4468 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:10.333157 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd65626-8a71-4459-af0b-c322011f4468 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:10.333871 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd65626-8a71-4459-af0b-c322011f4468 None admin] RBAC: Adding query filter params (role.id=676938e69210499ca11ee75dd572d0dc, scope.project.id=e0b111a0d60b44dcb6ebe19b7cc25ee9, user.id=118b05221ec04207944e6defb23062db) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:48:10.334169 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd65626-8a71-4459-af0b-c322011f4468 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:48:10.335623 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd65626-8a71-4459-af0b-c322011f4468 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:48:10.341321 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 584/1161] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:48:10 2022] GET /identity/v3/role_assignments?user.id=118b05221ec04207944e6defb23062db&scope.project.id=e0b111a0d60b44dcb6ebe19b7cc25ee9&role.id=676938e69210499ca11ee75dd572d0dc => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:48:12.247108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c7466-5cf2-4fb8-afd1-1bf20bce0c0f None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:12.247691 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c7466-5cf2-4fb8-afd1-1bf20bce0c0f None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:12.247691 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c7466-5cf2-4fb8-afd1-1bf20bce0c0f None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:12.249034 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 578/1162] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:48:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:48:12.254160 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cab49-b7c4-4eda-ac83-35cf0aeb0f81 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:12.254599 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cab49-b7c4-4eda-ac83-35cf0aeb0f81 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:12.254698 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cab49-b7c4-4eda-ac83-35cf0aeb0f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:12.272806 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-591cab49-b7c4-4eda-ac83-35cf0aeb0f81 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:48:12.274000 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-591cab49-b7c4-4eda-ac83-35cf0aeb0f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:48:12.338662 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 585/1163] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:48:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:48:12.602720 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c7466-5cf2-4fb8-afd1-1bf20bce0c0f None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:48:12.629991 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:48:12.705219 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c7466-5cf2-4fb8-afd1-1bf20bce0c0f None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:48:12.738676 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46df84-dcf4-43dc-bd64-dbe282c86453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:48:12.739280 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46df84-dcf4-43dc-bd64-dbe282c86453 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:12.739556 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46df84-dcf4-43dc-bd64-dbe282c86453 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:12.739824 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46df84-dcf4-43dc-bd64-dbe282c86453 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:12.804216 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da46df84-dcf4-43dc-bd64-dbe282c86453 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:48:12.805916 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da46df84-dcf4-43dc-bd64-dbe282c86453 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:48:12.830156 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:48:12.900551 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 579/1164] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:48:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 15:48:12.906395 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591cab49-b7c4-4eda-ac83-35cf0aeb0f81 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:48:13.002657 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:48:13.012750 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591cab49-b7c4-4eda-ac83-35cf0aeb0f81 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:48:13.045671 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fedaf88-d53e-4cd9-bf89-6a0dec2d5fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:48:13.046293 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fedaf88-d53e-4cd9-bf89-6a0dec2d5fd8 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:13.046568 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fedaf88-d53e-4cd9-bf89-6a0dec2d5fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:13.046835 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fedaf88-d53e-4cd9-bf89-6a0dec2d5fd8 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:13.053267 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fedaf88-d53e-4cd9-bf89-6a0dec2d5fd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:48:13.054690 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fedaf88-d53e-4cd9-bf89-6a0dec2d5fd8 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:48:13.065782 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-5fedaf88-d53e-4cd9-bf89-6a0dec2d5fd8 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 30 15:48:13.065782 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:48:13.065782 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 30 15:48:13.065782 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 30 15:48:13.065782 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 15:48:13.065782 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 15:48:13.065782 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 15:48:13.065782 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 15:48:13.065782 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 30 15:48:13.065782 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:48:13.065782 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 15:48:13.065782 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:48:13.065782 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:48:13.065782 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:48:13.065782 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:48:13.065782 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:48:13.065782 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:48:13.067031 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:48:13.067031 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:48:13.067031 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:48:13.067031 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:48:13.067031 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:48:13.067031 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:48:13.067031 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:48:13.067031 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:48:13.067031 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:48:13.067031 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:48:13.067031 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:48:13.067031 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:48:13.067031 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:48:13.067031 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:48:13.067031 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:48:13.067031 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:48:13.068201 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:48:13.068201 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:48:13.068201 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:48:13.068201 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:48:13.068201 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:48:13.068201 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:48:13.068201 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:48:13.068201 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:48:13.068201 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:48:13.068201 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:48:13.068201 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 30 15:48:13.068201 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:48:13.068201 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 30 15:48:13.068201 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:48:13.068201 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 586/1165] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Aug 30 15:48:12 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:48:13.073407 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46df84-dcf4-43dc-bd64-dbe282c86453 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:48:13.170366 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46df84-dcf4-43dc-bd64-dbe282c86453 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:48:13.194732 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:48:13.204039 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e4ce3-3028-4ac3-92b4-e5116f925645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:48:13.204644 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e4ce3-3028-4ac3-92b4-e5116f925645 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:13.204955 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e4ce3-3028-4ac3-92b4-e5116f925645 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:13.205230 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e4ce3-3028-4ac3-92b4-e5116f925645 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:13.205870 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e4ce3-3028-4ac3-92b4-e5116f925645 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:48:13.206170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e4ce3-3028-4ac3-92b4-e5116f925645 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:48:13.207539 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e4ce3-3028-4ac3-92b4-e5116f925645 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:48:13.215239 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 580/1166] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Aug 30 15:48:13 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:48:15.072287 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562db02f-55c1-4906-8072-cf374e8217a7 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:15.072830 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562db02f-55c1-4906-8072-cf374e8217a7 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:15.072830 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562db02f-55c1-4906-8072-cf374e8217a7 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:15.074173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 587/1167] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:48:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:48:15.079352 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c0674-e28f-4a17-90d9-4cd31bdad317 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:15.079776 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c0674-e28f-4a17-90d9-4cd31bdad317 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:15.079887 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c0674-e28f-4a17-90d9-4cd31bdad317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:15.098199 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-880c0674-e28f-4a17-90d9-4cd31bdad317 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:48:15.099375 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-880c0674-e28f-4a17-90d9-4cd31bdad317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:48:15.165653 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 581/1168] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:48:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:48:15.438561 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562db02f-55c1-4906-8072-cf374e8217a7 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:48:15.537165 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562db02f-55c1-4906-8072-cf374e8217a7 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:48:15.570198 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91161bd-4cf7-423f-bfc0-e6be9e6f09d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:48:15.571435 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91161bd-4cf7-423f-bfc0-e6be9e6f09d9 None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:15.571435 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91161bd-4cf7-423f-bfc0-e6be9e6f09d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:15.572099 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91161bd-4cf7-423f-bfc0-e6be9e6f09d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:15.572754 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91161bd-4cf7-423f-bfc0-e6be9e6f09d9 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:48:15.574129 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91161bd-4cf7-423f-bfc0-e6be9e6f09d9 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:48:15.589382 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 588/1169] 10.222.0.25 () {60 vars in 1138 bytes} [Tue Aug 30 15:48:15 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:48:17.522174 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad25ddb-5876-4eae-b479-f549bd1ed4f6 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:17.522725 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad25ddb-5876-4eae-b479-f549bd1ed4f6 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:17.522725 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad25ddb-5876-4eae-b479-f549bd1ed4f6 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:17.524144 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 582/1170] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:48:17.529363 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d121d5-18b9-4fb7-998f-17cd3daa40e3 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:17.529764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d121d5-18b9-4fb7-998f-17cd3daa40e3 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:17.529925 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d121d5-18b9-4fb7-998f-17cd3daa40e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:17.548201 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-54d121d5-18b9-4fb7-998f-17cd3daa40e3 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:48:17.549410 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-54d121d5-18b9-4fb7-998f-17cd3daa40e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:48:17.552118 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:48:17.615559 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 589/1171] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:48:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:48:17.882391 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad25ddb-5876-4eae-b479-f549bd1ed4f6 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:48:17.980821 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad25ddb-5876-4eae-b479-f549bd1ed4f6 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:48:18.000307 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:48:18.014190 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a8452-ce34-4969-a814-96b0d4e81d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:48:18.014807 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a8452-ce34-4969-a814-96b0d4e81d1c None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:18.015081 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a8452-ce34-4969-a814-96b0d4e81d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:18.015349 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a8452-ce34-4969-a814-96b0d4e81d1c None admin] PATH_INFO: `/v3/domains/01aba520d01445cb8ca4e7bbaf47abb9` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:18.026078 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a8452-ce34-4969-a814-96b0d4e81d1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=01aba520d01445cb8ca4e7bbaf47abb9)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:48:18.027508 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a8452-ce34-4969-a814-96b0d4e81d1c None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:48:18.029096 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 583/1172] 10.222.0.25 () {56 vars in 1183 bytes} [Tue Aug 30 15:48:17 2022] GET /identity/v3/domains/01aba520d01445cb8ca4e7bbaf47abb9 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:48:18.034799 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d121d5-18b9-4fb7-998f-17cd3daa40e3 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:48:18.129607 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d121d5-18b9-4fb7-998f-17cd3daa40e3 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:48:18.162958 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a74fe-10a5-4b8d-bec8-318354e40ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:48:18.163493 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a74fe-10a5-4b8d-bec8-318354e40ebc None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:18.163772 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a74fe-10a5-4b8d-bec8-318354e40ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:18.164046 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a74fe-10a5-4b8d-bec8-318354e40ebc None admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:18.165347 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a74fe-10a5-4b8d-bec8-318354e40ebc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:48:18.166745 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a74fe-10a5-4b8d-bec8-318354e40ebc None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:48:18.177341 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:48:18.193328 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 590/1173] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Aug 30 15:48:18 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:48:20.096312 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1c99a-5e95-492b-a223-b9f09a9db3b1 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:20.096865 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1c99a-5e95-492b-a223-b9f09a9db3b1 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:20.096982 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1c99a-5e95-492b-a223-b9f09a9db3b1 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:20.098260 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 584/1174] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:48:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:48:20.103946 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf516002-18d9-4a7f-9906-290a6173d9b5 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:20.104327 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf516002-18d9-4a7f-9906-290a6173d9b5 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:20.104493 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf516002-18d9-4a7f-9906-290a6173d9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:20.122286 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-cf516002-18d9-4a7f-9906-290a6173d9b5 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:48:20.123468 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-cf516002-18d9-4a7f-9906-290a6173d9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:48:20.188666 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 591/1175] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:48:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:48:20.459746 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1c99a-5e95-492b-a223-b9f09a9db3b1 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:48:20.559331 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1c99a-5e95-492b-a223-b9f09a9db3b1 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:48:20.590765 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c898b6a-4f5a-45af-a21c-ed300ee941c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:48:20.591386 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c898b6a-4f5a-45af-a21c-ed300ee941c5 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:20.591665 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c898b6a-4f5a-45af-a21c-ed300ee941c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:20.591939 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c898b6a-4f5a-45af-a21c-ed300ee941c5 None admin] PATH_INFO: `/v3/domains/01aba520d01445cb8ca4e7bbaf47abb9` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:20.593219 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c898b6a-4f5a-45af-a21c-ed300ee941c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=01aba520d01445cb8ca4e7bbaf47abb9)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:48:20.594651 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c898b6a-4f5a-45af-a21c-ed300ee941c5 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:48:20.596187 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 585/1176] 10.222.0.25 () {56 vars in 1183 bytes} [Tue Aug 30 15:48:20 2022] GET /identity/v3/domains/01aba520d01445cb8ca4e7bbaf47abb9 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:48:20.602386 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf516002-18d9-4a7f-9906-290a6173d9b5 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:48:20.698399 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf516002-18d9-4a7f-9906-290a6173d9b5 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:48:20.719888 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:48:20.734169 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101ef18-b628-4766-87b6-6cf327fd7420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:48:20.734776 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101ef18-b628-4766-87b6-6cf327fd7420 None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:20.735055 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101ef18-b628-4766-87b6-6cf327fd7420 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:20.735327 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101ef18-b628-4766-87b6-6cf327fd7420 None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:20.735976 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101ef18-b628-4766-87b6-6cf327fd7420 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:48:20.737444 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101ef18-b628-4766-87b6-6cf327fd7420 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:48:20.758704 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 592/1177] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Aug 30 15:48:20 2022] POST /identity/v3/users => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:48:22.708594 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b974b-6677-43eb-bae6-789fe49f78bf None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:22.709232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b974b-6677-43eb-bae6-789fe49f78bf None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:22.709232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b974b-6677-43eb-bae6-789fe49f78bf None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:22.710503 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 586/1178] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:48:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:48:22.716250 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c792c3-f7ef-47d2-a210-80987f626763 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:22.716676 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c792c3-f7ef-47d2-a210-80987f626763 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:22.716853 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c792c3-f7ef-47d2-a210-80987f626763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:22.736678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-c9c792c3-f7ef-47d2-a210-80987f626763 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:48:22.737874 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c9c792c3-f7ef-47d2-a210-80987f626763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:48:22.802498 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 593/1179] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:48:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:48:23.068622 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b974b-6677-43eb-bae6-789fe49f78bf None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:48:23.118994 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:48:23.170300 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b974b-6677-43eb-bae6-789fe49f78bf None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:48:23.207999 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c28314c-6d50-4b71-baa4-6079971a85ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:48:23.208623 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28314c-6d50-4b71-baa4-6079971a85ee None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:23.208931 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28314c-6d50-4b71-baa4-6079971a85ee None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:23.209205 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28314c-6d50-4b71-baa4-6079971a85ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:23.220203 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c28314c-6d50-4b71-baa4-6079971a85ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:48:23.224979 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-7c28314c-6d50-4b71-baa4-6079971a85ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:48:23.224979 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:48:23.224979 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:48:23.224979 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:48:23.224979 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:48:23.224979 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:48:23.224979 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:48:23.224979 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:48:23.224979 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:48:23.224979 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:48:23.224979 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:48:23.224979 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:48:23.224979 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:48:23.224979 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:48:23.224979 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:48:23.224979 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:48:23.226100 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:48:23.226100 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:48:23.226100 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:48:23.226100 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:48:23.226100 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:48:23.226100 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:48:23.226100 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:48:23.226100 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:48:23.226100 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:48:23.226100 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:48:23.226100 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:48:23.226100 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:48:23.226100 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:48:23.226100 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:48:23.226100 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:48:23.226100 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:48:23.227592 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:48:23.227592 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:48:23.227592 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:48:23.227592 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:48:23.227592 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:48:23.227592 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:48:23.227592 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:48:23.227592 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:48:23.227592 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:48:23.227592 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:48:23.227592 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:48:23.227592 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:48:23.227592 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 587/1180] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 30 15:48:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:48:23.232699 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c792c3-f7ef-47d2-a210-80987f626763 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:48:23.328207 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c792c3-f7ef-47d2-a210-80987f626763 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:48:23.337692 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:48:23.363361 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53915229-ce24-4013-8908-bc54c959b078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:48:23.363960 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53915229-ce24-4013-8908-bc54c959b078 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:23.364234 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53915229-ce24-4013-8908-bc54c959b078 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:23.364527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53915229-ce24-4013-8908-bc54c959b078 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:23.365222 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53915229-ce24-4013-8908-bc54c959b078 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:48:23.365518 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53915229-ce24-4013-8908-bc54c959b078 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:48:23.366871 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53915229-ce24-4013-8908-bc54c959b078 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:48:23.374984 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 594/1181] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:48:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:48:23.380649 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c28314c-6d50-4b71-baa4-6079971a85ee None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:48:23.478131 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c28314c-6d50-4b71-baa4-6079971a85ee None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:48:23.486642 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:48:23.511298 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62474b1-847e-49a7-aac5-843f098ce030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:48:23.511917 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62474b1-847e-49a7-aac5-843f098ce030 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:23.512197 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62474b1-847e-49a7-aac5-843f098ce030 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:23.512469 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62474b1-847e-49a7-aac5-843f098ce030 None admin] PATH_INFO: `/v3/users/2756a2405aa94bd0958a1f5ed8fabf57` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:23.526058 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62474b1-847e-49a7-aac5-843f098ce030 None admin] RBAC: Authorizing `identity:get_user(user_id=2756a2405aa94bd0958a1f5ed8fabf57)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:48:23.527493 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62474b1-847e-49a7-aac5-843f098ce030 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:48:23.529094 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 588/1182] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:48:23 2022] GET /identity/v3/users/2756a2405aa94bd0958a1f5ed8fabf57 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:48:23.535081 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53915229-ce24-4013-8908-bc54c959b078 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:48:23.629837 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53915229-ce24-4013-8908-bc54c959b078 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:48:23.662378 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e93510-4706-4acb-b9c8-dfdbc3a3217c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:48:23.662963 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e93510-4706-4acb-b9c8-dfdbc3a3217c None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:23.663237 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e93510-4706-4acb-b9c8-dfdbc3a3217c None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:23.663502 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e93510-4706-4acb-b9c8-dfdbc3a3217c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:23.700525 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:48:23.728858 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e93510-4706-4acb-b9c8-dfdbc3a3217c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:48:23.730299 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e93510-4706-4acb-b9c8-dfdbc3a3217c None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:48:23.824966 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 595/1183] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:48:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 15:48:23.830939 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62474b1-847e-49a7-aac5-843f098ce030 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:48:23.926528 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62474b1-847e-49a7-aac5-843f098ce030 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:48:23.959445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd2675-326e-4c44-97e0-58fe2f55266d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:48:23.960060 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd2675-326e-4c44-97e0-58fe2f55266d None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:23.960336 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd2675-326e-4c44-97e0-58fe2f55266d None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:23.960603 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd2675-326e-4c44-97e0-58fe2f55266d None admin] PATH_INFO: `/v3/projects/0d9371b64d4844efbb027677ab777ced` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:23.961879 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd2675-326e-4c44-97e0-58fe2f55266d None admin] RBAC: Authorizing `identity:get_project(project_id=0d9371b64d4844efbb027677ab777ced)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:48:23.963329 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd2675-326e-4c44-97e0-58fe2f55266d None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:48:23.964985 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 589/1184] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:48:23 2022] GET /identity/v3/projects/0d9371b64d4844efbb027677ab777ced => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:48:23.971105 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e93510-4706-4acb-b9c8-dfdbc3a3217c None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:48:24.037352 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:48:24.067899 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e93510-4706-4acb-b9c8-dfdbc3a3217c None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:48:24.101348 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded2b34-c043-4702-a846-959e3f7cad58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:48:24.102173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded2b34-c043-4702-a846-959e3f7cad58 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:24.102450 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded2b34-c043-4702-a846-959e3f7cad58 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:24.102716 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded2b34-c043-4702-a846-959e3f7cad58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:24.103432 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded2b34-c043-4702-a846-959e3f7cad58 None admin] RBAC: Adding query filter params (role.id=676938e69210499ca11ee75dd572d0dc, scope.project.id=0d9371b64d4844efbb027677ab777ced, user.id=2756a2405aa94bd0958a1f5ed8fabf57) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:48:24.103735 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded2b34-c043-4702-a846-959e3f7cad58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:48:24.105175 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded2b34-c043-4702-a846-959e3f7cad58 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:48:24.110316 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 596/1185] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:48:23 2022] GET /identity/v3/role_assignments?user.id=2756a2405aa94bd0958a1f5ed8fabf57&scope.project.id=0d9371b64d4844efbb027677ab777ced&role.id=676938e69210499ca11ee75dd572d0dc => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:48:25.987378 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98231f60-321e-4269-ab14-6c2a6c7a201d None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:25.987896 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98231f60-321e-4269-ab14-6c2a6c7a201d None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:25.987896 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98231f60-321e-4269-ab14-6c2a6c7a201d None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:25.989226 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 590/1186] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:48:25.995024 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545917a-67f0-47ac-ac1e-92d9b21c7e97 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:25.995531 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545917a-67f0-47ac-ac1e-92d9b21c7e97 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:25.995632 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545917a-67f0-47ac-ac1e-92d9b21c7e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:26.013289 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-c545917a-67f0-47ac-ac1e-92d9b21c7e97 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:48:26.014457 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c545917a-67f0-47ac-ac1e-92d9b21c7e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:48:26.077956 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 597/1187] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:48:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:48:26.345990 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98231f60-321e-4269-ab14-6c2a6c7a201d None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:48:26.380723 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:48:26.446663 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98231f60-321e-4269-ab14-6c2a6c7a201d None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:48:26.480884 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069d062-d029-4ed2-871e-344ee50f6b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:48:26.481503 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069d062-d029-4ed2-871e-344ee50f6b0e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:26.481782 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069d062-d029-4ed2-871e-344ee50f6b0e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:26.482056 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069d062-d029-4ed2-871e-344ee50f6b0e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:26.491864 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069d062-d029-4ed2-871e-344ee50f6b0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:48:26.497209 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-a069d062-d029-4ed2-871e-344ee50f6b0e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:48:26.497209 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:48:26.497209 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:48:26.497209 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:48:26.497209 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:48:26.497209 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:48:26.497209 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:48:26.497209 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:48:26.497209 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:48:26.497209 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:48:26.497209 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:48:26.497209 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:48:26.497209 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:48:26.497209 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:48:26.497209 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:48:26.497209 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:48:26.498323 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:48:26.498323 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:48:26.498323 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:48:26.498323 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:48:26.498323 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:48:26.498323 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:48:26.498323 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:48:26.498323 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:48:26.498323 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:48:26.498323 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:48:26.498323 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:48:26.498323 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:48:26.498323 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:48:26.498323 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:48:26.498323 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:48:26.498323 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:48:26.499356 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:48:26.499356 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:48:26.499356 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:48:26.499356 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:48:26.499356 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:48:26.499356 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:48:26.499356 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:48:26.499356 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:48:26.499356 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:48:26.499356 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:48:26.499356 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:48:26.499356 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:48:26.499356 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 591/1188] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 30 15:48:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:48:26.504356 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545917a-67f0-47ac-ac1e-92d9b21c7e97 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:48:26.564525 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:48:26.601097 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545917a-67f0-47ac-ac1e-92d9b21c7e97 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:48:26.634377 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f0055-2683-4b70-a9ec-5b2fd11ea138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:48:26.634979 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f0055-2683-4b70-a9ec-5b2fd11ea138 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:26.635259 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f0055-2683-4b70-a9ec-5b2fd11ea138 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:26.635531 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f0055-2683-4b70-a9ec-5b2fd11ea138 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:26.636193 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f0055-2683-4b70-a9ec-5b2fd11ea138 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:48:26.636493 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f0055-2683-4b70-a9ec-5b2fd11ea138 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:48:26.637891 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f0055-2683-4b70-a9ec-5b2fd11ea138 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:48:26.645972 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 598/1189] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:48:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:48:26.651925 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069d062-d029-4ed2-871e-344ee50f6b0e None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:48:26.748398 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:48:26.755081 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069d062-d029-4ed2-871e-344ee50f6b0e None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:48:26.787252 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e63b02-508e-4e7e-b723-ecd7cef8b226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:48:26.787876 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e63b02-508e-4e7e-b723-ecd7cef8b226 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:26.788150 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e63b02-508e-4e7e-b723-ecd7cef8b226 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:26.788416 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e63b02-508e-4e7e-b723-ecd7cef8b226 None admin] PATH_INFO: `/v3/users/2756a2405aa94bd0958a1f5ed8fabf57` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:26.790247 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e63b02-508e-4e7e-b723-ecd7cef8b226 None admin] RBAC: Authorizing `identity:get_user(user_id=2756a2405aa94bd0958a1f5ed8fabf57)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:48:26.791669 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e63b02-508e-4e7e-b723-ecd7cef8b226 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:48:26.793261 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 592/1190] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:48:26 2022] GET /identity/v3/users/2756a2405aa94bd0958a1f5ed8fabf57 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:48:26.798960 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f0055-2683-4b70-a9ec-5b2fd11ea138 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:48:26.894781 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f0055-2683-4b70-a9ec-5b2fd11ea138 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:48:26.919456 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:48:26.928316 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49c717-792d-41fc-a82b-cef51e8e345e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:48:26.928966 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49c717-792d-41fc-a82b-cef51e8e345e None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:26.929242 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49c717-792d-41fc-a82b-cef51e8e345e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:26.929511 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49c717-792d-41fc-a82b-cef51e8e345e None admin] PATH_INFO: `/v3/projects/0d9371b64d4844efbb027677ab777ced` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:26.930631 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49c717-792d-41fc-a82b-cef51e8e345e None admin] RBAC: Authorizing `identity:get_project(project_id=0d9371b64d4844efbb027677ab777ced)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:48:26.932037 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49c717-792d-41fc-a82b-cef51e8e345e None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:48:26.933640 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 599/1191] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:48:26 2022] GET /identity/v3/projects/0d9371b64d4844efbb027677ab777ced => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:48:26.939397 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e63b02-508e-4e7e-b723-ecd7cef8b226 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:48:27.038118 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e63b02-508e-4e7e-b723-ecd7cef8b226 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:48:27.070681 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d714fd-8ef2-45c0-bc79-ba6e68d43d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:48:27.071333 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d714fd-8ef2-45c0-bc79-ba6e68d43d43 None admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:27.071612 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d714fd-8ef2-45c0-bc79-ba6e68d43d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:27.071879 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d714fd-8ef2-45c0-bc79-ba6e68d43d43 None admin] PATH_INFO: `/v3/projects/0d9371b64d4844efbb027677ab777ced/users/2756a2405aa94bd0958a1f5ed8fabf57/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:27.073785 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d714fd-8ef2-45c0-bc79-ba6e68d43d43 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d9371b64d4844efbb027677ab777ced, user_id=2756a2405aa94bd0958a1f5ed8fabf57, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:48:27.075225 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d714fd-8ef2-45c0-bc79-ba6e68d43d43 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:48:27.088298 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 593/1192] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 30 15:48:26 2022] PUT /identity/v3/projects/0d9371b64d4844efbb027677ab777ced/users/2756a2405aa94bd0958a1f5ed8fabf57/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:48:28.969668 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495e511-7496-4914-a36c-dc0c4e3643cf None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:28.970179 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495e511-7496-4914-a36c-dc0c4e3643cf None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:28.970268 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495e511-7496-4914-a36c-dc0c4e3643cf None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:28.971599 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 600/1193] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:48:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:48:28.977398 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57058a-1443-45a7-bd81-7827635a08f4 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:28.977835 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57058a-1443-45a7-bd81-7827635a08f4 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:28.977924 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57058a-1443-45a7-bd81-7827635a08f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:28.996557 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-0b57058a-1443-45a7-bd81-7827635a08f4 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:48:28.998013 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-0b57058a-1443-45a7-bd81-7827635a08f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:48:29.016507 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:48:29.066479 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 594/1194] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:48:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:48:29.338521 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495e511-7496-4914-a36c-dc0c4e3643cf None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:48:29.438858 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495e511-7496-4914-a36c-dc0c4e3643cf None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:48:29.472283 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e91d4-8b8f-4e8c-884e-43a92e8f79a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:48:29.472929 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e91d4-8b8f-4e8c-884e-43a92e8f79a5 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:29.473207 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e91d4-8b8f-4e8c-884e-43a92e8f79a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:29.473477 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e91d4-8b8f-4e8c-884e-43a92e8f79a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:29.483934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639e91d4-8b8f-4e8c-884e-43a92e8f79a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:48:29.488678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-639e91d4-8b8f-4e8c-884e-43a92e8f79a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:48:29.488678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:48:29.488678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:48:29.488678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:48:29.488678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:48:29.488678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:48:29.488678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:48:29.488678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:48:29.488678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:48:29.488678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:48:29.488678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:48:29.488678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:48:29.488678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:48:29.488678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:48:29.488678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:48:29.488678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:48:29.489784 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:48:29.489784 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:48:29.489784 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:48:29.489784 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:48:29.489784 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:48:29.489784 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:48:29.489784 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:48:29.489784 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:48:29.489784 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:48:29.489784 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:48:29.489784 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:48:29.489784 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:48:29.489784 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:48:29.489784 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:48:29.489784 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:48:29.489784 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:48:29.490879 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:48:29.490879 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:48:29.490879 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:48:29.490879 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:48:29.490879 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:48:29.490879 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:48:29.490879 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:48:29.490879 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:48:29.490879 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:48:29.490879 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:48:29.490879 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:48:29.490879 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:48:29.490879 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 601/1195] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 30 15:48:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:48:29.496162 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57058a-1443-45a7-bd81-7827635a08f4 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:48:29.593109 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57058a-1443-45a7-bd81-7827635a08f4 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:48:29.624987 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0599557-b01d-4b45-8b26-f2bfda5fc7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:48:29.625590 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0599557-b01d-4b45-8b26-f2bfda5fc7a1 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:29.625865 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0599557-b01d-4b45-8b26-f2bfda5fc7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:29.626129 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0599557-b01d-4b45-8b26-f2bfda5fc7a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:29.626785 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0599557-b01d-4b45-8b26-f2bfda5fc7a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:48:29.627079 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0599557-b01d-4b45-8b26-f2bfda5fc7a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:48:29.628440 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0599557-b01d-4b45-8b26-f2bfda5fc7a1 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:48:29.636732 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 595/1196] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:48:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:48:29.643008 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e91d4-8b8f-4e8c-884e-43a92e8f79a5 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:48:29.697840 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:48:29.742919 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e91d4-8b8f-4e8c-884e-43a92e8f79a5 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:48:29.776389 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eabc90-f2c1-42db-800f-9fce3b50ca9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:48:29.777035 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eabc90-f2c1-42db-800f-9fce3b50ca9c None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:29.777314 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eabc90-f2c1-42db-800f-9fce3b50ca9c None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:29.777586 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eabc90-f2c1-42db-800f-9fce3b50ca9c None admin] PATH_INFO: `/v3/users/2756a2405aa94bd0958a1f5ed8fabf57` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:29.778696 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eabc90-f2c1-42db-800f-9fce3b50ca9c None admin] RBAC: Authorizing `identity:get_user(user_id=2756a2405aa94bd0958a1f5ed8fabf57)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:48:29.780117 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eabc90-f2c1-42db-800f-9fce3b50ca9c None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:48:29.781702 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 602/1197] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 30 15:48:29 2022] GET /identity/v3/users/2756a2405aa94bd0958a1f5ed8fabf57 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:48:29.787588 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0599557-b01d-4b45-8b26-f2bfda5fc7a1 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:48:29.805561 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:48:29.889211 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0599557-b01d-4b45-8b26-f2bfda5fc7a1 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:48:29.922776 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598d70a-180c-4853-bd71-cc8f7d50046e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:48:29.923486 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598d70a-180c-4853-bd71-cc8f7d50046e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:29.923849 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598d70a-180c-4853-bd71-cc8f7d50046e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:29.924156 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598d70a-180c-4853-bd71-cc8f7d50046e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:29.991148 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598d70a-180c-4853-bd71-cc8f7d50046e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:48:29.993214 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598d70a-180c-4853-bd71-cc8f7d50046e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:48:30.008196 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:48:30.093516 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 596/1198] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:48:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 15:48:30.099415 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eabc90-f2c1-42db-800f-9fce3b50ca9c None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:48:30.196360 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eabc90-f2c1-42db-800f-9fce3b50ca9c None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:48:30.217016 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:48:30.228825 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f512f9-fad9-4f5c-a8b5-92ad147b1f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:48:30.229442 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f512f9-fad9-4f5c-a8b5-92ad147b1f1b None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:30.229718 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f512f9-fad9-4f5c-a8b5-92ad147b1f1b None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:30.229987 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f512f9-fad9-4f5c-a8b5-92ad147b1f1b None admin] PATH_INFO: `/v3/projects/0d9371b64d4844efbb027677ab777ced` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:30.231077 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f512f9-fad9-4f5c-a8b5-92ad147b1f1b None admin] RBAC: Authorizing `identity:get_project(project_id=0d9371b64d4844efbb027677ab777ced)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:48:30.232492 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f512f9-fad9-4f5c-a8b5-92ad147b1f1b None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:48:30.234097 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 603/1199] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 30 15:48:30 2022] GET /identity/v3/projects/0d9371b64d4844efbb027677ab777ced => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:48:30.240114 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598d70a-180c-4853-bd71-cc8f7d50046e None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:48:30.336592 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598d70a-180c-4853-bd71-cc8f7d50046e None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:48:30.350731 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:48:30.371839 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572154fc-4db6-4e06-92c7-216f6269b421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:48:30.372441 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572154fc-4db6-4e06-92c7-216f6269b421 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:48:30.372723 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572154fc-4db6-4e06-92c7-216f6269b421 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:48:30.373058 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572154fc-4db6-4e06-92c7-216f6269b421 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:48:30.373742 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572154fc-4db6-4e06-92c7-216f6269b421 None admin] RBAC: Adding query filter params (role.id=676938e69210499ca11ee75dd572d0dc, scope.project.id=0d9371b64d4844efbb027677ab777ced, user.id=2756a2405aa94bd0958a1f5ed8fabf57) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:48:30.374052 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572154fc-4db6-4e06-92c7-216f6269b421 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:48:30.375493 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572154fc-4db6-4e06-92c7-216f6269b421 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:48:30.381149 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 597/1200] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:48:30 2022] GET /identity/v3/role_assignments?user.id=2756a2405aa94bd0958a1f5ed8fabf57&scope.project.id=0d9371b64d4844efbb027677ab777ced&role.id=676938e69210499ca11ee75dd572d0dc => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:48:40.224156 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=5 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:48:40.378587 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=11 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:26.214743 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed31ffc-9de4-4968-8f71-aa4fd3e698b7 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:26.215445 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed31ffc-9de4-4968-8f71-aa4fd3e698b7 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:26.215540 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed31ffc-9de4-4968-8f71-aa4fd3e698b7 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:26.217346 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 604/1201] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:49:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:49:26.224135 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fad7b2-f561-480b-92cd-60353b620114 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:26.224642 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fad7b2-f561-480b-92cd-60353b620114 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:26.224732 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fad7b2-f561-480b-92cd-60353b620114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:26.244152 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-04fad7b2-f561-480b-92cd-60353b620114 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:49:26.245371 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-04fad7b2-f561-480b-92cd-60353b620114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:49:26.351560 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 598/1202] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:49:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:49:26.632454 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed31ffc-9de4-4968-8f71-aa4fd3e698b7 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:26.768523 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed31ffc-9de4-4968-8f71-aa4fd3e698b7 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:26.814968 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871f4d8-e44f-4d10-b67c-82c6f5ca7c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:26.815869 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871f4d8-e44f-4d10-b67c-82c6f5ca7c4f None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:26.816161 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871f4d8-e44f-4d10-b67c-82c6f5ca7c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:26.816418 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871f4d8-e44f-4d10-b67c-82c6f5ca7c4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:26.828988 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1871f4d8-e44f-4d10-b67c-82c6f5ca7c4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:26.831850 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1871f4d8-e44f-4d10-b67c-82c6f5ca7c4f None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:26.853443 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-1871f4d8-e44f-4d10-b67c-82c6f5ca7c4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:49:26.853443 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:49:26.853443 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:49:26.853443 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:49:26.853443 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:49:26.853443 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:49:26.853443 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:49:26.853443 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:49:26.853443 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:49:26.853443 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:49:26.853443 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:49:26.853443 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:49:26.853443 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:49:26.853443 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:49:26.853443 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:49:26.853443 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:49:26.854621 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:49:26.854621 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:49:26.854621 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:49:26.854621 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:49:26.854621 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:49:26.854621 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:49:26.854621 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:49:26.854621 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:49:26.854621 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:49:26.854621 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:49:26.854621 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:49:26.854621 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:49:26.854621 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:49:26.854621 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:49:26.854621 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:49:26.854621 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:49:26.854621 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:49:26.857813 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:49:26.857813 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:49:26.857813 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:49:26.857813 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 605/1203] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:49:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:49:26.862539 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fad7b2-f561-480b-92cd-60353b620114 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:26.991228 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fad7b2-f561-480b-92cd-60353b620114 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:27.026535 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:27.037863 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f34e0-2cf3-45b9-a75d-daa7431fba1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:27.037863 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f34e0-2cf3-45b9-a75d-daa7431fba1e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:27.037863 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f34e0-2cf3-45b9-a75d-daa7431fba1e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:27.037863 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f34e0-2cf3-45b9-a75d-daa7431fba1e None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:27.038266 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f34e0-2cf3-45b9-a75d-daa7431fba1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:49:27.038266 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f34e0-2cf3-45b9-a75d-daa7431fba1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:27.038406 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f34e0-2cf3-45b9-a75d-daa7431fba1e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:27.052886 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 599/1204] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:49:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:49:27.072894 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871f4d8-e44f-4d10-b67c-82c6f5ca7c4f None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:27.133148 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:27.197894 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871f4d8-e44f-4d10-b67c-82c6f5ca7c4f None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:27.242372 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dcbdb8-b23c-4052-9fca-4573ee3302ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:27.243036 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dcbdb8-b23c-4052-9fca-4573ee3302ab None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:27.243173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dcbdb8-b23c-4052-9fca-4573ee3302ab None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:27.243481 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dcbdb8-b23c-4052-9fca-4573ee3302ab None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:27.244140 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dcbdb8-b23c-4052-9fca-4573ee3302ab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:27.245721 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dcbdb8-b23c-4052-9fca-4573ee3302ab None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:27.284812 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 606/1205] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Aug 30 15:49:27 2022] POST /identity/v3/users => generated 251 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:49:29.555404 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859ac76-67e5-449a-aeee-7afd22d4c3e3 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:29.556497 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859ac76-67e5-449a-aeee-7afd22d4c3e3 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:29.556497 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859ac76-67e5-449a-aeee-7afd22d4c3e3 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:29.557339 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 600/1206] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:49:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:49:29.562904 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916a081-1f26-446c-bd53-4d3f916f4332 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:29.563366 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916a081-1f26-446c-bd53-4d3f916f4332 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:29.563491 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916a081-1f26-446c-bd53-4d3f916f4332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:29.582800 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-8916a081-1f26-446c-bd53-4d3f916f4332 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:49:29.584314 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-8916a081-1f26-446c-bd53-4d3f916f4332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:49:29.678698 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 607/1207] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:49:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:49:29.952243 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859ac76-67e5-449a-aeee-7afd22d4c3e3 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:30.073233 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859ac76-67e5-449a-aeee-7afd22d4c3e3 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:30.116625 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967eedb4-7596-4192-a6f1-e483e86350a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:30.117507 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967eedb4-7596-4192-a6f1-e483e86350a7 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:30.117866 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967eedb4-7596-4192-a6f1-e483e86350a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:30.118751 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967eedb4-7596-4192-a6f1-e483e86350a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:30.142235 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967eedb4-7596-4192-a6f1-e483e86350a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:49:30.148373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-967eedb4-7596-4192-a6f1-e483e86350a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 15:49:30.148373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:49:30.148373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:49:30.148373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:49:30.148373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:49:30.148373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:49:30.148373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:49:30.148373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:49:30.148373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:49:30.148373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:49:30.148373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:49:30.148373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:49:30.148373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:49:30.148373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:49:30.148373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:49:30.148373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:49:30.149652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:49:30.149652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:49:30.149652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:49:30.149652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:49:30.149652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:49:30.149652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:49:30.149652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:49:30.149652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:49:30.149652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:49:30.149652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:49:30.149652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:49:30.149652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:49:30.149652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:49:30.149652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:49:30.149652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:49:30.149652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:49:30.150565 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:49:30.150565 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:49:30.150565 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:49:30.150565 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:49:30.150565 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:49:30.150565 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:49:30.150565 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:49:30.150565 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:49:30.150565 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:49:30.150565 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:49:30.150565 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 15:49:30.150565 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:49:30.150565 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 601/1208] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 30 15:49:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:49:30.155615 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916a081-1f26-446c-bd53-4d3f916f4332 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:30.198532 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:30.269099 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916a081-1f26-446c-bd53-4d3f916f4332 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:30.312813 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a58073-5f33-4d35-8e2f-e8ecd70d74a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:30.312813 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a58073-5f33-4d35-8e2f-e8ecd70d74a0 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:30.312813 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a58073-5f33-4d35-8e2f-e8ecd70d74a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:30.312813 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a58073-5f33-4d35-8e2f-e8ecd70d74a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:30.313409 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a58073-5f33-4d35-8e2f-e8ecd70d74a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:49:30.313409 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a58073-5f33-4d35-8e2f-e8ecd70d74a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:30.313910 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a58073-5f33-4d35-8e2f-e8ecd70d74a0 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:30.322971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 608/1209] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Aug 30 15:49:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:49:30.328719 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967eedb4-7596-4192-a6f1-e483e86350a7 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:30.386457 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:30.448450 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967eedb4-7596-4192-a6f1-e483e86350a7 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:30.485743 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e212f3-3fed-4000-b408-4a53429a9219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:30.486980 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e212f3-3fed-4000-b408-4a53429a9219 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:30.486980 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e212f3-3fed-4000-b408-4a53429a9219 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:30.487166 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e212f3-3fed-4000-b408-4a53429a9219 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:30.501107 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e212f3-3fed-4000-b408-4a53429a9219 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:30.502617 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e212f3-3fed-4000-b408-4a53429a9219 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:30.518661 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-07e212f3-3fed-4000-b408-4a53429a9219 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:49:30.518661 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:49:30.518661 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:49:30.518661 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:49:30.518661 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:49:30.518661 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:49:30.518661 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:49:30.518661 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:49:30.518661 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:49:30.518661 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:49:30.518661 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:49:30.518661 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:49:30.518661 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:49:30.518661 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:49:30.518661 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:49:30.518661 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:49:30.520355 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:49:30.520355 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:49:30.520355 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:49:30.520355 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:49:30.520355 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:49:30.520355 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:49:30.520355 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:49:30.520355 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:49:30.520355 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:49:30.520355 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:49:30.520355 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:49:30.520355 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:49:30.520355 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:49:30.520355 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:49:30.520355 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:49:30.520355 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:49:30.520355 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:49:30.522086 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:49:30.522086 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:49:30.522086 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:49:30.522086 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 602/1210] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:49:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:49:30.526541 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a58073-5f33-4d35-8e2f-e8ecd70d74a0 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:30.658000 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:30.662183 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a58073-5f33-4d35-8e2f-e8ecd70d74a0 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:30.712970 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948d52d-0277-45d8-9c89-4d9045deec09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:30.713808 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948d52d-0277-45d8-9c89-4d9045deec09 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:30.714134 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948d52d-0277-45d8-9c89-4d9045deec09 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:30.714502 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948d52d-0277-45d8-9c89-4d9045deec09 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:30.715158 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a948d52d-0277-45d8-9c89-4d9045deec09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:49:30.715821 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a948d52d-0277-45d8-9c89-4d9045deec09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:30.716926 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a948d52d-0277-45d8-9c89-4d9045deec09 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:30.740152 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 609/1211] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:49:30.745968 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e212f3-3fed-4000-b408-4a53429a9219 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:30.864508 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e212f3-3fed-4000-b408-4a53429a9219 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:30.866380 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:30.903655 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9f2d5-12d2-4c7f-afc8-1330de780acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:30.904287 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9f2d5-12d2-4c7f-afc8-1330de780acd None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:30.904561 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9f2d5-12d2-4c7f-afc8-1330de780acd None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:30.904857 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9f2d5-12d2-4c7f-afc8-1330de780acd None admin] PATH_INFO: `/v3/users/placement` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:30.914916 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df9f2d5-12d2-4c7f-afc8-1330de780acd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:30.916597 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df9f2d5-12d2-4c7f-afc8-1330de780acd None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:30.930108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-7df9f2d5-12d2-4c7f-afc8-1330de780acd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 15:49:30.930108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:49:30.930108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:49:30.930108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:49:30.930108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:49:30.930108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:49:30.930108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:49:30.930108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:49:30.930108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:49:30.930108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:49:30.930108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:49:30.930108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:49:30.930108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 15:49:30.930108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 15:49:30.930108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 15:49:30.930108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 15:49:30.931286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:49:30.931286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:49:30.931286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 15:49:30.931286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:49:30.931286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 15:49:30.931286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:49:30.931286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:49:30.931286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:49:30.931286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:49:30.931286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:49:30.931286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:49:30.931286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:49:30.931286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:49:30.931286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:49:30.931286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:49:30.931286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:49:30.931286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:49:30.931286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:49:30.932375 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:49:30.932375 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:49:30.932375 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 15:49:30.932375 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 15:49:30.932375 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 15:49:30.932375 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 15:49:30.932375 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 15:49:30.932375 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 15:49:30.932375 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 15:49:30.932375 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:49:30.932375 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 603/1212] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:49:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:49:30.938053 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948d52d-0277-45d8-9c89-4d9045deec09 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:31.070574 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948d52d-0277-45d8-9c89-4d9045deec09 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:31.109613 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c6026-e9d3-4ae0-83a9-8aed3c42bd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:31.110256 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c6026-e9d3-4ae0-83a9-8aed3c42bd39 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:31.110512 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c6026-e9d3-4ae0-83a9-8aed3c42bd39 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:31.110781 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c6026-e9d3-4ae0-83a9-8aed3c42bd39 None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:31.111631 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c6026-e9d3-4ae0-83a9-8aed3c42bd39 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:49:31.112029 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c6026-e9d3-4ae0-83a9-8aed3c42bd39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:31.113845 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c6026-e9d3-4ae0-83a9-8aed3c42bd39 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:31.138399 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 610/1213] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Aug 30 15:49:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:49:31.139851 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9f2d5-12d2-4c7f-afc8-1330de780acd None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:31.268290 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9f2d5-12d2-4c7f-afc8-1330de780acd None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:31.315099 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa25da4-86c0-44ab-8a27-1542ad59ec24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:31.315802 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa25da4-86c0-44ab-8a27-1542ad59ec24 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:31.316148 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa25da4-86c0-44ab-8a27-1542ad59ec24 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:31.316518 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa25da4-86c0-44ab-8a27-1542ad59ec24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:31.348972 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:31.392660 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa25da4-86c0-44ab-8a27-1542ad59ec24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:31.394445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa25da4-86c0-44ab-8a27-1542ad59ec24 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:31.512317 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 604/1214] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:49:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 15:49:31.514228 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c6026-e9d3-4ae0-83a9-8aed3c42bd39 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:31.536047 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:31.633102 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c6026-e9d3-4ae0-83a9-8aed3c42bd39 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:31.680766 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdff89f-4bb7-4055-817f-6023c55bca1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:31.681480 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdff89f-4bb7-4055-817f-6023c55bca1b None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:31.681652 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdff89f-4bb7-4055-817f-6023c55bca1b None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:31.681922 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdff89f-4bb7-4055-817f-6023c55bca1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:31.695172 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdff89f-4bb7-4055-817f-6023c55bca1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:31.696804 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdff89f-4bb7-4055-817f-6023c55bca1b None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:31.712524 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-dfdff89f-4bb7-4055-817f-6023c55bca1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:49:31.712524 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:49:31.712524 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:49:31.712524 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:49:31.712524 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:49:31.712524 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:49:31.712524 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:49:31.712524 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:49:31.712524 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:49:31.712524 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:49:31.712524 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:49:31.712524 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:49:31.712524 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:49:31.712524 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:49:31.712524 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:49:31.712524 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:49:31.713739 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:49:31.713739 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:49:31.713739 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:49:31.713739 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:49:31.713739 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:49:31.713739 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:49:31.713739 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:49:31.713739 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:49:31.713739 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:49:31.713739 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:49:31.713739 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:49:31.713739 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:49:31.713739 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:49:31.713739 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:49:31.713739 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:49:31.713739 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:49:31.713739 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:49:31.714818 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:49:31.714818 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:49:31.714818 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:49:31.720839 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 611/1215] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:49:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:49:31.720998 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa25da4-86c0-44ab-8a27-1542ad59ec24 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:31.787337 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:31.829485 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa25da4-86c0-44ab-8a27-1542ad59ec24 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:31.868028 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99215024-75c4-4280-b1df-c2276a6841bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:31.868646 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99215024-75c4-4280-b1df-c2276a6841bd None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:31.869028 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99215024-75c4-4280-b1df-c2276a6841bd None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:31.869303 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99215024-75c4-4280-b1df-c2276a6841bd None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:31.869979 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99215024-75c4-4280-b1df-c2276a6841bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:49:31.870282 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99215024-75c4-4280-b1df-c2276a6841bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:31.871672 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99215024-75c4-4280-b1df-c2276a6841bd None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:31.886179 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 605/1216] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:49:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:49:31.892375 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdff89f-4bb7-4055-817f-6023c55bca1b None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:31.974550 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:32.009915 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdff89f-4bb7-4055-817f-6023c55bca1b None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:32.049668 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd623cbc-622b-459b-9df4-229bbf94d617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:32.050296 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd623cbc-622b-459b-9df4-229bbf94d617 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:32.050570 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd623cbc-622b-459b-9df4-229bbf94d617 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:32.050836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd623cbc-622b-459b-9df4-229bbf94d617 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:32.058458 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd623cbc-622b-459b-9df4-229bbf94d617 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:32.060443 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd623cbc-622b-459b-9df4-229bbf94d617 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:32.073997 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-bd623cbc-622b-459b-9df4-229bbf94d617 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:49:32.073997 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:49:32.073997 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:49:32.073997 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:49:32.073997 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:49:32.073997 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:49:32.073997 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:49:32.073997 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:49:32.073997 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:49:32.073997 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:49:32.073997 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:49:32.073997 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:49:32.073997 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 15:49:32.073997 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 15:49:32.073997 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 15:49:32.075252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 15:49:32.075252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:49:32.075252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:49:32.075252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:49:32.075252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:49:32.075252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:49:32.075252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:49:32.075252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:49:32.075252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:49:32.075252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:49:32.075252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:49:32.075252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:49:32.075252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:49:32.075252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:49:32.075252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:49:32.075252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:49:32.075252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:49:32.076695 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 15:49:32.076695 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 15:49:32.076695 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 15:49:32.076695 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 15:49:32.076695 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 15:49:32.076695 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 15:49:32.076695 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:49:32.076695 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:49:32.076695 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 612/1217] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:49:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:49:32.081059 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99215024-75c4-4280-b1df-c2276a6841bd None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:32.208605 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99215024-75c4-4280-b1df-c2276a6841bd None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:32.239020 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:32.257568 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5e394-b88d-48ab-b3ae-2b1b1bb8424e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:32.258517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5e394-b88d-48ab-b3ae-2b1b1bb8424e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:32.258888 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5e394-b88d-48ab-b3ae-2b1b1bb8424e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:32.259428 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5e394-b88d-48ab-b3ae-2b1b1bb8424e None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:32.260420 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc5e394-b88d-48ab-b3ae-2b1b1bb8424e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:49:32.260939 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc5e394-b88d-48ab-b3ae-2b1b1bb8424e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:32.262932 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc5e394-b88d-48ab-b3ae-2b1b1bb8424e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:32.276823 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 606/1218] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 30 15:49:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:49:32.282728 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd623cbc-622b-459b-9df4-229bbf94d617 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:32.412154 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd623cbc-622b-459b-9df4-229bbf94d617 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:32.449924 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:32.457351 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76615ee-6f45-48fa-a80e-de7a03199c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:32.458089 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76615ee-6f45-48fa-a80e-de7a03199c8c None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:32.458408 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76615ee-6f45-48fa-a80e-de7a03199c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:32.458705 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76615ee-6f45-48fa-a80e-de7a03199c8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:32.459582 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76615ee-6f45-48fa-a80e-de7a03199c8c None admin] RBAC: Adding query filter params (role.id=c99e31de7c4c47c7b7b2c45c2771ca58, scope.project.id=51f312b4cd8b449aa2971993f68de9af, user.id=2bba851e1a0d4601b5d4841662f645dc) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:49:32.459948 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76615ee-6f45-48fa-a80e-de7a03199c8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:32.461752 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76615ee-6f45-48fa-a80e-de7a03199c8c None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:32.470928 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 613/1219] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:49:32 2022] GET /identity/v3/role_assignments?user.id=2bba851e1a0d4601b5d4841662f645dc&scope.project.id=51f312b4cd8b449aa2971993f68de9af&role.id=c99e31de7c4c47c7b7b2c45c2771ca58 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:49:34.594420 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2324c-d25c-43a4-8dd7-737e236142f4 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:34.595094 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2324c-d25c-43a4-8dd7-737e236142f4 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:34.595197 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2324c-d25c-43a4-8dd7-737e236142f4 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:34.596642 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 607/1220] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:49:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:49:34.602258 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fd1cd-6f6d-4c9c-8f52-c4eaf660a239 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:34.602751 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fd1cd-6f6d-4c9c-8f52-c4eaf660a239 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:34.602838 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fd1cd-6f6d-4c9c-8f52-c4eaf660a239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:34.622301 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-807fd1cd-6f6d-4c9c-8f52-c4eaf660a239 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:49:34.623537 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-807fd1cd-6f6d-4c9c-8f52-c4eaf660a239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:49:34.700176 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 614/1221] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:49:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:49:34.986297 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2324c-d25c-43a4-8dd7-737e236142f4 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:35.099280 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2324c-d25c-43a4-8dd7-737e236142f4 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:35.139258 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9a327-0188-4230-91bd-37775b65277b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:35.139896 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9a327-0188-4230-91bd-37775b65277b None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:35.140174 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9a327-0188-4230-91bd-37775b65277b None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:35.140444 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9a327-0188-4230-91bd-37775b65277b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:35.152214 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9a327-0188-4230-91bd-37775b65277b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:49:35.157445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-a0f9a327-0188-4230-91bd-37775b65277b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 15:49:35.157445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:49:35.157445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:49:35.157445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:49:35.157445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:49:35.157445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:49:35.157445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:49:35.157445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:49:35.157445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:49:35.157445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:49:35.157445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:49:35.157445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:49:35.157445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:49:35.157445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:49:35.157445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:49:35.157445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:49:35.158640 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:49:35.158640 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:49:35.158640 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:49:35.158640 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:49:35.158640 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:49:35.158640 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:49:35.158640 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:49:35.158640 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:49:35.158640 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:49:35.158640 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:49:35.158640 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:49:35.158640 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:49:35.158640 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:49:35.158640 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:49:35.158640 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:49:35.158640 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:49:35.159577 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:49:35.159577 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:49:35.159577 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:49:35.159577 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:49:35.159577 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:49:35.159577 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:49:35.159577 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:49:35.159577 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:49:35.159577 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:49:35.159577 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:49:35.159577 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 15:49:35.159577 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:49:35.159577 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 608/1222] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 30 15:49:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:49:35.166231 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fd1cd-6f6d-4c9c-8f52-c4eaf660a239 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:35.275404 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fd1cd-6f6d-4c9c-8f52-c4eaf660a239 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:35.302261 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:35.315632 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aefec7-3663-4bc1-bd46-7a4f830e6153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:35.316433 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aefec7-3663-4bc1-bd46-7a4f830e6153 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:35.316947 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aefec7-3663-4bc1-bd46-7a4f830e6153 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:35.317395 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aefec7-3663-4bc1-bd46-7a4f830e6153 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:35.318256 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aefec7-3663-4bc1-bd46-7a4f830e6153 None admin] RBAC: Adding query filter params (name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:49:35.318612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aefec7-3663-4bc1-bd46-7a4f830e6153 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:35.320269 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aefec7-3663-4bc1-bd46-7a4f830e6153 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:35.330909 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 615/1223] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Aug 30 15:49:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:49:35.337485 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9a327-0188-4230-91bd-37775b65277b None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:35.391070 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:35.461889 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9a327-0188-4230-91bd-37775b65277b None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:35.501069 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8c733-c176-4fbe-a9e5-2e9b13f0da99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:35.501707 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8c733-c176-4fbe-a9e5-2e9b13f0da99 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:35.501983 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8c733-c176-4fbe-a9e5-2e9b13f0da99 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:35.502255 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8c733-c176-4fbe-a9e5-2e9b13f0da99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:35.515440 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8c733-c176-4fbe-a9e5-2e9b13f0da99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:35.517270 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8c733-c176-4fbe-a9e5-2e9b13f0da99 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:35.537348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-f7c8c733-c176-4fbe-a9e5-2e9b13f0da99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:49:35.537348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:49:35.537348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:49:35.537348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:49:35.537348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:49:35.537348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:49:35.537348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:49:35.537348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:49:35.537348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:49:35.537348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:49:35.537348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:49:35.537348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:49:35.537348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:49:35.537348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:49:35.537348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:49:35.537348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:49:35.538476 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:49:35.538476 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:49:35.538476 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:49:35.538476 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:49:35.538476 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:49:35.538476 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:49:35.538476 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:49:35.538476 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:49:35.538476 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:49:35.538476 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:49:35.538476 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:49:35.538476 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:49:35.538476 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:49:35.538476 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:49:35.538476 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:49:35.538476 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:49:35.538476 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:49:35.539359 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:49:35.539359 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:49:35.539359 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:49:35.539359 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 609/1224] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:49:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:49:35.544537 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aefec7-3663-4bc1-bd46-7a4f830e6153 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:35.669856 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aefec7-3663-4bc1-bd46-7a4f830e6153 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:35.711038 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771869ff-cf87-49a3-8bc5-ccf99cdfea6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:35.711694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771869ff-cf87-49a3-8bc5-ccf99cdfea6e None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:35.711992 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771869ff-cf87-49a3-8bc5-ccf99cdfea6e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:35.712298 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771869ff-cf87-49a3-8bc5-ccf99cdfea6e None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:35.713021 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771869ff-cf87-49a3-8bc5-ccf99cdfea6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:49:35.713368 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771869ff-cf87-49a3-8bc5-ccf99cdfea6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:35.715096 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771869ff-cf87-49a3-8bc5-ccf99cdfea6e None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:35.731573 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 616/1225] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:49:35.737651 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8c733-c176-4fbe-a9e5-2e9b13f0da99 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:35.847450 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:35.855309 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8c733-c176-4fbe-a9e5-2e9b13f0da99 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:35.893888 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db810653-ea29-4ada-9491-9f961d045074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:35.894522 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db810653-ea29-4ada-9491-9f961d045074 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:35.894890 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db810653-ea29-4ada-9491-9f961d045074 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:35.895382 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db810653-ea29-4ada-9491-9f961d045074 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:35.903749 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db810653-ea29-4ada-9491-9f961d045074 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:35.905295 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db810653-ea29-4ada-9491-9f961d045074 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:35.918576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-db810653-ea29-4ada-9491-9f961d045074 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 15:49:35.918576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:49:35.918576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:49:35.918576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:49:35.918576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:49:35.918576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:49:35.918576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:49:35.918576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:49:35.918576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:49:35.918576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:49:35.918576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:49:35.918576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:49:35.918576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 15:49:35.918576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 15:49:35.918576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 15:49:35.918576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 15:49:35.919801 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:49:35.919801 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:49:35.919801 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 15:49:35.919801 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:49:35.919801 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 15:49:35.919801 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:49:35.919801 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:49:35.919801 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:49:35.919801 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:49:35.919801 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:49:35.919801 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:49:35.919801 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:49:35.919801 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:49:35.919801 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:49:35.919801 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:49:35.919801 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:49:35.919801 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:49:35.919801 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:49:35.920805 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:49:35.920805 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:49:35.920805 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 15:49:35.920805 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 15:49:35.920805 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 15:49:35.920805 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 15:49:35.920805 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 15:49:35.920805 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 15:49:35.920805 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 15:49:35.920805 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:49:35.920805 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 610/1226] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:49:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 15:49:35.926404 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771869ff-cf87-49a3-8bc5-ccf99cdfea6e None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:35.984160 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:36.048427 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771869ff-cf87-49a3-8bc5-ccf99cdfea6e None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:36.088484 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872be06-4a58-475a-9543-005deb15eea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:36.089138 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872be06-4a58-475a-9543-005deb15eea5 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:36.089465 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872be06-4a58-475a-9543-005deb15eea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:36.089733 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872be06-4a58-475a-9543-005deb15eea5 None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:36.090534 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a872be06-4a58-475a-9543-005deb15eea5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:49:36.090892 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a872be06-4a58-475a-9543-005deb15eea5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:36.092531 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a872be06-4a58-475a-9543-005deb15eea5 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:36.116942 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 617/1227] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Aug 30 15:49:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:49:36.123002 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db810653-ea29-4ada-9491-9f961d045074 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:36.245392 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db810653-ea29-4ada-9491-9f961d045074 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:36.290333 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154b21b-5683-40cc-b538-bee03171e6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:36.290972 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154b21b-5683-40cc-b538-bee03171e6c1 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:36.291251 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154b21b-5683-40cc-b538-bee03171e6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:36.291523 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154b21b-5683-40cc-b538-bee03171e6c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:36.303826 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b154b21b-5683-40cc-b538-bee03171e6c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:36.305390 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b154b21b-5683-40cc-b538-bee03171e6c1 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:36.320427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-b154b21b-5683-40cc-b538-bee03171e6c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:49:36.320427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:49:36.320427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:49:36.320427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:49:36.320427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:49:36.320427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:49:36.320427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:49:36.320427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:49:36.320427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:49:36.320427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:49:36.320427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:49:36.320427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:49:36.320427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:49:36.320427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:49:36.320427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:49:36.320427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:49:36.321645 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:49:36.321645 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:49:36.321645 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:49:36.321645 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:49:36.321645 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:49:36.321645 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:49:36.321645 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:49:36.321645 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:49:36.321645 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:49:36.321645 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:49:36.321645 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:49:36.321645 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:49:36.321645 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:49:36.321645 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:49:36.321645 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:49:36.321645 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:49:36.321645 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:49:36.322744 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:49:36.322744 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:49:36.322744 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:49:36.322744 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 611/1228] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:49:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:49:36.327581 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872be06-4a58-475a-9543-005deb15eea5 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:36.446051 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872be06-4a58-475a-9543-005deb15eea5 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:36.449215 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:36.485463 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564e634-f974-4e26-8dd9-ce7a931aeac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:36.486148 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564e634-f974-4e26-8dd9-ce7a931aeac7 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:36.486467 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564e634-f974-4e26-8dd9-ce7a931aeac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:36.486839 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564e634-f974-4e26-8dd9-ce7a931aeac7 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:36.487459 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564e634-f974-4e26-8dd9-ce7a931aeac7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:49:36.487753 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564e634-f974-4e26-8dd9-ce7a931aeac7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:36.489794 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564e634-f974-4e26-8dd9-ce7a931aeac7 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:36.502735 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 618/1229] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:49:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:49:36.508853 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154b21b-5683-40cc-b538-bee03171e6c1 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:36.518665 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:36.623789 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154b21b-5683-40cc-b538-bee03171e6c1 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:36.659158 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad909c-5842-402c-ae03-78dc021b2d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:36.659796 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad909c-5842-402c-ae03-78dc021b2d65 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:36.660696 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad909c-5842-402c-ae03-78dc021b2d65 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:36.661138 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad909c-5842-402c-ae03-78dc021b2d65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:36.668243 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad909c-5842-402c-ae03-78dc021b2d65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:36.669823 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad909c-5842-402c-ae03-78dc021b2d65 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:36.682262 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-6fad909c-5842-402c-ae03-78dc021b2d65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:49:36.682262 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:49:36.682262 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:49:36.682262 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:49:36.682262 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:49:36.682262 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:49:36.682262 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:49:36.682262 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:49:36.682262 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:49:36.682262 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:49:36.682262 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:49:36.682262 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:49:36.682262 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 15:49:36.682262 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 15:49:36.682262 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 15:49:36.683208 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 15:49:36.683208 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:49:36.683208 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:49:36.683208 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:49:36.683208 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:49:36.683208 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:49:36.683208 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:49:36.683208 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:49:36.683208 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:49:36.683208 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:49:36.683208 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:49:36.683208 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:49:36.683208 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:49:36.683208 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:49:36.683208 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:49:36.683208 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:49:36.683208 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:49:36.684331 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 15:49:36.684331 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 15:49:36.684331 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 15:49:36.684331 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 15:49:36.684331 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 15:49:36.684331 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 15:49:36.684331 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:49:36.684331 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:49:36.684331 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 612/1230] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:49:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:49:36.689781 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564e634-f974-4e26-8dd9-ce7a931aeac7 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:36.804393 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564e634-f974-4e26-8dd9-ce7a931aeac7 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:36.839278 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12784259-db4b-49c6-b1ec-d7f6880a60e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:36.839899 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12784259-db4b-49c6-b1ec-d7f6880a60e2 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:36.840177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12784259-db4b-49c6-b1ec-d7f6880a60e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:36.840443 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12784259-db4b-49c6-b1ec-d7f6880a60e2 None admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:36.841176 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12784259-db4b-49c6-b1ec-d7f6880a60e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:49:36.841476 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12784259-db4b-49c6-b1ec-d7f6880a60e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:36.842897 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12784259-db4b-49c6-b1ec-d7f6880a60e2 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:36.856329 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 619/1231] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 30 15:49:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:49:36.862362 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad909c-5842-402c-ae03-78dc021b2d65 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:36.934740 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:36.973519 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad909c-5842-402c-ae03-78dc021b2d65 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:37.009362 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791feca-cf1c-427d-9ced-6d5d75f71ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:37.009985 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791feca-cf1c-427d-9ced-6d5d75f71ee9 None admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:37.010237 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791feca-cf1c-427d-9ced-6d5d75f71ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:37.010514 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791feca-cf1c-427d-9ced-6d5d75f71ee9 None admin] PATH_INFO: `/v3/projects/51f312b4cd8b449aa2971993f68de9af/users/2bba851e1a0d4601b5d4841662f645dc/roles/c99e31de7c4c47c7b7b2c45c2771ca58` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:37.026391 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791feca-cf1c-427d-9ced-6d5d75f71ee9 None admin] RBAC: Authorizing `identity:create_grant(project_id=51f312b4cd8b449aa2971993f68de9af, user_id=2bba851e1a0d4601b5d4841662f645dc, role_id=c99e31de7c4c47c7b7b2c45c2771ca58)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:37.028601 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791feca-cf1c-427d-9ced-6d5d75f71ee9 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:37.041466 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 613/1232] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 30 15:49:36 2022] PUT /identity/v3/projects/51f312b4cd8b449aa2971993f68de9af/users/2bba851e1a0d4601b5d4841662f645dc/roles/c99e31de7c4c47c7b7b2c45c2771ca58 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:49:39.134289 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2360d37-8058-45bb-9592-37eebfaba984 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:39.134878 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2360d37-8058-45bb-9592-37eebfaba984 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:39.134878 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2360d37-8058-45bb-9592-37eebfaba984 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:39.136579 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 620/1233] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:49:39.143238 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171a618-57b6-414f-a66e-b0d5b885dc13 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:39.143776 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171a618-57b6-414f-a66e-b0d5b885dc13 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:39.143930 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171a618-57b6-414f-a66e-b0d5b885dc13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:39.167224 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-7171a618-57b6-414f-a66e-b0d5b885dc13 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:49:39.168422 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-7171a618-57b6-414f-a66e-b0d5b885dc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:49:39.256272 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 614/1234] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:49:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:49:39.538592 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2360d37-8058-45bb-9592-37eebfaba984 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:39.566092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:39.656206 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2360d37-8058-45bb-9592-37eebfaba984 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:39.701993 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f283d6-039b-4a2e-9bf2-4cadc3326a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:39.702950 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f283d6-039b-4a2e-9bf2-4cadc3326a92 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:39.703230 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f283d6-039b-4a2e-9bf2-4cadc3326a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:39.703504 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f283d6-039b-4a2e-9bf2-4cadc3326a92 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:39.717696 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f283d6-039b-4a2e-9bf2-4cadc3326a92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:49:39.724297 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-b9f283d6-039b-4a2e-9bf2-4cadc3326a92 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 15:49:39.724297 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:49:39.724297 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:49:39.724297 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:49:39.724297 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:49:39.724297 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:49:39.724297 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:49:39.724297 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:49:39.724297 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:49:39.724297 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:49:39.724297 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:49:39.724297 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:49:39.724297 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:49:39.724297 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:49:39.724297 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:49:39.724297 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:49:39.725271 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:49:39.725271 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:49:39.725271 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:49:39.725271 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:49:39.725271 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:49:39.725271 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:49:39.725271 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:49:39.725271 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:49:39.725271 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:49:39.725271 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:49:39.725271 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:49:39.725271 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:49:39.725271 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:49:39.725271 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:49:39.725271 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:49:39.725271 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:49:39.726138 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:49:39.726138 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:49:39.726138 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:49:39.726138 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:49:39.726138 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:49:39.726138 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:49:39.726138 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:49:39.726138 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:49:39.726138 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:49:39.726138 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:49:39.726138 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 15:49:39.726138 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:49:39.726138 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 621/1235] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 30 15:49:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:49:39.732020 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171a618-57b6-414f-a66e-b0d5b885dc13 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:39.795034 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:39.862912 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171a618-57b6-414f-a66e-b0d5b885dc13 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:39.903354 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec49e7d-159a-4cde-b53c-7b8aa3c78ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:39.903974 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec49e7d-159a-4cde-b53c-7b8aa3c78ed6 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:39.904259 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec49e7d-159a-4cde-b53c-7b8aa3c78ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:39.904530 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec49e7d-159a-4cde-b53c-7b8aa3c78ed6 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:39.905241 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec49e7d-159a-4cde-b53c-7b8aa3c78ed6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:49:39.905547 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec49e7d-159a-4cde-b53c-7b8aa3c78ed6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:39.906928 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec49e7d-159a-4cde-b53c-7b8aa3c78ed6 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:39.918011 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 615/1236] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Aug 30 15:49:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:49:39.923515 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f283d6-039b-4a2e-9bf2-4cadc3326a92 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:40.033654 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:40.052765 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f283d6-039b-4a2e-9bf2-4cadc3326a92 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:40.099598 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75397c40-dc74-4c7a-885b-8cd2bc60c0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:40.100495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75397c40-dc74-4c7a-885b-8cd2bc60c0cd None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:40.101055 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75397c40-dc74-4c7a-885b-8cd2bc60c0cd None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:40.101372 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75397c40-dc74-4c7a-885b-8cd2bc60c0cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:40.116526 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75397c40-dc74-4c7a-885b-8cd2bc60c0cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:40.118766 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75397c40-dc74-4c7a-885b-8cd2bc60c0cd None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:40.141614 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-75397c40-dc74-4c7a-885b-8cd2bc60c0cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:49:40.141614 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:49:40.141614 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:49:40.141614 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:49:40.141614 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:49:40.141614 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:49:40.141614 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:49:40.141614 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:49:40.141614 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:49:40.141614 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:49:40.141614 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:49:40.141614 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:49:40.141614 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:49:40.141614 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:49:40.141614 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:49:40.141614 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:49:40.143544 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:49:40.143544 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:49:40.143544 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:49:40.143544 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:49:40.143544 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:49:40.143544 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:49:40.143544 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:49:40.143544 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:49:40.143544 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:49:40.143544 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:49:40.143544 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:49:40.143544 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:49:40.143544 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:49:40.143544 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:49:40.143544 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:49:40.143544 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:49:40.143544 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:49:40.145505 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:49:40.145505 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:49:40.145505 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:49:40.145505 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 622/1237] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:49:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:49:40.150767 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec49e7d-159a-4cde-b53c-7b8aa3c78ed6 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:40.261249 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec49e7d-159a-4cde-b53c-7b8aa3c78ed6 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:40.271867 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:40.298197 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3170e9d-4518-4172-b752-139d287d04d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:40.298810 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3170e9d-4518-4172-b752-139d287d04d7 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:40.299084 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3170e9d-4518-4172-b752-139d287d04d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:40.299356 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3170e9d-4518-4172-b752-139d287d04d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:40.300004 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3170e9d-4518-4172-b752-139d287d04d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:49:40.300311 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3170e9d-4518-4172-b752-139d287d04d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:40.302881 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3170e9d-4518-4172-b752-139d287d04d7 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:40.315045 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 616/1238] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:49:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:49:40.321760 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75397c40-dc74-4c7a-885b-8cd2bc60c0cd None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:40.438735 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75397c40-dc74-4c7a-885b-8cd2bc60c0cd None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:40.475844 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83b36e-8402-4366-b97f-a59025c18bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:40.476475 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83b36e-8402-4366-b97f-a59025c18bab None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:40.476796 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83b36e-8402-4366-b97f-a59025c18bab None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:40.477095 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83b36e-8402-4366-b97f-a59025c18bab None admin] PATH_INFO: `/v3/users/placement` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:40.480272 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:40.487056 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83b36e-8402-4366-b97f-a59025c18bab None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:40.489498 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83b36e-8402-4366-b97f-a59025c18bab None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:40.503381 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-3c83b36e-8402-4366-b97f-a59025c18bab None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 15:49:40.503381 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:49:40.503381 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:49:40.503381 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:49:40.503381 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:49:40.503381 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:49:40.503381 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:49:40.503381 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:49:40.503381 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:49:40.503381 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:49:40.503381 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:49:40.503381 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:49:40.503381 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 15:49:40.503381 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 15:49:40.503381 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 15:49:40.503381 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 15:49:40.505205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:49:40.505205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:49:40.505205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 15:49:40.505205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:49:40.505205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 15:49:40.505205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:49:40.505205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:49:40.505205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:49:40.505205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:49:40.505205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:49:40.505205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:49:40.505205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:49:40.505205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:49:40.505205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:49:40.505205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:49:40.505205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:49:40.505205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:49:40.505205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:49:40.506347 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:49:40.506347 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:49:40.506347 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 15:49:40.506347 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 15:49:40.506347 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 15:49:40.506347 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 15:49:40.506347 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 15:49:40.506347 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 15:49:40.506347 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 15:49:40.506347 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:49:40.506347 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 623/1239] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:49:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:49:40.512085 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3170e9d-4518-4172-b752-139d287d04d7 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:40.636338 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3170e9d-4518-4172-b752-139d287d04d7 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:40.680022 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67254c-faaa-4631-bb0e-0436e056d20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:40.680632 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67254c-faaa-4631-bb0e-0436e056d20c None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:40.680945 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67254c-faaa-4631-bb0e-0436e056d20c None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:40.681234 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67254c-faaa-4631-bb0e-0436e056d20c None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:40.682107 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a67254c-faaa-4631-bb0e-0436e056d20c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:49:40.682436 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a67254c-faaa-4631-bb0e-0436e056d20c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:40.684359 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a67254c-faaa-4631-bb0e-0436e056d20c None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:40.705385 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 617/1240] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Aug 30 15:49:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:49:40.712245 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83b36e-8402-4366-b97f-a59025c18bab None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:40.828577 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83b36e-8402-4366-b97f-a59025c18bab None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:40.868650 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526956a4-fa3e-46db-92bc-40495e88bfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:40.869382 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526956a4-fa3e-46db-92bc-40495e88bfd0 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:40.869673 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526956a4-fa3e-46db-92bc-40495e88bfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:40.869965 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526956a4-fa3e-46db-92bc-40495e88bfd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:40.945532 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:40.952392 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526956a4-fa3e-46db-92bc-40495e88bfd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:40.953893 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526956a4-fa3e-46db-92bc-40495e88bfd0 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:41.060389 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 624/1241] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:49:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 15:49:41.066677 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67254c-faaa-4631-bb0e-0436e056d20c None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:41.099093 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:41.202347 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67254c-faaa-4631-bb0e-0436e056d20c None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:41.248660 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12920530-b095-425e-a409-365a41374f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:41.249438 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12920530-b095-425e-a409-365a41374f92 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:41.249636 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12920530-b095-425e-a409-365a41374f92 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:41.249916 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12920530-b095-425e-a409-365a41374f92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:41.262201 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12920530-b095-425e-a409-365a41374f92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:41.264247 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12920530-b095-425e-a409-365a41374f92 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:41.281574 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-12920530-b095-425e-a409-365a41374f92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:49:41.281574 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:49:41.281574 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:49:41.281574 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:49:41.281574 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:49:41.281574 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:49:41.281574 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:49:41.281574 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:49:41.281574 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:49:41.281574 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:49:41.281574 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:49:41.281574 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:49:41.281574 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:49:41.281574 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:49:41.281574 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:49:41.281574 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:49:41.282872 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:49:41.282872 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:49:41.282872 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:49:41.282872 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:49:41.282872 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:49:41.282872 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:49:41.282872 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:49:41.282872 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:49:41.282872 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:49:41.282872 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:49:41.282872 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:49:41.282872 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:49:41.282872 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:49:41.282872 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:49:41.282872 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:49:41.282872 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:49:41.282872 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:49:41.283926 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:49:41.283926 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:49:41.283926 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:49:41.283926 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 618/1242] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:49:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:49:41.289231 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526956a4-fa3e-46db-92bc-40495e88bfd0 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:41.400480 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:41.407470 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526956a4-fa3e-46db-92bc-40495e88bfd0 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:41.447414 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b546e-70b3-44db-a617-6d66a4fc9127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:41.448181 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b546e-70b3-44db-a617-6d66a4fc9127 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:41.448459 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b546e-70b3-44db-a617-6d66a4fc9127 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:41.448732 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b546e-70b3-44db-a617-6d66a4fc9127 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:41.449402 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b546e-70b3-44db-a617-6d66a4fc9127 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:49:41.449703 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b546e-70b3-44db-a617-6d66a4fc9127 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:41.451061 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b546e-70b3-44db-a617-6d66a4fc9127 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:41.464839 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 625/1243] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:49:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:49:41.470028 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12920530-b095-425e-a409-365a41374f92 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:41.563114 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:41.591187 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12920530-b095-425e-a409-365a41374f92 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:41.629690 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5d899-bd66-46c0-9087-4d77a8c692db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:41.630644 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5d899-bd66-46c0-9087-4d77a8c692db None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:41.630957 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5d899-bd66-46c0-9087-4d77a8c692db None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:41.631229 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5d899-bd66-46c0-9087-4d77a8c692db None admin] PATH_INFO: `/v3/projects/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:41.639437 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a5d899-bd66-46c0-9087-4d77a8c692db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:41.640958 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a5d899-bd66-46c0-9087-4d77a8c692db None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:41.654141 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-c7a5d899-bd66-46c0-9087-4d77a8c692db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:49:41.654141 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:49:41.654141 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:49:41.654141 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:49:41.654141 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:49:41.654141 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:49:41.654141 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:49:41.654141 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:49:41.654141 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:49:41.654141 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:49:41.654141 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:49:41.654141 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:49:41.654141 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 15:49:41.654141 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 15:49:41.654141 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 15:49:41.655230 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 15:49:41.655230 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:49:41.655230 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:49:41.655230 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:49:41.655230 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:49:41.655230 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:49:41.655230 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:49:41.655230 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:49:41.655230 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:49:41.655230 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:49:41.655230 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:49:41.655230 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:49:41.655230 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:49:41.655230 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:49:41.655230 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:49:41.655230 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:49:41.655230 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:49:41.656255 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 15:49:41.656255 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 15:49:41.656255 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 15:49:41.656255 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 15:49:41.656255 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 15:49:41.656255 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 15:49:41.656255 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:49:41.656255 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:49:41.656255 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 619/1244] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:49:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 15:49:41.661354 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b546e-70b3-44db-a617-6d66a4fc9127 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:41.790681 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b546e-70b3-44db-a617-6d66a4fc9127 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:41.828896 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8930d6-b530-4cbd-841f-d991673909e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:41.829555 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8930d6-b530-4cbd-841f-d991673909e6 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:41.829940 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8930d6-b530-4cbd-841f-d991673909e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:41.830185 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8930d6-b530-4cbd-841f-d991673909e6 None admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:41.830936 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8930d6-b530-4cbd-841f-d991673909e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:49:41.831358 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8930d6-b530-4cbd-841f-d991673909e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:41.833959 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8930d6-b530-4cbd-841f-d991673909e6 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:41.848381 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 626/1245] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 30 15:49:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:49:41.854791 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5d899-bd66-46c0-9087-4d77a8c692db None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:41.975113 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5d899-bd66-46c0-9087-4d77a8c692db None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:42.022982 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01fe4b-2938-4ea2-b725-4bc71e72f4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:42.023745 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01fe4b-2938-4ea2-b725-4bc71e72f4a4 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:42.024055 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01fe4b-2938-4ea2-b725-4bc71e72f4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:42.024275 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01fe4b-2938-4ea2-b725-4bc71e72f4a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:42.025253 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da01fe4b-2938-4ea2-b725-4bc71e72f4a4 None admin] RBAC: Adding query filter params (role.id=c99e31de7c4c47c7b7b2c45c2771ca58, scope.project.id=51f312b4cd8b449aa2971993f68de9af, user.id=2bba851e1a0d4601b5d4841662f645dc) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:49:42.025553 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da01fe4b-2938-4ea2-b725-4bc71e72f4a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:42.027017 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da01fe4b-2938-4ea2-b725-4bc71e72f4a4 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:42.033955 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 620/1246] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:49:41 2022] GET /identity/v3/role_assignments?user.id=2bba851e1a0d4601b5d4841662f645dc&scope.project.id=51f312b4cd8b449aa2971993f68de9af&role.id=c99e31de7c4c47c7b7b2c45c2771ca58 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:49:44.031649 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098d590-51f6-4b84-81b9-03c0d449e3a2 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:44.032170 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098d590-51f6-4b84-81b9-03c0d449e3a2 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:44.032170 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098d590-51f6-4b84-81b9-03c0d449e3a2 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:44.033527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 627/1247] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 15:49:44.040768 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5a8e1-4758-43ec-9494-6f47ff14c4db None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:44.041269 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5a8e1-4758-43ec-9494-6f47ff14c4db None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:44.041612 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5a8e1-4758-43ec-9494-6f47ff14c4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:44.050036 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:44.067872 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-b5e5a8e1-4758-43ec-9494-6f47ff14c4db None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:49:44.069376 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-b5e5a8e1-4758-43ec-9494-6f47ff14c4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:49:44.152956 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 621/1248] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:49:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:49:44.430489 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098d590-51f6-4b84-81b9-03c0d449e3a2 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:44.452046 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:44.548629 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098d590-51f6-4b84-81b9-03c0d449e3a2 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:44.589235 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40665bb9-608b-4bec-b604-51880525cc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:44.589970 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40665bb9-608b-4bec-b604-51880525cc83 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:44.590274 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40665bb9-608b-4bec-b604-51880525cc83 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:44.590531 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40665bb9-608b-4bec-b604-51880525cc83 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:44.601198 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40665bb9-608b-4bec-b604-51880525cc83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:49:44.606000 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-40665bb9-608b-4bec-b604-51880525cc83 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:49:44.606000 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:49:44.606000 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:49:44.606000 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:49:44.606000 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:49:44.606000 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:49:44.606000 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:49:44.606000 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:49:44.606000 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:49:44.606000 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:49:44.606000 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:49:44.606000 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:49:44.606000 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:49:44.606000 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:49:44.606000 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:49:44.606000 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:49:44.607180 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:49:44.607180 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:49:44.607180 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:49:44.607180 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:49:44.607180 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:49:44.607180 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:49:44.607180 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:49:44.607180 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:49:44.607180 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:49:44.607180 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:49:44.607180 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:49:44.607180 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:49:44.607180 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:49:44.607180 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:49:44.607180 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:49:44.607180 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:49:44.608506 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:49:44.608506 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:49:44.608506 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:49:44.608506 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:49:44.608506 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:49:44.608506 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:49:44.608506 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:49:44.608506 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:49:44.608506 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:49:44.608506 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:49:44.608506 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:49:44.608506 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:49:44.612294 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 628/1249] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 30 15:49:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:49:44.613521 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5a8e1-4758-43ec-9494-6f47ff14c4db None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:44.738061 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5a8e1-4758-43ec-9494-6f47ff14c4db None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:44.774070 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:44.781207 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfadff07-383d-4658-94a5-498f43bc6da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:44.781827 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadff07-383d-4658-94a5-498f43bc6da7 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:44.782111 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadff07-383d-4658-94a5-498f43bc6da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:44.782390 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadff07-383d-4658-94a5-498f43bc6da7 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:44.783063 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfadff07-383d-4658-94a5-498f43bc6da7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:49:44.783430 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfadff07-383d-4658-94a5-498f43bc6da7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:44.784881 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfadff07-383d-4658-94a5-498f43bc6da7 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:44.793017 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 622/1250] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:49:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:49:44.798928 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40665bb9-608b-4bec-b604-51880525cc83 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:44.886346 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:44.917073 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40665bb9-608b-4bec-b604-51880525cc83 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:44.960237 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953a052-057b-4d94-b60d-8e9cce8bd412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:44.960982 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953a052-057b-4d94-b60d-8e9cce8bd412 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:44.961234 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953a052-057b-4d94-b60d-8e9cce8bd412 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:44.961505 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953a052-057b-4d94-b60d-8e9cce8bd412 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:44.972975 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f953a052-057b-4d94-b60d-8e9cce8bd412 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:44.974742 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f953a052-057b-4d94-b60d-8e9cce8bd412 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:44.992177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-f953a052-057b-4d94-b60d-8e9cce8bd412 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:49:44.992177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:49:44.992177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:49:44.992177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:49:44.992177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:49:44.992177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:49:44.992177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:49:44.992177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:49:44.992177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:49:44.992177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:49:44.992177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:49:44.992177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:49:44.992177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:49:44.992177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:49:44.992177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:49:44.992177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:49:44.993186 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:49:44.993186 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:49:44.993186 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:49:44.993186 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:49:44.993186 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:49:44.993186 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:49:44.993186 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:49:44.993186 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:49:44.993186 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:49:44.993186 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:49:44.993186 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:49:44.993186 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:49:44.993186 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:49:44.993186 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:49:44.993186 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:49:44.993186 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:49:44.993186 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:49:44.994085 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:49:44.994085 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:49:44.994085 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:49:44.998761 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 629/1251] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:49:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 15:49:44.999946 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfadff07-383d-4658-94a5-498f43bc6da7 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:45.119009 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfadff07-383d-4658-94a5-498f43bc6da7 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:45.168678 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8319b12-0242-49e9-8162-3bc4e9e34262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:45.169557 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8319b12-0242-49e9-8162-3bc4e9e34262 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:45.169943 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8319b12-0242-49e9-8162-3bc4e9e34262 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:45.170323 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8319b12-0242-49e9-8162-3bc4e9e34262 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:45.171260 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8319b12-0242-49e9-8162-3bc4e9e34262 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:49:45.171621 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8319b12-0242-49e9-8162-3bc4e9e34262 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:45.173419 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8319b12-0242-49e9-8162-3bc4e9e34262 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:45.188704 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 623/1252] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:49:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:49:45.195436 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953a052-057b-4d94-b60d-8e9cce8bd412 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:45.308722 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953a052-057b-4d94-b60d-8e9cce8bd412 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:45.335565 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:45.343892 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d31aec-3d57-4440-b359-ab59b95ea97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:45.344526 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d31aec-3d57-4440-b359-ab59b95ea97a None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:45.344834 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d31aec-3d57-4440-b359-ab59b95ea97a None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:45.345107 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d31aec-3d57-4440-b359-ab59b95ea97a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:45.353417 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d31aec-3d57-4440-b359-ab59b95ea97a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:45.354997 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d31aec-3d57-4440-b359-ab59b95ea97a None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:45.367064 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-d2d31aec-3d57-4440-b359-ab59b95ea97a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 15:49:45.367064 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:49:45.367064 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:49:45.367064 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:49:45.367064 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:49:45.367064 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:49:45.367064 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:49:45.367064 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:49:45.367064 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:49:45.367064 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:49:45.367064 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:49:45.367064 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:49:45.367064 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 15:49:45.367064 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 15:49:45.367064 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 15:49:45.367064 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 15:49:45.368388 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:49:45.368388 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:49:45.368388 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 15:49:45.368388 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:49:45.368388 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 15:49:45.368388 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:49:45.368388 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:49:45.368388 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:49:45.368388 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:49:45.368388 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:49:45.368388 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:49:45.368388 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:49:45.368388 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:49:45.368388 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:49:45.368388 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:49:45.368388 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:49:45.368388 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:49:45.368388 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:49:45.369609 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:49:45.369609 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:49:45.369609 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 15:49:45.369609 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 15:49:45.369609 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 15:49:45.369609 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 15:49:45.369609 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 15:49:45.369609 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 15:49:45.369609 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 15:49:45.369609 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:49:45.369609 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 630/1253] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:49:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 15:49:45.374466 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8319b12-0242-49e9-8162-3bc4e9e34262 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:45.443319 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:45.494231 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8319b12-0242-49e9-8162-3bc4e9e34262 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:45.530386 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4a7e8-6fa2-402d-b4a0-dca4be86b5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:45.530981 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4a7e8-6fa2-402d-b4a0-dca4be86b5d5 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:45.531263 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4a7e8-6fa2-402d-b4a0-dca4be86b5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:45.531536 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4a7e8-6fa2-402d-b4a0-dca4be86b5d5 None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:45.532268 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4a7e8-6fa2-402d-b4a0-dca4be86b5d5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:49:45.532571 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4a7e8-6fa2-402d-b4a0-dca4be86b5d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:45.534056 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4a7e8-6fa2-402d-b4a0-dca4be86b5d5 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:45.555346 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 624/1254] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Aug 30 15:49:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:49:45.561330 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d31aec-3d57-4440-b359-ab59b95ea97a None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:45.684295 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d31aec-3d57-4440-b359-ab59b95ea97a None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:45.723166 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da36ad8-c080-43e3-a8e7-62802a16cef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:45.723798 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da36ad8-c080-43e3-a8e7-62802a16cef2 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:45.724141 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da36ad8-c080-43e3-a8e7-62802a16cef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:45.724334 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da36ad8-c080-43e3-a8e7-62802a16cef2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:45.788712 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:45.803361 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da36ad8-c080-43e3-a8e7-62802a16cef2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:45.804831 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da36ad8-c080-43e3-a8e7-62802a16cef2 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:45.926694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 631/1255] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:49:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 15:49:45.928581 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4a7e8-6fa2-402d-b4a0-dca4be86b5d5 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:46.041650 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4a7e8-6fa2-402d-b4a0-dca4be86b5d5 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:46.057038 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:46.082302 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128901b4-58ac-49f7-a527-d1bef506d461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:46.082945 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128901b4-58ac-49f7-a527-d1bef506d461 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:46.083236 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128901b4-58ac-49f7-a527-d1bef506d461 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:46.083507 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128901b4-58ac-49f7-a527-d1bef506d461 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:46.095737 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128901b4-58ac-49f7-a527-d1bef506d461 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:46.097655 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128901b4-58ac-49f7-a527-d1bef506d461 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:46.113786 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-128901b4-58ac-49f7-a527-d1bef506d461 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:49:46.113786 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:49:46.113786 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:49:46.113786 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:49:46.113786 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:49:46.113786 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:49:46.113786 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:49:46.113786 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:49:46.113786 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:49:46.113786 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:49:46.113786 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:49:46.113786 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:49:46.113786 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:49:46.113786 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:49:46.113786 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:49:46.113786 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:49:46.115103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:49:46.115103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:49:46.115103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:49:46.115103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:49:46.115103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:49:46.115103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:49:46.115103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:49:46.115103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:49:46.115103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:49:46.115103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:49:46.115103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:49:46.115103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:49:46.115103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:49:46.115103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:49:46.115103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:49:46.115103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:49:46.115103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:49:46.116181 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:49:46.116181 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:49:46.116181 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:49:46.120988 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da36ad8-c080-43e3-a8e7-62802a16cef2 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:46.121281 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 625/1256] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:49:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:49:46.218349 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:46.234824 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da36ad8-c080-43e3-a8e7-62802a16cef2 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:46.277314 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f063db3-f7b2-411c-b436-cb6b42248e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:46.277932 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f063db3-f7b2-411c-b436-cb6b42248e11 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:46.278237 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f063db3-f7b2-411c-b436-cb6b42248e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:46.278527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f063db3-f7b2-411c-b436-cb6b42248e11 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:46.279177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f063db3-f7b2-411c-b436-cb6b42248e11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:49:46.279479 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f063db3-f7b2-411c-b436-cb6b42248e11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:46.281037 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f063db3-f7b2-411c-b436-cb6b42248e11 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:46.295643 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 632/1257] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:49:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:49:46.302237 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128901b4-58ac-49f7-a527-d1bef506d461 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:46.413032 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128901b4-58ac-49f7-a527-d1bef506d461 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:46.448373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912c6ff-268c-4d63-88c6-afbb1ef4a66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:46.449050 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912c6ff-268c-4d63-88c6-afbb1ef4a66d None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:46.449331 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912c6ff-268c-4d63-88c6-afbb1ef4a66d None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:46.449599 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912c6ff-268c-4d63-88c6-afbb1ef4a66d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:46.457340 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3912c6ff-268c-4d63-88c6-afbb1ef4a66d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:46.458807 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3912c6ff-268c-4d63-88c6-afbb1ef4a66d None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:46.471001 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-3912c6ff-268c-4d63-88c6-afbb1ef4a66d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:49:46.471001 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:49:46.471001 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:49:46.471001 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:49:46.471001 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:49:46.471001 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:49:46.471001 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:49:46.471001 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:49:46.471001 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:49:46.471001 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:49:46.471001 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:49:46.471001 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:49:46.471001 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 15:49:46.471001 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 15:49:46.471001 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 15:49:46.472130 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 15:49:46.472130 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:49:46.472130 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:49:46.472130 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:49:46.472130 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:49:46.472130 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:49:46.472130 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:49:46.472130 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:49:46.472130 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:49:46.472130 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:49:46.472130 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:49:46.472130 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:49:46.472130 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:49:46.472130 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:49:46.472130 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:49:46.472130 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:49:46.472130 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:49:46.473356 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 15:49:46.473356 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 15:49:46.473356 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 15:49:46.473356 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 15:49:46.473356 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 15:49:46.473356 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 15:49:46.473356 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:49:46.473356 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:49:46.473356 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 626/1258] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:49:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:49:46.478279 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f063db3-f7b2-411c-b436-cb6b42248e11 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:46.588403 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f063db3-f7b2-411c-b436-cb6b42248e11 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:46.624299 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a0486-d2ac-438e-9664-65c3e4c84058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:46.624953 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a0486-d2ac-438e-9664-65c3e4c84058 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:46.625229 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a0486-d2ac-438e-9664-65c3e4c84058 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:46.625499 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a0486-d2ac-438e-9664-65c3e4c84058 None admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:46.626195 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a0486-d2ac-438e-9664-65c3e4c84058 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:49:46.626496 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a0486-d2ac-438e-9664-65c3e4c84058 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:46.627939 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a0486-d2ac-438e-9664-65c3e4c84058 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:46.642130 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 633/1259] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 30 15:49:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:49:46.649013 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912c6ff-268c-4d63-88c6-afbb1ef4a66d None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:46.677755 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:46.757916 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912c6ff-268c-4d63-88c6-afbb1ef4a66d None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:46.792974 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775284c8-ec8a-46c9-8da3-1c6f478864da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:46.793624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775284c8-ec8a-46c9-8da3-1c6f478864da None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:46.793919 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775284c8-ec8a-46c9-8da3-1c6f478864da None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:46.794218 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775284c8-ec8a-46c9-8da3-1c6f478864da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:46.794992 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775284c8-ec8a-46c9-8da3-1c6f478864da None admin] RBAC: Adding query filter params (role.id=676938e69210499ca11ee75dd572d0dc, scope.project.id=51f312b4cd8b449aa2971993f68de9af, user.id=2bba851e1a0d4601b5d4841662f645dc) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:49:46.795322 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775284c8-ec8a-46c9-8da3-1c6f478864da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:46.796877 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775284c8-ec8a-46c9-8da3-1c6f478864da None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:46.803142 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 627/1260] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:49:46 2022] GET /identity/v3/role_assignments?user.id=2bba851e1a0d4601b5d4841662f645dc&scope.project.id=51f312b4cd8b449aa2971993f68de9af&role.id=676938e69210499ca11ee75dd572d0dc => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:49:48.699747 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207c743-bfdd-47ef-98b5-9e5d3277b20c None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:48.700297 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207c743-bfdd-47ef-98b5-9e5d3277b20c None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:48.700297 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207c743-bfdd-47ef-98b5-9e5d3277b20c None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:48.701662 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 634/1261] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:49:48.707185 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147d3d3-2dad-472e-b73f-02f0aa0995ff None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:48.707585 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147d3d3-2dad-472e-b73f-02f0aa0995ff None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:48.707730 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147d3d3-2dad-472e-b73f-02f0aa0995ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:48.726329 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-4147d3d3-2dad-472e-b73f-02f0aa0995ff None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:49:48.727502 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-4147d3d3-2dad-472e-b73f-02f0aa0995ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:49:48.791520 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 628/1262] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:49:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:49:49.088369 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207c743-bfdd-47ef-98b5-9e5d3277b20c None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:49.100975 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:49.199121 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207c743-bfdd-47ef-98b5-9e5d3277b20c None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:49.232012 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f12a6f-6292-4e07-a5fd-7788d46fe86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:49.232623 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f12a6f-6292-4e07-a5fd-7788d46fe86e None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:49.232926 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f12a6f-6292-4e07-a5fd-7788d46fe86e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:49.233197 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f12a6f-6292-4e07-a5fd-7788d46fe86e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:49.243065 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f12a6f-6292-4e07-a5fd-7788d46fe86e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:49:49.247885 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-d1f12a6f-6292-4e07-a5fd-7788d46fe86e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:49:49.247885 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:49:49.247885 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:49:49.247885 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:49:49.247885 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:49:49.247885 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:49:49.247885 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:49:49.247885 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:49:49.247885 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:49:49.247885 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:49:49.247885 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:49:49.247885 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:49:49.247885 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:49:49.247885 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:49:49.247885 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:49:49.247885 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:49:49.248981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:49:49.248981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:49:49.248981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:49:49.248981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:49:49.248981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:49:49.248981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:49:49.248981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:49:49.248981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:49:49.248981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:49:49.248981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:49:49.248981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:49:49.248981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:49:49.248981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:49:49.248981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:49:49.248981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:49:49.248981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:49:49.250007 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:49:49.250007 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:49:49.250007 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:49:49.250007 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:49:49.250007 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:49:49.250007 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:49:49.250007 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:49:49.250007 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:49:49.250007 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:49:49.250007 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:49:49.250007 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:49:49.250007 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:49:49.250007 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 635/1263] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 30 15:49:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:49:49.255894 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147d3d3-2dad-472e-b73f-02f0aa0995ff None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:49.274889 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:49.354999 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147d3d3-2dad-472e-b73f-02f0aa0995ff None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:49.389980 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bfa054-28f7-4530-9cb6-0ea5d875bb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:49.390600 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfa054-28f7-4530-9cb6-0ea5d875bb52 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:49.390882 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfa054-28f7-4530-9cb6-0ea5d875bb52 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:49.391157 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfa054-28f7-4530-9cb6-0ea5d875bb52 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:49.391821 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bfa054-28f7-4530-9cb6-0ea5d875bb52 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:49:49.392124 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bfa054-28f7-4530-9cb6-0ea5d875bb52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:49.393515 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bfa054-28f7-4530-9cb6-0ea5d875bb52 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:49.401489 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 629/1264] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:49:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:49:49.407320 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f12a6f-6292-4e07-a5fd-7788d46fe86e None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:49.472643 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:49.506024 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f12a6f-6292-4e07-a5fd-7788d46fe86e None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:49.538578 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c46d7-ba37-42ee-a7dc-444c74bc5a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:49.539187 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c46d7-ba37-42ee-a7dc-444c74bc5a85 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:49.539463 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c46d7-ba37-42ee-a7dc-444c74bc5a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:49.539727 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c46d7-ba37-42ee-a7dc-444c74bc5a85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:49.549409 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c46d7-ba37-42ee-a7dc-444c74bc5a85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:49.551382 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c46d7-ba37-42ee-a7dc-444c74bc5a85 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:49.565313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-801c46d7-ba37-42ee-a7dc-444c74bc5a85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:49:49.565313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:49:49.565313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:49:49.565313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:49:49.565313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:49:49.565313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:49:49.565313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:49:49.565313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:49:49.565313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:49:49.565313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:49:49.565313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:49:49.565313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:49:49.565313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:49:49.565313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:49:49.565313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:49:49.565313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:49:49.566259 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:49:49.566259 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:49:49.566259 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:49:49.566259 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:49:49.566259 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:49:49.566259 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:49:49.566259 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:49:49.566259 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:49:49.566259 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:49:49.566259 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:49:49.566259 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:49:49.566259 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:49:49.566259 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:49:49.566259 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:49:49.566259 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:49:49.566259 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:49:49.566259 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:49:49.567885 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:49:49.567885 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:49:49.567885 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:49:49.567885 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 636/1265] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:49:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:49:49.572747 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bfa054-28f7-4530-9cb6-0ea5d875bb52 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:49.658155 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:49.678122 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bfa054-28f7-4530-9cb6-0ea5d875bb52 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:49.709532 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d284e714-c881-4d29-a72b-3a6bde47498b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:49.710124 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284e714-c881-4d29-a72b-3a6bde47498b None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:49.710390 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284e714-c881-4d29-a72b-3a6bde47498b None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:49.710657 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284e714-c881-4d29-a72b-3a6bde47498b None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:49.711291 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d284e714-c881-4d29-a72b-3a6bde47498b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:49:49.711588 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d284e714-c881-4d29-a72b-3a6bde47498b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:49.712977 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d284e714-c881-4d29-a72b-3a6bde47498b None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:49.725611 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 630/1266] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:49:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:49:49.731378 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c46d7-ba37-42ee-a7dc-444c74bc5a85 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:49.831355 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c46d7-ba37-42ee-a7dc-444c74bc5a85 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:49.851616 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:49.866566 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896924d-d206-440a-89cd-b1ff4bc74ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:49.867219 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896924d-d206-440a-89cd-b1ff4bc74ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:49.867497 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896924d-d206-440a-89cd-b1ff4bc74ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:49.867767 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896924d-d206-440a-89cd-b1ff4bc74ab8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:49.875403 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896924d-d206-440a-89cd-b1ff4bc74ab8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:49.876897 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896924d-d206-440a-89cd-b1ff4bc74ab8 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:49.888313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-7896924d-d206-440a-89cd-b1ff4bc74ab8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 15:49:49.888313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:49:49.888313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:49:49.888313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:49:49.888313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:49:49.888313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:49:49.888313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:49:49.888313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:49:49.888313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:49:49.888313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:49:49.888313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:49:49.888313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:49:49.888313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 15:49:49.888313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 15:49:49.888313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 15:49:49.888313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 15:49:49.889424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:49:49.889424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:49:49.889424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 15:49:49.889424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:49:49.889424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 15:49:49.889424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:49:49.889424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:49:49.889424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:49:49.889424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:49:49.889424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:49:49.889424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:49:49.889424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:49:49.889424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:49:49.889424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:49:49.889424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:49:49.889424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:49:49.889424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:49:49.889424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:49:49.890493 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:49:49.890493 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:49:49.890493 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 15:49:49.890493 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 15:49:49.890493 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 15:49:49.890493 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 15:49:49.890493 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 15:49:49.890493 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 15:49:49.890493 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 15:49:49.890493 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:49:49.890493 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 637/1267] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:49:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:49:49.895565 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d284e714-c881-4d29-a72b-3a6bde47498b None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:49.993910 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d284e714-c881-4d29-a72b-3a6bde47498b None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:50.027988 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0d3ba-d39f-420b-9824-a43654797651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:50.028588 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0d3ba-d39f-420b-9824-a43654797651 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:50.028897 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0d3ba-d39f-420b-9824-a43654797651 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:50.029175 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0d3ba-d39f-420b-9824-a43654797651 None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:50.029964 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb0d3ba-d39f-420b-9824-a43654797651 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:49:50.030306 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb0d3ba-d39f-420b-9824-a43654797651 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:50.031971 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb0d3ba-d39f-420b-9824-a43654797651 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:50.042227 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:50.051275 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 631/1268] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Aug 30 15:49:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:49:50.056919 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896924d-d206-440a-89cd-b1ff4bc74ab8 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:50.162168 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896924d-d206-440a-89cd-b1ff4bc74ab8 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:50.194796 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb933b-c980-4344-b080-1f7e431efe5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:50.195409 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb933b-c980-4344-b080-1f7e431efe5a None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:50.195683 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb933b-c980-4344-b080-1f7e431efe5a None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:50.195947 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb933b-c980-4344-b080-1f7e431efe5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:50.205971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb933b-c980-4344-b080-1f7e431efe5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:50.207419 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb933b-c980-4344-b080-1f7e431efe5a None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:50.220861 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-98fb933b-c980-4344-b080-1f7e431efe5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:49:50.220861 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:49:50.220861 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:49:50.220861 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:49:50.220861 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:49:50.220861 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:49:50.220861 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:49:50.220861 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:49:50.220861 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:49:50.220861 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:49:50.220861 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:49:50.220861 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:49:50.220861 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:49:50.220861 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:49:50.220861 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:49:50.220861 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:49:50.221971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:49:50.221971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:49:50.221971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:49:50.221971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:49:50.221971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:49:50.221971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:49:50.221971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:49:50.221971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:49:50.221971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:49:50.221971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:49:50.221971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:49:50.221971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:49:50.221971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:49:50.221971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:49:50.221971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:49:50.221971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:49:50.221971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:49:50.223054 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:49:50.223054 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:49:50.223054 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:49:50.223054 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 638/1269] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:49:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:49:50.228111 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0d3ba-d39f-420b-9824-a43654797651 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:50.324111 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0d3ba-d39f-420b-9824-a43654797651 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:50.355694 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ba463-6689-4d96-9d33-dfae23d7c39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:50.356283 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ba463-6689-4d96-9d33-dfae23d7c39b None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:50.356575 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ba463-6689-4d96-9d33-dfae23d7c39b None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:50.356850 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ba463-6689-4d96-9d33-dfae23d7c39b None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:50.357485 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ba463-6689-4d96-9d33-dfae23d7c39b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:49:50.357784 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ba463-6689-4d96-9d33-dfae23d7c39b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:50.359172 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ba463-6689-4d96-9d33-dfae23d7c39b None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:50.370426 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 632/1270] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:49:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:49:50.375995 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb933b-c980-4344-b080-1f7e431efe5a None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:50.408095 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:50.476566 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb933b-c980-4344-b080-1f7e431efe5a None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:50.509951 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f8e19-faf7-4aa4-9529-5f1bb17fc17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:50.510664 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f8e19-faf7-4aa4-9529-5f1bb17fc17a None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:50.510938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f8e19-faf7-4aa4-9529-5f1bb17fc17a None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:50.511206 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f8e19-faf7-4aa4-9529-5f1bb17fc17a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:50.517868 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f8e19-faf7-4aa4-9529-5f1bb17fc17a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:50.519801 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f8e19-faf7-4aa4-9529-5f1bb17fc17a None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:50.530732 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-0f7f8e19-faf7-4aa4-9529-5f1bb17fc17a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:49:50.530732 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:49:50.530732 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:49:50.530732 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:49:50.530732 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:49:50.530732 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:49:50.530732 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:49:50.530732 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:49:50.530732 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:49:50.530732 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:49:50.530732 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:49:50.530732 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:49:50.530732 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 15:49:50.530732 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 15:49:50.530732 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 15:49:50.531769 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 15:49:50.531769 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:49:50.531769 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:49:50.531769 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:49:50.531769 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:49:50.531769 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:49:50.531769 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:49:50.531769 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:49:50.531769 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:49:50.531769 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:49:50.531769 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:49:50.531769 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:49:50.531769 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:49:50.531769 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:49:50.531769 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:49:50.531769 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:49:50.531769 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:49:50.533069 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 15:49:50.533069 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 15:49:50.533069 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 15:49:50.533069 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 15:49:50.533069 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 15:49:50.533069 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 15:49:50.533069 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:49:50.533069 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:49:50.533069 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 639/1271] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:49:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:49:50.538698 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ba463-6689-4d96-9d33-dfae23d7c39b None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:50.594341 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:50.636072 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ba463-6689-4d96-9d33-dfae23d7c39b None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:50.669058 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9348f4-68e9-40f4-9c0e-c53192f1b577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:50.669649 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9348f4-68e9-40f4-9c0e-c53192f1b577 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:50.669925 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9348f4-68e9-40f4-9c0e-c53192f1b577 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:50.670194 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9348f4-68e9-40f4-9c0e-c53192f1b577 None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:50.670876 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9348f4-68e9-40f4-9c0e-c53192f1b577 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:49:50.671176 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9348f4-68e9-40f4-9c0e-c53192f1b577 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:50.672600 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9348f4-68e9-40f4-9c0e-c53192f1b577 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:50.684704 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 633/1272] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 30 15:49:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:49:50.690623 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f8e19-faf7-4aa4-9529-5f1bb17fc17a None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:50.780560 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:50.790100 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f8e19-faf7-4aa4-9529-5f1bb17fc17a None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:50.822506 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db624c-054b-46bd-b0f4-6c1049ae19c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:50.823159 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db624c-054b-46bd-b0f4-6c1049ae19c5 None admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:50.823437 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db624c-054b-46bd-b0f4-6c1049ae19c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:50.823707 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db624c-054b-46bd-b0f4-6c1049ae19c5 None admin] PATH_INFO: `/v3/projects/51f312b4cd8b449aa2971993f68de9af/users/2bba851e1a0d4601b5d4841662f645dc/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:50.825626 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db624c-054b-46bd-b0f4-6c1049ae19c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=51f312b4cd8b449aa2971993f68de9af, user_id=2bba851e1a0d4601b5d4841662f645dc, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:50.827100 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db624c-054b-46bd-b0f4-6c1049ae19c5 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:50.840414 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 640/1273] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 30 15:49:50 2022] PUT /identity/v3/projects/51f312b4cd8b449aa2971993f68de9af/users/2bba851e1a0d4601b5d4841662f645dc/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:49:52.724718 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3d958-4092-4b73-81a5-5ad6d19e7e50 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:52.725211 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3d958-4092-4b73-81a5-5ad6d19e7e50 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:52.725302 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3d958-4092-4b73-81a5-5ad6d19e7e50 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:52.726645 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 634/1274] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:49:52.731834 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e2a36-4c23-4f16-a6de-5728f4fcb4fb None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:52.732220 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e2a36-4c23-4f16-a6de-5728f4fcb4fb None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:52.732386 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e2a36-4c23-4f16-a6de-5728f4fcb4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:52.750860 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-580e2a36-4c23-4f16-a6de-5728f4fcb4fb None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:49:52.752031 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-580e2a36-4c23-4f16-a6de-5728f4fcb4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:49:52.818982 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 641/1275] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:49:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:49:53.095359 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3d958-4092-4b73-81a5-5ad6d19e7e50 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:53.207937 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3d958-4092-4b73-81a5-5ad6d19e7e50 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:53.224491 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:53.241637 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e27d81-9a59-4ffc-90cf-3c588f528477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:53.242262 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e27d81-9a59-4ffc-90cf-3c588f528477 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:53.242537 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e27d81-9a59-4ffc-90cf-3c588f528477 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:53.242802 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e27d81-9a59-4ffc-90cf-3c588f528477 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:53.252447 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e27d81-9a59-4ffc-90cf-3c588f528477 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 15:49:53.258148 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-a6e27d81-9a59-4ffc-90cf-3c588f528477 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:49:53.258148 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:49:53.258148 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:49:53.258148 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:49:53.258148 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:49:53.258148 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:49:53.258148 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:49:53.258148 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:49:53.258148 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:49:53.258148 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:49:53.258148 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:49:53.258148 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:49:53.258148 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 15:49:53.258148 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 15:49:53.258148 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 15:49:53.258148 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 15:49:53.259370 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 15:49:53.259370 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 15:49:53.259370 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 15:49:53.259370 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 15:49:53.259370 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:49:53.259370 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:49:53.259370 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:49:53.259370 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:49:53.259370 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:49:53.259370 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:49:53.259370 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:49:53.259370 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:49:53.259370 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:49:53.259370 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:49:53.259370 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:49:53.259370 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:49:53.260555 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:49:53.260555 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:49:53.260555 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:49:53.260555 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:49:53.260555 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 15:49:53.260555 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 15:49:53.260555 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 15:49:53.260555 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 15:49:53.260555 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 15:49:53.260555 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 15:49:53.260555 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 15:49:53.260555 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:49:53.260555 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 635/1276] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 30 15:49:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:49:53.265523 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e2a36-4c23-4f16-a6de-5728f4fcb4fb None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:53.342940 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:53.361861 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e2a36-4c23-4f16-a6de-5728f4fcb4fb None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:53.396492 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17c8d2-5cef-4888-9ef2-f29b849e42c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:53.397121 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17c8d2-5cef-4888-9ef2-f29b849e42c6 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:53.397400 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17c8d2-5cef-4888-9ef2-f29b849e42c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:53.397666 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17c8d2-5cef-4888-9ef2-f29b849e42c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:53.398322 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf17c8d2-5cef-4888-9ef2-f29b849e42c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:49:53.398619 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf17c8d2-5cef-4888-9ef2-f29b849e42c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:53.399974 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf17c8d2-5cef-4888-9ef2-f29b849e42c6 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:53.407707 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 642/1277] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 30 15:49:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:49:53.414072 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e27d81-9a59-4ffc-90cf-3c588f528477 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:53.514800 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e27d81-9a59-4ffc-90cf-3c588f528477 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:53.548345 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea61f49-b453-4941-bc16-f4e0286598bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:53.549003 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea61f49-b453-4941-bc16-f4e0286598bd None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:53.549282 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea61f49-b453-4941-bc16-f4e0286598bd None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:53.549599 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea61f49-b453-4941-bc16-f4e0286598bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:53.559880 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea61f49-b453-4941-bc16-f4e0286598bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:53.561356 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea61f49-b453-4941-bc16-f4e0286598bd None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:53.575538 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-bea61f49-b453-4941-bc16-f4e0286598bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:49:53.575538 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:49:53.575538 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:49:53.575538 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:49:53.575538 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:49:53.575538 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:49:53.575538 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:49:53.575538 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:49:53.575538 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:49:53.575538 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:49:53.575538 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:49:53.575538 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:49:53.575538 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:49:53.575538 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:49:53.575538 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:49:53.575538 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:49:53.576658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:49:53.576658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:49:53.576658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:49:53.576658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:49:53.576658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:49:53.576658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:49:53.576658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:49:53.576658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:49:53.576658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:49:53.576658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:49:53.576658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:49:53.576658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:49:53.576658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:49:53.576658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:49:53.576658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:49:53.576658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:49:53.576658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:49:53.577631 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:49:53.577631 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:49:53.577631 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:49:53.577631 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 636/1278] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:49:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:49:53.582539 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17c8d2-5cef-4888-9ef2-f29b849e42c6 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:53.680730 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17c8d2-5cef-4888-9ef2-f29b849e42c6 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:53.712586 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e323c24-8d4c-475d-ba7e-7f6d0823acd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:53.713206 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e323c24-8d4c-475d-ba7e-7f6d0823acd3 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:53.713477 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e323c24-8d4c-475d-ba7e-7f6d0823acd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:53.713742 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e323c24-8d4c-475d-ba7e-7f6d0823acd3 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:53.714369 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e323c24-8d4c-475d-ba7e-7f6d0823acd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:49:53.714668 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e323c24-8d4c-475d-ba7e-7f6d0823acd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:53.716007 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e323c24-8d4c-475d-ba7e-7f6d0823acd3 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:53.730352 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 643/1279] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:49:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:49:53.735990 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea61f49-b453-4941-bc16-f4e0286598bd None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:53.766141 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:53.833539 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea61f49-b453-4941-bc16-f4e0286598bd None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:53.866454 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab00175-0633-4e8b-aee8-66e985963d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:53.867090 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab00175-0633-4e8b-aee8-66e985963d44 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:53.867392 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab00175-0633-4e8b-aee8-66e985963d44 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:53.867662 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab00175-0633-4e8b-aee8-66e985963d44 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:53.874913 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab00175-0633-4e8b-aee8-66e985963d44 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:53.876348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab00175-0633-4e8b-aee8-66e985963d44 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:53.887561 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-3ab00175-0633-4e8b-aee8-66e985963d44 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 15:49:53.887561 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:49:53.887561 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:49:53.887561 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:49:53.887561 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:49:53.887561 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:49:53.887561 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:49:53.887561 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:49:53.887561 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:49:53.887561 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:49:53.887561 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:49:53.887561 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:49:53.887561 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 15:49:53.887561 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 15:49:53.887561 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 15:49:53.887561 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 15:49:53.888946 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:49:53.888946 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:49:53.888946 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 15:49:53.888946 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:49:53.888946 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 15:49:53.888946 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 15:49:53.888946 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:49:53.888946 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:49:53.888946 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:49:53.888946 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:49:53.888946 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:49:53.888946 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:49:53.888946 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:49:53.888946 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:49:53.888946 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:49:53.888946 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:49:53.888946 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:49:53.888946 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:49:53.890111 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:49:53.890111 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:49:53.890111 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 15:49:53.890111 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 15:49:53.890111 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 15:49:53.890111 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 15:49:53.890111 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 15:49:53.890111 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 15:49:53.890111 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 15:49:53.890111 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:49:53.890111 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 637/1280] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:49:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:49:53.895181 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e323c24-8d4c-475d-ba7e-7f6d0823acd3 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:53.898987 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:53.992183 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e323c24-8d4c-475d-ba7e-7f6d0823acd3 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:54.025442 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91213652-e444-4fe2-8d2f-5830e8fc38b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:54.026072 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91213652-e444-4fe2-8d2f-5830e8fc38b5 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:54.026370 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91213652-e444-4fe2-8d2f-5830e8fc38b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:54.026659 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91213652-e444-4fe2-8d2f-5830e8fc38b5 None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:54.027376 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91213652-e444-4fe2-8d2f-5830e8fc38b5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:49:54.027679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91213652-e444-4fe2-8d2f-5830e8fc38b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:54.029127 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91213652-e444-4fe2-8d2f-5830e8fc38b5 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:54.046905 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 644/1281] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Aug 30 15:49:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:49:54.052934 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab00175-0633-4e8b-aee8-66e985963d44 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:54.148690 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:54.158460 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab00175-0633-4e8b-aee8-66e985963d44 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:54.191813 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07797571-d59c-45b7-977a-6d49778ad2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:54.192415 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07797571-d59c-45b7-977a-6d49778ad2bd None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:54.192695 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07797571-d59c-45b7-977a-6d49778ad2bd None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:54.192992 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07797571-d59c-45b7-977a-6d49778ad2bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:54.258210 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07797571-d59c-45b7-977a-6d49778ad2bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:54.259604 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07797571-d59c-45b7-977a-6d49778ad2bd None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:54.345206 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:54.356071 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 638/1282] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 30 15:49:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 15:49:54.361948 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91213652-e444-4fe2-8d2f-5830e8fc38b5 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:54.421198 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:54.460352 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91213652-e444-4fe2-8d2f-5830e8fc38b5 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:54.494431 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a450974-2d62-4f9a-97d9-f13c3a7501de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:54.495051 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a450974-2d62-4f9a-97d9-f13c3a7501de None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:54.495331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a450974-2d62-4f9a-97d9-f13c3a7501de None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:54.495601 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a450974-2d62-4f9a-97d9-f13c3a7501de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:54.505841 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a450974-2d62-4f9a-97d9-f13c3a7501de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:54.507277 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a450974-2d62-4f9a-97d9-f13c3a7501de None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:54.522330 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-3a450974-2d62-4f9a-97d9-f13c3a7501de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:49:54.522330 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:49:54.522330 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:49:54.522330 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:49:54.522330 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:49:54.522330 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:49:54.522330 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:49:54.522330 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:49:54.522330 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:49:54.522330 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:49:54.522330 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:49:54.522330 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:49:54.522330 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 15:49:54.522330 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 15:49:54.522330 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 15:49:54.522330 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 15:49:54.523238 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:49:54.523238 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:49:54.523238 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:49:54.523238 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:49:54.523238 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:49:54.523238 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:49:54.523238 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:49:54.523238 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:49:54.523238 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:49:54.523238 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:49:54.523238 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:49:54.523238 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:49:54.523238 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:49:54.523238 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:49:54.523238 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:49:54.523238 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:49:54.523238 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 15:49:54.524243 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 15:49:54.524243 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 15:49:54.524243 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:49:54.524243 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 645/1283] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:49:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:49:54.529122 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07797571-d59c-45b7-977a-6d49778ad2bd None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:54.625241 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07797571-d59c-45b7-977a-6d49778ad2bd None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:54.660732 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff120a41-3d7c-4e78-8fb4-d28e71381b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:54.661403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff120a41-3d7c-4e78-8fb4-d28e71381b91 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:54.661695 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff120a41-3d7c-4e78-8fb4-d28e71381b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:54.661995 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff120a41-3d7c-4e78-8fb4-d28e71381b91 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:54.662681 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff120a41-3d7c-4e78-8fb4-d28e71381b91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:49:54.663005 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff120a41-3d7c-4e78-8fb4-d28e71381b91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:54.664472 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff120a41-3d7c-4e78-8fb4-d28e71381b91 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:54.676355 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 639/1284] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 30 15:49:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:49:54.682116 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a450974-2d62-4f9a-97d9-f13c3a7501de None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:54.780572 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a450974-2d62-4f9a-97d9-f13c3a7501de None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:54.793564 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:54.813829 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f59a6-3e9e-4e41-83db-6c5f3a64c2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:54.814449 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f59a6-3e9e-4e41-83db-6c5f3a64c2c4 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:54.814725 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f59a6-3e9e-4e41-83db-6c5f3a64c2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:54.814994 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f59a6-3e9e-4e41-83db-6c5f3a64c2c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:54.822257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f59a6-3e9e-4e41-83db-6c5f3a64c2c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:54.823689 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f59a6-3e9e-4e41-83db-6c5f3a64c2c4 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:54.834678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-da4f59a6-3e9e-4e41-83db-6c5f3a64c2c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:49:54.834678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:49:54.834678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:49:54.834678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:49:54.834678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:49:54.834678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:49:54.834678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:49:54.834678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:49:54.834678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:49:54.834678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:49:54.834678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:49:54.834678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:49:54.834678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 15:49:54.834678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 15:49:54.834678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 15:49:54.835720 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 15:49:54.835720 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:49:54.835720 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:49:54.835720 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:49:54.835720 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:49:54.835720 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:49:54.835720 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:49:54.835720 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:49:54.835720 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Aug 30 15:49:54.835720 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:49:54.835720 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:49:54.835720 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:49:54.835720 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:49:54.835720 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:49:54.835720 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:49:54.835720 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:49:54.835720 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:49:54.836825 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 15:49:54.836825 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 15:49:54.836825 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 15:49:54.836825 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 15:49:54.836825 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 15:49:54.836825 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 15:49:54.836825 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 15:49:54.836825 dv-cinder-855058-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Aug 30 15:49:54.836825 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 646/1285] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 30 15:49:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:49:54.841998 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff120a41-3d7c-4e78-8fb4-d28e71381b91 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:54.895298 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:54.951295 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff120a41-3d7c-4e78-8fb4-d28e71381b91 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:54.985645 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8284a-117a-4364-b57d-b9eef4f7942e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:54.986246 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8284a-117a-4364-b57d-b9eef4f7942e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:54.986523 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8284a-117a-4364-b57d-b9eef4f7942e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:54.986788 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8284a-117a-4364-b57d-b9eef4f7942e None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:54.988134 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f8284a-117a-4364-b57d-b9eef4f7942e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:49:54.988430 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f8284a-117a-4364-b57d-b9eef4f7942e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:54.989891 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f8284a-117a-4364-b57d-b9eef4f7942e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:55.001462 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 640/1286] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 30 15:49:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:49:55.007671 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f59a6-3e9e-4e41-83db-6c5f3a64c2c4 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:55.111706 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f59a6-3e9e-4e41-83db-6c5f3a64c2c4 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:55.145345 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4df12-bfe7-4285-aceb-263b7c365195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:55.145930 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4df12-bfe7-4285-aceb-263b7c365195 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:55.146203 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4df12-bfe7-4285-aceb-263b7c365195 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:55.146469 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4df12-bfe7-4285-aceb-263b7c365195 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:55.147179 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4df12-bfe7-4285-aceb-263b7c365195 None admin] RBAC: Adding query filter params (role.id=676938e69210499ca11ee75dd572d0dc, scope.project.id=51f312b4cd8b449aa2971993f68de9af, user.id=2bba851e1a0d4601b5d4841662f645dc) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:49:55.147478 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4df12-bfe7-4285-aceb-263b7c365195 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:55.148939 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4df12-bfe7-4285-aceb-263b7c365195 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:55.154407 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 647/1287] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 30 15:49:55 2022] GET /identity/v3/role_assignments?user.id=2bba851e1a0d4601b5d4841662f645dc&scope.project.id=51f312b4cd8b449aa2971993f68de9af&role.id=676938e69210499ca11ee75dd572d0dc => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:49:57.052392 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be63e6-3168-44e4-afbd-294a27ff5623 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:57.052936 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be63e6-3168-44e4-afbd-294a27ff5623 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:57.052936 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be63e6-3168-44e4-afbd-294a27ff5623 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:57.054279 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 641/1288] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:49:57.059256 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9fd94a-83b8-4e7c-9451-0e6e719bb76a None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:57.059623 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9fd94a-83b8-4e7c-9451-0e6e719bb76a None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:57.059809 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9fd94a-83b8-4e7c-9451-0e6e719bb76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:57.078213 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-1f9fd94a-83b8-4e7c-9451-0e6e719bb76a None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:49:57.079387 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-1f9fd94a-83b8-4e7c-9451-0e6e719bb76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:49:57.109467 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:57.147419 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 648/1289] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:49:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:49:57.420714 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be63e6-3168-44e4-afbd-294a27ff5623 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:57.520409 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be63e6-3168-44e4-afbd-294a27ff5623 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:57.530884 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:57.555013 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70281ae3-3cd5-47dd-9999-6881682f61f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:57.555634 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70281ae3-3cd5-47dd-9999-6881682f61f4 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:57.555917 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70281ae3-3cd5-47dd-9999-6881682f61f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:57.556189 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70281ae3-3cd5-47dd-9999-6881682f61f4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:57.556771 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70281ae3-3cd5-47dd-9999-6881682f61f4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:57.558172 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70281ae3-3cd5-47dd-9999-6881682f61f4 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:57.567517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-70281ae3-3cd5-47dd-9999-6881682f61f4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 15:49:57.567517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:49:57.567517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 15:49:57.567517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 15:49:57.567517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 15:49:57.567517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 15:49:57.567517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 15:49:57.567517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:49:57.567517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 15:49:57.567517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:49:57.567517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 15:49:57.567517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:49:57.567517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:49:57.567517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:49:57.567517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:49:57.567517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:49:57.567517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:49:57.568693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:49:57.568693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:49:57.568693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:49:57.568693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:49:57.568693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:49:57.568693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:49:57.568693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 15:49:57.568693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 15:49:57.568693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 15:49:57.568693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 15:49:57.568693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:49:57.568693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:49:57.568693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:49:57.568693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:49:57.568693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:49:57.568693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:49:57.569576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:49:57.569576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:49:57.569576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:49:57.569576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:49:57.569576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:49:57.569576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:49:57.569576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:49:57.569576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:49:57.569576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:49:57.569576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:49:57.569576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 15:49:57.569576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:49:57.569576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 15:49:57.569576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:49:57.569576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 642/1290] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Aug 30 15:49:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:49:57.574569 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9fd94a-83b8-4e7c-9451-0e6e719bb76a None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:57.671909 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9fd94a-83b8-4e7c-9451-0e6e719bb76a None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:57.704087 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63a8fa-8bd7-4943-8597-b684741378b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:57.704686 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63a8fa-8bd7-4943-8597-b684741378b9 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:57.704993 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63a8fa-8bd7-4943-8597-b684741378b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:57.705268 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63a8fa-8bd7-4943-8597-b684741378b9 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:57.706425 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63a8fa-8bd7-4943-8597-b684741378b9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:49:57.706722 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63a8fa-8bd7-4943-8597-b684741378b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:57.708083 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63a8fa-8bd7-4943-8597-b684741378b9 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:57.712719 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 649/1291] 10.222.0.25 () {56 vars in 1116 bytes} [Tue Aug 30 15:49:57 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:49:57.718285 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70281ae3-3cd5-47dd-9999-6881682f61f4 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:49:57.823634 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70281ae3-3cd5-47dd-9999-6881682f61f4 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:49:57.856820 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4248d4-2070-4e40-aa6e-88a337a522d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:49:57.857424 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4248d4-2070-4e40-aa6e-88a337a522d8 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:57.857708 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4248d4-2070-4e40-aa6e-88a337a522d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:57.857985 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4248d4-2070-4e40-aa6e-88a337a522d8 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:57.858624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4248d4-2070-4e40-aa6e-88a337a522d8 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:49:57.858929 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4248d4-2070-4e40-aa6e-88a337a522d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:49:57.860311 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4248d4-2070-4e40-aa6e-88a337a522d8 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:49:57.864978 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 643/1292] 10.222.0.25 () {56 vars in 1116 bytes} [Tue Aug 30 15:49:57 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:49:59.735663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ec859-deb1-48d4-93bf-d7d9c86b704f None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:59.736074 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ec859-deb1-48d4-93bf-d7d9c86b704f None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:59.736213 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ec859-deb1-48d4-93bf-d7d9c86b704f None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:59.737679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 650/1293] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:49:59.742872 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52b3fb-9bb9-4f16-91fc-c1bd2d689c92 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:49:59.743249 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52b3fb-9bb9-4f16-91fc-c1bd2d689c92 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:49:59.743422 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52b3fb-9bb9-4f16-91fc-c1bd2d689c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:49:59.762279 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-be52b3fb-9bb9-4f16-91fc-c1bd2d689c92 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:49:59.763736 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-be52b3fb-9bb9-4f16-91fc-c1bd2d689c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:49:59.794744 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:49:59.833516 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 644/1294] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:49:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:50:00.110733 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ec859-deb1-48d4-93bf-d7d9c86b704f None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:50:00.149886 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:50:00.225109 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ec859-deb1-48d4-93bf-d7d9c86b704f None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:50:00.258646 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191578ad-8c0b-4f5a-8baf-27e0b6382551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:50:00.259248 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191578ad-8c0b-4f5a-8baf-27e0b6382551 None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:50:00.259526 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191578ad-8c0b-4f5a-8baf-27e0b6382551 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:50:00.259795 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191578ad-8c0b-4f5a-8baf-27e0b6382551 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:50:00.260437 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191578ad-8c0b-4f5a-8baf-27e0b6382551 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:50:00.261838 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191578ad-8c0b-4f5a-8baf-27e0b6382551 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:50:00.276135 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 651/1295] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Aug 30 15:50:00 2022] POST /identity/v3/services => generated 246 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:50:02.168191 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf29f28-15cd-4c99-80aa-64b046cd6c32 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:50:02.168742 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf29f28-15cd-4c99-80aa-64b046cd6c32 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:50:02.168742 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf29f28-15cd-4c99-80aa-64b046cd6c32 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:50:02.170099 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 645/1296] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:50:02.176007 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36adfd-f8ed-4b82-93f8-77475da37f05 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:50:02.176417 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36adfd-f8ed-4b82-93f8-77475da37f05 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:50:02.176558 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36adfd-f8ed-4b82-93f8-77475da37f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:50:02.194895 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-1a36adfd-f8ed-4b82-93f8-77475da37f05 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:50:02.196082 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-1a36adfd-f8ed-4b82-93f8-77475da37f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:50:02.267507 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 652/1297] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:50:02 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 15:50:02.537929 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf29f28-15cd-4c99-80aa-64b046cd6c32 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:50:02.639260 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf29f28-15cd-4c99-80aa-64b046cd6c32 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:50:02.672342 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928a381-4f27-4fd0-9fe1-0da4a1289ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:50:02.672988 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928a381-4f27-4fd0-9fe1-0da4a1289ebc None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:50:02.673271 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928a381-4f27-4fd0-9fe1-0da4a1289ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:50:02.673540 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928a381-4f27-4fd0-9fe1-0da4a1289ebc None admin] PATH_INFO: `/v3/services/placement` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:50:02.674980 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d928a381-4f27-4fd0-9fe1-0da4a1289ebc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:50:02.676449 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d928a381-4f27-4fd0-9fe1-0da4a1289ebc None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:50:02.685108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-d928a381-4f27-4fd0-9fe1-0da4a1289ebc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 15:50:02.685108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:50:02.685108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 15:50:02.685108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 15:50:02.685108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 15:50:02.685108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 15:50:02.685108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 15:50:02.685108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:50:02.685108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 15:50:02.685108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:50:02.685108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 15:50:02.685108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:50:02.685108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:50:02.685108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:50:02.685108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:50:02.685108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:50:02.685108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:50:02.686624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:50:02.686624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:50:02.686624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:50:02.686624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:50:02.686624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:50:02.686624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:50:02.686624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 15:50:02.686624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 15:50:02.686624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 15:50:02.686624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 15:50:02.686624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:50:02.686624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:50:02.686624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:50:02.686624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:50:02.686624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:50:02.686624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:50:02.687636 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:50:02.687636 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:50:02.687636 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:50:02.687636 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:50:02.687636 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:50:02.687636 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:50:02.687636 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:50:02.687636 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:50:02.687636 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:50:02.687636 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:50:02.687636 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 15:50:02.687636 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:50:02.687636 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 15:50:02.687636 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:50:02.687636 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 646/1298] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Aug 30 15:50:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:50:02.692593 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36adfd-f8ed-4b82-93f8-77475da37f05 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:50:02.710151 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:50:02.791997 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36adfd-f8ed-4b82-93f8-77475da37f05 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:50:02.823720 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884ad8a-11b7-4fae-bffa-30ba4bd1ee6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:50:02.824315 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884ad8a-11b7-4fae-bffa-30ba4bd1ee6a None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:50:02.824592 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884ad8a-11b7-4fae-bffa-30ba4bd1ee6a None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:50:02.824896 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884ad8a-11b7-4fae-bffa-30ba4bd1ee6a None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:50:02.825514 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884ad8a-11b7-4fae-bffa-30ba4bd1ee6a None admin] RBAC: Adding query filter params (name=placement) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:50:02.825809 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884ad8a-11b7-4fae-bffa-30ba4bd1ee6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:50:02.827157 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884ad8a-11b7-4fae-bffa-30ba4bd1ee6a None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:50:02.832664 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 653/1299] 10.222.0.25 () {56 vars in 1116 bytes} [Tue Aug 30 15:50:02 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:50:02.838603 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928a381-4f27-4fd0-9fe1-0da4a1289ebc None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:50:02.870121 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:50:02.937836 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928a381-4f27-4fd0-9fe1-0da4a1289ebc None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:50:02.970636 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfceee4c-f7d1-4d20-a396-a02633296e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:50:02.972203 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfceee4c-f7d1-4d20-a396-a02633296e53 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:50:02.972486 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfceee4c-f7d1-4d20-a396-a02633296e53 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:50:02.972759 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfceee4c-f7d1-4d20-a396-a02633296e53 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:50:02.973489 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfceee4c-f7d1-4d20-a396-a02633296e53 None admin] RBAC: Adding query filter params (interface=public, service_id=978dbaedfda846d9a7b6f12a9d4900b5, region_id=RegionOne) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:50:02.973795 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfceee4c-f7d1-4d20-a396-a02633296e53 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:50:02.975163 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfceee4c-f7d1-4d20-a396-a02633296e53 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:50:02.980004 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 647/1300] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Aug 30 15:50:02 2022] GET /identity/v3/endpoints?service_id=978dbaedfda846d9a7b6f12a9d4900b5&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:50:02.985718 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884ad8a-11b7-4fae-bffa-30ba4bd1ee6a None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:50:03.066011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:50:03.084256 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884ad8a-11b7-4fae-bffa-30ba4bd1ee6a None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:50:03.124216 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ef0b2-f107-4738-9500-2579f65258cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:50:03.125000 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ef0b2-f107-4738-9500-2579f65258cc None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:50:03.125311 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ef0b2-f107-4738-9500-2579f65258cc None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:50:03.125603 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ef0b2-f107-4738-9500-2579f65258cc None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:50:03.126265 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3ef0b2-f107-4738-9500-2579f65258cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:50:03.128589 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3ef0b2-f107-4738-9500-2579f65258cc None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:50:03.135837 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 654/1301] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Aug 30 15:50:02 2022] GET /identity/v3/services => generated 2191 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:50:05.044191 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f7fcc-6e9b-4285-a19d-f76b8ec76f81 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:50:05.044742 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f7fcc-6e9b-4285-a19d-f76b8ec76f81 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:50:05.044742 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f7fcc-6e9b-4285-a19d-f76b8ec76f81 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:50:05.046025 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 648/1302] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:50:05.051767 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c756b-4863-4108-b492-eb2fe4608809 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:50:05.052187 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c756b-4863-4108-b492-eb2fe4608809 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:50:05.052293 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c756b-4863-4108-b492-eb2fe4608809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:50:05.070413 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-a28c756b-4863-4108-b492-eb2fe4608809 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:50:05.071579 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-a28c756b-4863-4108-b492-eb2fe4608809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:50:05.138551 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 655/1303] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:50:05 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 15:50:05.405018 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687f7fcc-6e9b-4285-a19d-f76b8ec76f81 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:50:05.499836 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:50:05.506893 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687f7fcc-6e9b-4285-a19d-f76b8ec76f81 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:50:05.539929 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3d0f9-b1ae-424c-b3dc-4cbdffc1cb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:50:05.540551 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3d0f9-b1ae-424c-b3dc-4cbdffc1cb8b None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:50:05.540853 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3d0f9-b1ae-424c-b3dc-4cbdffc1cb8b None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:50:05.541127 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3d0f9-b1ae-424c-b3dc-4cbdffc1cb8b None admin] PATH_INFO: `/v3/services/placement` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:50:05.541706 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d3d0f9-b1ae-424c-b3dc-4cbdffc1cb8b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:50:05.543076 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d3d0f9-b1ae-424c-b3dc-4cbdffc1cb8b None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:50:05.552673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-16d3d0f9-b1ae-424c-b3dc-4cbdffc1cb8b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 15:50:05.552673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:50:05.552673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 15:50:05.552673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 15:50:05.552673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 15:50:05.552673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 15:50:05.552673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 15:50:05.552673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:50:05.552673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 15:50:05.552673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:50:05.552673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 15:50:05.552673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:50:05.552673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 15:50:05.552673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 15:50:05.552673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 15:50:05.552673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 15:50:05.552673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 15:50:05.553960 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 15:50:05.553960 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 15:50:05.553960 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 15:50:05.553960 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 15:50:05.553960 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 15:50:05.553960 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 15:50:05.553960 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 15:50:05.553960 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 15:50:05.553960 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 15:50:05.553960 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 15:50:05.553960 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 15:50:05.553960 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 15:50:05.553960 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 15:50:05.553960 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 15:50:05.553960 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 15:50:05.553960 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 15:50:05.554855 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 15:50:05.554855 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Aug 30 15:50:05.554855 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 15:50:05.554855 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Aug 30 15:50:05.554855 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 15:50:05.554855 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 15:50:05.554855 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 15:50:05.554855 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Aug 30 15:50:05.554855 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 15:50:05.554855 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Aug 30 15:50:05.554855 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 15:50:05.554855 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 15:50:05.554855 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 15:50:05.554855 dv-cinder-855058-1-smb devstack@keystone.service[81420]: ERROR keystone.server.flask.application Aug 30 15:50:05.554855 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 649/1304] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Aug 30 15:50:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 15:50:05.559805 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c756b-4863-4108-b492-eb2fe4608809 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:50:05.632961 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:50:05.654929 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c756b-4863-4108-b492-eb2fe4608809 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:50:05.688056 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde22e37-37c9-4ff2-95af-54288bd3ec70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:50:05.688593 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde22e37-37c9-4ff2-95af-54288bd3ec70 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:50:05.688899 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde22e37-37c9-4ff2-95af-54288bd3ec70 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:50:05.689169 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde22e37-37c9-4ff2-95af-54288bd3ec70 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:50:05.689817 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde22e37-37c9-4ff2-95af-54288bd3ec70 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:50:05.690112 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde22e37-37c9-4ff2-95af-54288bd3ec70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:50:05.691457 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde22e37-37c9-4ff2-95af-54288bd3ec70 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:50:05.696318 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 656/1305] 10.222.0.25 () {56 vars in 1116 bytes} [Tue Aug 30 15:50:05 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:50:05.702090 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3d0f9-b1ae-424c-b3dc-4cbdffc1cb8b None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:50:05.807044 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3d0f9-b1ae-424c-b3dc-4cbdffc1cb8b None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:50:05.840551 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b678d15-1a0f-4646-984c-5ef8a6134f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:50:05.841182 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b678d15-1a0f-4646-984c-5ef8a6134f22 None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:50:05.841465 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b678d15-1a0f-4646-984c-5ef8a6134f22 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:50:05.841738 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b678d15-1a0f-4646-984c-5ef8a6134f22 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:50:05.842403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b678d15-1a0f-4646-984c-5ef8a6134f22 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:50:05.843777 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b678d15-1a0f-4646-984c-5ef8a6134f22 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:50:05.864087 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 650/1306] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:50:05 2022] POST /identity/v3/endpoints => generated 331 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:50:15.693496 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=30 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:50:15.860142 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:51:09.827993 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c05a9-f2cf-471d-a258-0a8e959c731e None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:09.828583 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c05a9-f2cf-471d-a258-0a8e959c731e None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:09.828583 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c05a9-f2cf-471d-a258-0a8e959c731e None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:09.830954 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 657/1307] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:51:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:51:09.836894 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1aac5-73b2-436b-afcb-9a231ee14f19 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:09.837418 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1aac5-73b2-436b-afcb-9a231ee14f19 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:09.837418 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1aac5-73b2-436b-afcb-9a231ee14f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:09.999878 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-92d1aac5-73b2-436b-afcb-9a231ee14f19 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:51:10.001686 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-92d1aac5-73b2-436b-afcb-9a231ee14f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:51:10.175881 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 651/1308] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:51:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:51:10.508700 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b07b65-01e0-4461-89b5-39ffa4549aea None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:10.509552 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b07b65-01e0-4461-89b5-39ffa4549aea None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:10.510322 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b07b65-01e0-4461-89b5-39ffa4549aea None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:10.512290 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 658/1309] 10.222.0.25 () {54 vars in 965 bytes} [Tue Aug 30 15:51:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 15:51:10.519617 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74d449-3eb9-47d8-bd5c-1c9d5dea51c9 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:10.520307 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74d449-3eb9-47d8-bd5c-1c9d5dea51c9 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:10.520890 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74d449-3eb9-47d8-bd5c-1c9d5dea51c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:10.623470 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-8a74d449-3eb9-47d8-bd5c-1c9d5dea51c9 None None] MFA Rules not processed for user `48c49f6751d14526a0954797d9ab6a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:51:10.625126 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-8a74d449-3eb9-47d8-bd5c-1c9d5dea51c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:51:10.653628 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:51:10.733597 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 652/1310] 10.222.0.25 () {58 vars in 1062 bytes} [Tue Aug 30 15:51:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:51:10.744379 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b07b65-01e0-4461-89b5-39ffa4549aea None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:51:10.746673 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-06b07b65-01e0-4461-89b5-39ffa4549aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:51:10.884262 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b07b65-01e0-4461-89b5-39ffa4549aea None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:51:10.990935 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53d1e6-3f06-48a9-90d4-b1b66200ec00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:51:10.991648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53d1e6-3f06-48a9-90d4-b1b66200ec00 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:10.992035 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53d1e6-3f06-48a9-90d4-b1b66200ec00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:10.992433 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53d1e6-3f06-48a9-90d4-b1b66200ec00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:10.994335 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-2a53d1e6-3f06-48a9-90d4-b1b66200ec00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:51:11.060052 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:51:11.135793 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a53d1e6-3f06-48a9-90d4-b1b66200ec00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:51:11.137313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a53d1e6-3f06-48a9-90d4-b1b66200ec00 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:51:11.158703 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 659/1311] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:51:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:51:13.398492 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b89340-0e6f-4aee-abdd-b73082cd9beb None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:13.399052 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b89340-0e6f-4aee-abdd-b73082cd9beb None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:13.399052 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b89340-0e6f-4aee-abdd-b73082cd9beb None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:13.400373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 653/1312] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:51:13.405411 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d51915-8760-4d60-a3cb-69d4557b2902 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:13.405840 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d51915-8760-4d60-a3cb-69d4557b2902 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:13.405989 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d51915-8760-4d60-a3cb-69d4557b2902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:13.491517 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-c5d51915-8760-4d60-a3cb-69d4557b2902 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:51:13.492800 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c5d51915-8760-4d60-a3cb-69d4557b2902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:51:13.597928 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 660/1313] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:51:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:51:13.887368 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b89340-0e6f-4aee-abdd-b73082cd9beb None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:51:13.889022 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-a7b89340-0e6f-4aee-abdd-b73082cd9beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:51:13.993566 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b89340-0e6f-4aee-abdd-b73082cd9beb None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:51:14.062769 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:51:14.065304 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00a57a-6a2d-4541-a808-492e0a2f1b28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:51:14.065972 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00a57a-6a2d-4541-a808-492e0a2f1b28 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:14.066276 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00a57a-6a2d-4541-a808-492e0a2f1b28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:14.066586 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00a57a-6a2d-4541-a808-492e0a2f1b28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:14.068735 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-5d00a57a-6a2d-4541-a808-492e0a2f1b28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:51:14.180944 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d00a57a-6a2d-4541-a808-492e0a2f1b28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:51:14.182393 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d00a57a-6a2d-4541-a808-492e0a2f1b28 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:51:14.200135 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 654/1314] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:51:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:51:16.410248 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944201e5-1e60-4998-9411-49ba019c513f None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:16.410777 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944201e5-1e60-4998-9411-49ba019c513f None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:16.410777 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944201e5-1e60-4998-9411-49ba019c513f None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:16.412108 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 661/1315] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:51:16.417249 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32254a8-b5eb-478c-94bf-7aa6b29d04d0 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:16.417614 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32254a8-b5eb-478c-94bf-7aa6b29d04d0 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:16.417809 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32254a8-b5eb-478c-94bf-7aa6b29d04d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:16.483869 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-c32254a8-b5eb-478c-94bf-7aa6b29d04d0 None None] MFA Rules not processed for user `a3d5c3129b0d4c998a2a04444d03e300`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:51:16.485919 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-c32254a8-b5eb-478c-94bf-7aa6b29d04d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:51:16.559859 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:51:16.605010 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 655/1316] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:51:16 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:51:16.891981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944201e5-1e60-4998-9411-49ba019c513f None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:51:16.893582 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-944201e5-1e60-4998-9411-49ba019c513f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:51:16.903470 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:51:16.996589 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944201e5-1e60-4998-9411-49ba019c513f None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:51:17.067756 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbab0a4-181a-4fd6-b0b5-103cdca39762 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:51:17.068357 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbab0a4-181a-4fd6-b0b5-103cdca39762 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:17.068635 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbab0a4-181a-4fd6-b0b5-103cdca39762 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:17.068939 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbab0a4-181a-4fd6-b0b5-103cdca39762 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:17.070519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-0dbab0a4-181a-4fd6-b0b5-103cdca39762 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:51:17.135091 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:51:17.182873 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbab0a4-181a-4fd6-b0b5-103cdca39762 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:51:17.184307 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbab0a4-181a-4fd6-b0b5-103cdca39762 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:51:17.202049 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 662/1317] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:51:16 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:51:19.638819 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d993ff9-9728-4206-b65a-e8f7f1d5ca40 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:19.639351 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d993ff9-9728-4206-b65a-e8f7f1d5ca40 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:19.639351 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d993ff9-9728-4206-b65a-e8f7f1d5ca40 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:19.640810 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 656/1318] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:51:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:51:19.645964 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df7ca5-85e7-4e83-9b7d-db41ab80e0ab None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:19.646376 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df7ca5-85e7-4e83-9b7d-db41ab80e0ab None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:19.646511 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df7ca5-85e7-4e83-9b7d-db41ab80e0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:19.710988 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-46df7ca5-85e7-4e83-9b7d-db41ab80e0ab None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:51:19.712165 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-46df7ca5-85e7-4e83-9b7d-db41ab80e0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:51:19.807960 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 663/1319] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:51:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:51:20.095803 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d993ff9-9728-4206-b65a-e8f7f1d5ca40 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:51:20.097364 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-0d993ff9-9728-4206-b65a-e8f7f1d5ca40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:51:20.200917 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d993ff9-9728-4206-b65a-e8f7f1d5ca40 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:51:20.272505 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c7518-508e-463f-9329-65a536dd40bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:51:20.273144 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c7518-508e-463f-9329-65a536dd40bc service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:20.273424 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c7518-508e-463f-9329-65a536dd40bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:20.273692 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c7518-508e-463f-9329-65a536dd40bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:20.275292 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-1c2c7518-508e-463f-9329-65a536dd40bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:51:20.283259 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:51:20.382322 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c7518-508e-463f-9329-65a536dd40bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:51:20.383683 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c7518-508e-463f-9329-65a536dd40bc service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:51:20.402129 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 657/1320] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:51:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:51:22.954120 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f01ca-a41a-48ab-aa74-746bdfe0444c None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:22.954645 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f01ca-a41a-48ab-aa74-746bdfe0444c None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:22.954645 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f01ca-a41a-48ab-aa74-746bdfe0444c None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:22.956269 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 664/1321] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:51:22.961184 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ac1cf-9cad-480c-a99f-cc28b484161c None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:22.961598 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ac1cf-9cad-480c-a99f-cc28b484161c None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:22.961738 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ac1cf-9cad-480c-a99f-cc28b484161c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:23.028013 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-7d8ac1cf-9cad-480c-a99f-cc28b484161c None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:51:23.029137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-7d8ac1cf-9cad-480c-a99f-cc28b484161c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:51:23.087399 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:51:23.129891 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 658/1322] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:51:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:51:23.421556 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f01ca-a41a-48ab-aa74-746bdfe0444c None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:51:23.423653 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-fe0f01ca-a41a-48ab-aa74-746bdfe0444c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:51:23.443684 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:51:23.529715 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f01ca-a41a-48ab-aa74-746bdfe0444c None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:51:23.603794 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394fc21-eaba-4a99-943b-b4dbe2e8c65e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:51:23.604323 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394fc21-eaba-4a99-943b-b4dbe2e8c65e service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:23.604598 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394fc21-eaba-4a99-943b-b4dbe2e8c65e service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:23.604900 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394fc21-eaba-4a99-943b-b4dbe2e8c65e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:23.606643 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-2394fc21-eaba-4a99-943b-b4dbe2e8c65e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:51:23.680261 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:51:23.719196 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394fc21-eaba-4a99-943b-b4dbe2e8c65e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:51:23.720642 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394fc21-eaba-4a99-943b-b4dbe2e8c65e service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:51:23.741161 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 665/1323] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:51:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:51:25.705290 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c42205-4085-4a12-ab35-0723dbf67eaa None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:25.705803 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c42205-4085-4a12-ab35-0723dbf67eaa None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:25.705803 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c42205-4085-4a12-ab35-0723dbf67eaa None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:25.707067 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 659/1324] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:51:25.712198 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3a8b7-7db7-4a19-b3a4-e46bfaebf30e None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:25.712596 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3a8b7-7db7-4a19-b3a4-e46bfaebf30e None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:25.712914 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3a8b7-7db7-4a19-b3a4-e46bfaebf30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:25.779541 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-40f3a8b7-7db7-4a19-b3a4-e46bfaebf30e None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:51:25.780874 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-40f3a8b7-7db7-4a19-b3a4-e46bfaebf30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:51:25.880328 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 666/1325] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:51:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:51:26.162002 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c42205-4085-4a12-ab35-0723dbf67eaa None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:51:26.163540 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-b2c42205-4085-4a12-ab35-0723dbf67eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:51:26.268126 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c42205-4085-4a12-ab35-0723dbf67eaa None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:51:26.349229 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06bc23c-0a07-43f1-83dd-87f082334edc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:51:26.349852 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bc23c-0a07-43f1-83dd-87f082334edc service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:26.350134 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bc23c-0a07-43f1-83dd-87f082334edc service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:26.350408 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bc23c-0a07-43f1-83dd-87f082334edc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:26.352031 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-a06bc23c-0a07-43f1-83dd-87f082334edc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:51:26.368868 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:51:26.462121 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06bc23c-0a07-43f1-83dd-87f082334edc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:51:26.463604 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06bc23c-0a07-43f1-83dd-87f082334edc service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:51:26.481492 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 660/1326] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:51:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:51:28.551264 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3fc25-aaf0-484b-b203-275912762226 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:28.551786 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3fc25-aaf0-484b-b203-275912762226 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:28.551870 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3fc25-aaf0-484b-b203-275912762226 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:28.553802 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 667/1327] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:51:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:51:28.559052 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb06c87-dd1e-4dec-b13c-67f11687dfc7 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:28.559472 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb06c87-dd1e-4dec-b13c-67f11687dfc7 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:28.559589 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb06c87-dd1e-4dec-b13c-67f11687dfc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:28.629485 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-8fb06c87-dd1e-4dec-b13c-67f11687dfc7 None None] MFA Rules not processed for user `a3d5c3129b0d4c998a2a04444d03e300`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:51:28.630670 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-8fb06c87-dd1e-4dec-b13c-67f11687dfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:51:28.697299 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:51:28.736335 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 661/1328] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:51:28 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:51:29.024323 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3fc25-aaf0-484b-b203-275912762226 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:51:29.025936 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-94e3fc25-aaf0-484b-b203-275912762226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:51:29.057010 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:51:29.128761 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3fc25-aaf0-484b-b203-275912762226 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:51:29.203798 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac6f20-f212-40e7-be8f-c0354aa4850a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:51:29.204343 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac6f20-f212-40e7-be8f-c0354aa4850a service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:29.204622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac6f20-f212-40e7-be8f-c0354aa4850a service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:29.204934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac6f20-f212-40e7-be8f-c0354aa4850a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:29.206532 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-74ac6f20-f212-40e7-be8f-c0354aa4850a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:51:29.285576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:51:29.319290 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac6f20-f212-40e7-be8f-c0354aa4850a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:51:29.320737 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac6f20-f212-40e7-be8f-c0354aa4850a service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:51:29.338970 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 668/1329] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:51:29 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:51:31.526523 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6ddce-08f8-47a3-889f-727ea8bb15a0 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:31.527057 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6ddce-08f8-47a3-889f-727ea8bb15a0 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:31.527057 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6ddce-08f8-47a3-889f-727ea8bb15a0 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:31.528449 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 662/1330] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:51:31.534134 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c205de5-c3ae-4bdf-a277-952d9bd5aae5 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:31.534576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c205de5-c3ae-4bdf-a277-952d9bd5aae5 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:31.534681 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c205de5-c3ae-4bdf-a277-952d9bd5aae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:31.602130 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-2c205de5-c3ae-4bdf-a277-952d9bd5aae5 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:51:31.603335 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-2c205de5-c3ae-4bdf-a277-952d9bd5aae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:51:31.697717 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 669/1331] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:51:31.981733 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6ddce-08f8-47a3-889f-727ea8bb15a0 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:51:31.983812 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-83a6ddce-08f8-47a3-889f-727ea8bb15a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:51:32.093516 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6ddce-08f8-47a3-889f-727ea8bb15a0 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:51:32.166788 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f089a38-c9ff-4c55-bd9b-d1777df8d2c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:51:32.167318 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f089a38-c9ff-4c55-bd9b-d1777df8d2c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:32.167598 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f089a38-c9ff-4c55-bd9b-d1777df8d2c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:32.167870 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f089a38-c9ff-4c55-bd9b-d1777df8d2c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:32.169500 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-4f089a38-c9ff-4c55-bd9b-d1777df8d2c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:51:32.196567 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:51:32.279853 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f089a38-c9ff-4c55-bd9b-d1777df8d2c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:51:32.281495 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f089a38-c9ff-4c55-bd9b-d1777df8d2c2 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:51:32.300697 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 663/1332] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:51:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:51:34.294289 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371e982-d50e-436e-ad26-6815965e798a None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:34.294825 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371e982-d50e-436e-ad26-6815965e798a None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:34.294955 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371e982-d50e-436e-ad26-6815965e798a None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:34.296336 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 670/1333] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:51:34.301914 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03f965-a7b3-4ce5-a411-e18d6ef67824 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:34.302327 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03f965-a7b3-4ce5-a411-e18d6ef67824 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:34.302478 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03f965-a7b3-4ce5-a411-e18d6ef67824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:34.367701 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-1c03f965-a7b3-4ce5-a411-e18d6ef67824 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:51:34.368954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-1c03f965-a7b3-4ce5-a411-e18d6ef67824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:51:34.443119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:51:34.466175 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 664/1334] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:51:34.763499 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc33f26-ef88-477e-b398-5f5c441216c5 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:34.763780 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc33f26-ef88-477e-b398-5f5c441216c5 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:34.764054 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc33f26-ef88-477e-b398-5f5c441216c5 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:34.765482 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 671/1335] 10.222.0.25 () {54 vars in 965 bytes} [Tue Aug 30 15:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:51:34.771042 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd677a3-d6bb-47b6-aa49-69200ff3a1c6 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:34.771325 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd677a3-d6bb-47b6-aa49-69200ff3a1c6 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:34.771595 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd677a3-d6bb-47b6-aa49-69200ff3a1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:34.847471 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-dcd677a3-d6bb-47b6-aa49-69200ff3a1c6 None None] MFA Rules not processed for user `48c49f6751d14526a0954797d9ab6a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:51:34.848654 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-dcd677a3-d6bb-47b6-aa49-69200ff3a1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:51:34.923739 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 665/1336] 10.222.0.25 () {58 vars in 1062 bytes} [Tue Aug 30 15:51:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:51:34.933095 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc33f26-ef88-477e-b398-5f5c441216c5 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:51:34.934666 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-9bc33f26-ef88-477e-b398-5f5c441216c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:51:34.974474 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:51:35.038738 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc33f26-ef88-477e-b398-5f5c441216c5 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:51:35.111055 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943b1b5-0c2f-497d-a299-eafcb6f1d13a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:51:35.111656 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943b1b5-0c2f-497d-a299-eafcb6f1d13a service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:35.111929 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943b1b5-0c2f-497d-a299-eafcb6f1d13a service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:35.112192 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943b1b5-0c2f-497d-a299-eafcb6f1d13a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:35.113818 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-4943b1b5-0c2f-497d-a299-eafcb6f1d13a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:51:35.194355 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:51:35.219600 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943b1b5-0c2f-497d-a299-eafcb6f1d13a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:51:35.221051 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943b1b5-0c2f-497d-a299-eafcb6f1d13a service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:51:35.238797 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 672/1337] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:51:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:51:37.995134 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3820d-5a8e-4758-85e2-ebcfd9a17281 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:37.995686 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3820d-5a8e-4758-85e2-ebcfd9a17281 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:37.995686 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3820d-5a8e-4758-85e2-ebcfd9a17281 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:37.996963 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 666/1338] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:51:38.002495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dd428-3185-494a-bba5-e90ed0d59b8b None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:38.002924 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dd428-3185-494a-bba5-e90ed0d59b8b None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:38.003041 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dd428-3185-494a-bba5-e90ed0d59b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:38.069380 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-524dd428-3185-494a-bba5-e90ed0d59b8b None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:51:38.070607 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-524dd428-3185-494a-bba5-e90ed0d59b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:51:38.170107 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 673/1339] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:51:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:51:38.457888 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3820d-5a8e-4758-85e2-ebcfd9a17281 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:51:38.459453 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-4dd3820d-5a8e-4758-85e2-ebcfd9a17281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:51:38.534944 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:51:38.563462 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3820d-5a8e-4758-85e2-ebcfd9a17281 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:51:38.636023 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c134e05-9527-4f7e-b5b8-c8391dc1dd6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:51:38.636625 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c134e05-9527-4f7e-b5b8-c8391dc1dd6e service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:38.636931 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c134e05-9527-4f7e-b5b8-c8391dc1dd6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:38.637196 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c134e05-9527-4f7e-b5b8-c8391dc1dd6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:38.638790 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-5c134e05-9527-4f7e-b5b8-c8391dc1dd6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:51:38.748151 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c134e05-9527-4f7e-b5b8-c8391dc1dd6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:51:38.750400 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c134e05-9527-4f7e-b5b8-c8391dc1dd6e service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:51:38.768139 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 667/1340] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:51:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:51:42.780294 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f197ca2-9dc3-41a5-a22b-ec66945de3fd None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:42.780771 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f197ca2-9dc3-41a5-a22b-ec66945de3fd None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:42.780904 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f197ca2-9dc3-41a5-a22b-ec66945de3fd None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:42.782239 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 674/1341] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:51:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:51:42.787444 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f40ec0-5171-4b70-8c7e-dcb57c1a7a8c None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:42.787884 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f40ec0-5171-4b70-8c7e-dcb57c1a7a8c None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:42.788136 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f40ec0-5171-4b70-8c7e-dcb57c1a7a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:42.794565 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:51:42.858491 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-b7f40ec0-5171-4b70-8c7e-dcb57c1a7a8c None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:51:42.859766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-b7f40ec0-5171-4b70-8c7e-dcb57c1a7a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:51:42.959559 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 668/1342] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:51:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:51:43.254794 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f197ca2-9dc3-41a5-a22b-ec66945de3fd None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:51:43.256482 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-4f197ca2-9dc3-41a5-a22b-ec66945de3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:51:43.305869 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:51:43.364913 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f197ca2-9dc3-41a5-a22b-ec66945de3fd None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:51:43.445123 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca724e11-1fd0-40bf-adea-5c04c9a67e2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:51:43.445776 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca724e11-1fd0-40bf-adea-5c04c9a67e2a service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:43.446072 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca724e11-1fd0-40bf-adea-5c04c9a67e2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:43.446344 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca724e11-1fd0-40bf-adea-5c04c9a67e2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:43.448138 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-ca724e11-1fd0-40bf-adea-5c04c9a67e2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:51:43.541908 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:51:43.559098 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca724e11-1fd0-40bf-adea-5c04c9a67e2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:51:43.560560 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca724e11-1fd0-40bf-adea-5c04c9a67e2a service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:51:43.579763 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 675/1343] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:51:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:51:46.111925 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef012bdf-862a-460f-acff-f5d8c2208707 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:46.112505 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef012bdf-862a-460f-acff-f5d8c2208707 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:46.112505 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef012bdf-862a-460f-acff-f5d8c2208707 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:46.113880 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 669/1344] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:51:46.119552 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522edc7-8e96-4841-99fd-43d3b6d3eaee None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:46.120029 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522edc7-8e96-4841-99fd-43d3b6d3eaee None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:46.120153 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522edc7-8e96-4841-99fd-43d3b6d3eaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:46.192868 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-8522edc7-8e96-4841-99fd-43d3b6d3eaee None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:51:46.194072 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-8522edc7-8e96-4841-99fd-43d3b6d3eaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:51:46.292962 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 676/1345] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:51:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:51:46.572145 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef012bdf-862a-460f-acff-f5d8c2208707 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:51:46.573795 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-ef012bdf-862a-460f-acff-f5d8c2208707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:51:46.662224 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:51:46.680173 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef012bdf-862a-460f-acff-f5d8c2208707 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:51:46.757690 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cda01e-de6e-45d4-b3e2-e99d6ef76452 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:51:46.758551 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cda01e-de6e-45d4-b3e2-e99d6ef76452 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:46.758826 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cda01e-de6e-45d4-b3e2-e99d6ef76452 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:46.759093 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cda01e-de6e-45d4-b3e2-e99d6ef76452 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:46.760684 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-14cda01e-de6e-45d4-b3e2-e99d6ef76452 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:51:46.875545 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cda01e-de6e-45d4-b3e2-e99d6ef76452 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:51:46.876953 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cda01e-de6e-45d4-b3e2-e99d6ef76452 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:51:46.895952 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 670/1346] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:51:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:51:50.812479 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf2def-667d-477e-9721-603958dad352 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:50.813081 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf2def-667d-477e-9721-603958dad352 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:50.813081 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf2def-667d-477e-9721-603958dad352 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:50.814415 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 677/1347] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:51:50.819798 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d5377-7b3e-4d9c-ade3-98e5471ba69d None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:50.820255 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d5377-7b3e-4d9c-ade3-98e5471ba69d None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:50.820356 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d5377-7b3e-4d9c-ade3-98e5471ba69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:50.837185 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:51:50.894527 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-259d5377-7b3e-4d9c-ade3-98e5471ba69d None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:51:50.895760 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-259d5377-7b3e-4d9c-ade3-98e5471ba69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:51:51.016859 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 671/1348] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:51:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:51:51.309695 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf2def-667d-477e-9721-603958dad352 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:51:51.311237 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-8dcf2def-667d-477e-9721-603958dad352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:51:51.374574 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:51:51.423596 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf2def-667d-477e-9721-603958dad352 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:51:51.497431 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e24745-8e86-44c7-b7a9-16aa96e80dda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:51:51.498319 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e24745-8e86-44c7-b7a9-16aa96e80dda service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:51.498319 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e24745-8e86-44c7-b7a9-16aa96e80dda service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:51.498599 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e24745-8e86-44c7-b7a9-16aa96e80dda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:51.500245 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c6e24745-8e86-44c7-b7a9-16aa96e80dda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:51:51.614514 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:51:51.618710 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e24745-8e86-44c7-b7a9-16aa96e80dda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:51:51.620149 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e24745-8e86-44c7-b7a9-16aa96e80dda service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:51:51.638643 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 678/1349] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:51:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:51:56.542551 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181440fc-335e-4b2a-8090-d7e66c205e71 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:56.543049 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181440fc-335e-4b2a-8090-d7e66c205e71 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:56.543141 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181440fc-335e-4b2a-8090-d7e66c205e71 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:56.547372 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 672/1350] 10.222.0.25 () {54 vars in 921 bytes} [Tue Aug 30 15:51:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:51:56.552130 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9bfdd-f0b9-4121-9bdd-892fe54b7e4a None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:51:56.552555 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9bfdd-f0b9-4121-9bdd-892fe54b7e4a None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:51:56.552995 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9bfdd-f0b9-4121-9bdd-892fe54b7e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:51:56.667673 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-a1e9bfdd-f0b9-4121-9bdd-892fe54b7e4a None None] MFA Rules not processed for user `2bba851e1a0d4601b5d4841662f645dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:51:56.668891 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-a1e9bfdd-f0b9-4121-9bdd-892fe54b7e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:51:56.847327 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 679/1351] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Aug 30 15:51:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:52:00.970588 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2718c-a881-410c-a521-c965fdf7ebcb None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:00.971091 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2718c-a881-410c-a521-c965fdf7ebcb None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:00.971091 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2718c-a881-410c-a521-c965fdf7ebcb None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:00.972601 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 673/1352] 10.222.0.25 () {54 vars in 921 bytes} [Tue Aug 30 15:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:52:00.977971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b63e14-a7a2-4773-887d-64681456f7a4 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:00.978414 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b63e14-a7a2-4773-887d-64681456f7a4 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:00.978518 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b63e14-a7a2-4773-887d-64681456f7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:01.014747 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=59 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:01.035571 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:01.060144 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-d3b63e14-a7a2-4773-887d-64681456f7a4 None None] MFA Rules not processed for user `2bba851e1a0d4601b5d4841662f645dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:52:01.061366 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-d3b63e14-a7a2-4773-887d-64681456f7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:01.175281 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 680/1353] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Aug 30 15:52:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:52:02.494357 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f414d7-3b8c-407f-abb7-99972549c037 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:02.494922 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f414d7-3b8c-407f-abb7-99972549c037 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:02.494922 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f414d7-3b8c-407f-abb7-99972549c037 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:02.496363 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 674/1354] 10.222.0.25 () {54 vars in 921 bytes} [Tue Aug 30 15:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:52:02.501628 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168642da-d7d6-4d96-bc59-52a8e1edd541 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:02.502065 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168642da-d7d6-4d96-bc59-52a8e1edd541 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:02.502337 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168642da-d7d6-4d96-bc59-52a8e1edd541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:02.578990 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-168642da-d7d6-4d96-bc59-52a8e1edd541 None None] MFA Rules not processed for user `2bba851e1a0d4601b5d4841662f645dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:52:02.580185 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-168642da-d7d6-4d96-bc59-52a8e1edd541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:02.620495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:02.687850 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 681/1355] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Aug 30 15:52:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:52:06.141134 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2e7f0-26ed-49fc-923e-6dcb7cade918 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:06.141792 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2e7f0-26ed-49fc-923e-6dcb7cade918 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:06.141792 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2e7f0-26ed-49fc-923e-6dcb7cade918 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:06.143031 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 675/1356] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:52:06.148402 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d64b5f-21f8-4910-b611-f64cee666886 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:06.148842 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d64b5f-21f8-4910-b611-f64cee666886 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:06.149001 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d64b5f-21f8-4910-b611-f64cee666886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:06.232000 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-22d64b5f-21f8-4910-b611-f64cee666886 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:52:06.233381 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-22d64b5f-21f8-4910-b611-f64cee666886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:06.360477 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 682/1357] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:52:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:52:06.669378 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a835e9-4382-40ff-975a-6f5d6ebc7054 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:06.669641 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a835e9-4382-40ff-975a-6f5d6ebc7054 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:06.670085 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a835e9-4382-40ff-975a-6f5d6ebc7054 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:06.671580 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 676/1358] 10.222.0.25 () {54 vars in 962 bytes} [Tue Aug 30 15:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:52:06.680658 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb740e5-7d9b-4a8d-92a9-e83142ad5e21 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:06.680976 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb740e5-7d9b-4a8d-92a9-e83142ad5e21 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:06.681259 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb740e5-7d9b-4a8d-92a9-e83142ad5e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:06.716113 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:06.783174 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-4cb740e5-7d9b-4a8d-92a9-e83142ad5e21 None None] MFA Rules not processed for user `ebc80bf891614fb895af33ca1ded6b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:52:06.784365 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-4cb740e5-7d9b-4a8d-92a9-e83142ad5e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:06.900499 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 683/1359] 10.222.0.25 () {58 vars in 1059 bytes} [Tue Aug 30 15:52:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:52:06.908616 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a835e9-4382-40ff-975a-6f5d6ebc7054 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:52:06.910144 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-c6a835e9-4382-40ff-975a-6f5d6ebc7054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:07.070337 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a835e9-4382-40ff-975a-6f5d6ebc7054 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:52:07.148381 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:07.191347 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba0542-241d-4072-a3e6-18716e72a69a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:52:07.191962 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba0542-241d-4072-a3e6-18716e72a69a service nova] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:07.192247 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba0542-241d-4072-a3e6-18716e72a69a service nova] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:07.192522 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba0542-241d-4072-a3e6-18716e72a69a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:07.194176 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-8aba0542-241d-4072-a3e6-18716e72a69a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:07.294258 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba0542-241d-4072-a3e6-18716e72a69a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:52:07.296627 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba0542-241d-4072-a3e6-18716e72a69a service nova] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:52:07.315982 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 677/1360] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:52:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:52:09.456774 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682243b3-0123-43c0-b97a-e6831ae07b32 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:09.457390 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682243b3-0123-43c0-b97a-e6831ae07b32 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:09.457390 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682243b3-0123-43c0-b97a-e6831ae07b32 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:09.458888 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 684/1361] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:52:09.463928 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda56396-e770-4076-bdf0-b84b00c2846a None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:09.464445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda56396-e770-4076-bdf0-b84b00c2846a None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:09.464605 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda56396-e770-4076-bdf0-b84b00c2846a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:09.534312 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-dda56396-e770-4076-bdf0-b84b00c2846a None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:52:09.535419 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-dda56396-e770-4076-bdf0-b84b00c2846a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:09.575125 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:09.641244 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 678/1362] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:52:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:52:09.983302 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682243b3-0123-43c0-b97a-e6831ae07b32 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:52:09.987726 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-682243b3-0123-43c0-b97a-e6831ae07b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:10.076349 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:10.180396 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682243b3-0123-43c0-b97a-e6831ae07b32 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:52:10.314524 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9090a8-cc22-4ebd-981f-9bb58ad94ec0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:52:10.315511 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9090a8-cc22-4ebd-981f-9bb58ad94ec0 service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:10.315961 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9090a8-cc22-4ebd-981f-9bb58ad94ec0 service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:10.316416 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9090a8-cc22-4ebd-981f-9bb58ad94ec0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:10.319205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-ea9090a8-cc22-4ebd-981f-9bb58ad94ec0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:10.353418 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:10.445598 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9090a8-cc22-4ebd-981f-9bb58ad94ec0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:52:10.447392 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9090a8-cc22-4ebd-981f-9bb58ad94ec0 service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:52:10.468468 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 685/1363] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:52:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:52:12.819027 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a0c66-909b-41f3-ad9a-0cce1dc4a3bf None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:12.819969 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a0c66-909b-41f3-ad9a-0cce1dc4a3bf None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:12.820323 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a0c66-909b-41f3-ad9a-0cce1dc4a3bf None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:12.821863 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 679/1364] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:52:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:52:12.827227 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d3000-c829-43ba-bb80-8b5e369d35a9 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:12.827679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d3000-c829-43ba-bb80-8b5e369d35a9 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:12.827762 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d3000-c829-43ba-bb80-8b5e369d35a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:12.899501 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-8c5d3000-c829-43ba-bb80-8b5e369d35a9 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:52:12.900864 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-8c5d3000-c829-43ba-bb80-8b5e369d35a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:13.001726 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:13.004760 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 686/1365] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:52:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:52:13.301992 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14cc6a-8f8b-4c29-b785-285a3a03b465 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:13.302456 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14cc6a-8f8b-4c29-b785-285a3a03b465 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:13.302814 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14cc6a-8f8b-4c29-b785-285a3a03b465 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:13.304237 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 680/1366] 10.222.0.25 () {54 vars in 962 bytes} [Tue Aug 30 15:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:52:13.310067 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd832aa8-9eb1-4ddd-b2fc-f42819d10a31 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:13.310360 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd832aa8-9eb1-4ddd-b2fc-f42819d10a31 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:13.310639 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd832aa8-9eb1-4ddd-b2fc-f42819d10a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:13.390120 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-dd832aa8-9eb1-4ddd-b2fc-f42819d10a31 None None] MFA Rules not processed for user `ebc80bf891614fb895af33ca1ded6b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:52:13.391341 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-dd832aa8-9eb1-4ddd-b2fc-f42819d10a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:13.516326 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 687/1367] 10.222.0.25 () {58 vars in 1059 bytes} [Tue Aug 30 15:52:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:52:13.524130 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14cc6a-8f8b-4c29-b785-285a3a03b465 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:52:13.525694 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-6e14cc6a-8f8b-4c29-b785-285a3a03b465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:13.689363 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14cc6a-8f8b-4c29-b785-285a3a03b465 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:52:13.710572 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:13.815317 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8818fe-533e-44cf-848e-af2078209a89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:52:13.815937 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8818fe-533e-44cf-848e-af2078209a89 service nova] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:13.816215 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8818fe-533e-44cf-848e-af2078209a89 service nova] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:13.816490 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8818fe-533e-44cf-848e-af2078209a89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:13.818131 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-bd8818fe-533e-44cf-848e-af2078209a89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:13.919775 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8818fe-533e-44cf-848e-af2078209a89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:52:13.922029 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8818fe-533e-44cf-848e-af2078209a89 service nova] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:52:13.942848 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 681/1368] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:52:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:52:14.483906 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9093a0-f2cd-4c37-92f0-8bd9e458ac31 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:14.483906 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9093a0-f2cd-4c37-92f0-8bd9e458ac31 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:14.483906 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9093a0-f2cd-4c37-92f0-8bd9e458ac31 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:14.485013 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 688/1369] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:52:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:52:14.489827 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4348e-90b7-46cb-83db-ae9a00f8961b None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:14.490120 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4348e-90b7-46cb-83db-ae9a00f8961b None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:14.490396 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4348e-90b7-46cb-83db-ae9a00f8961b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:14.525283 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:14.564112 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-97e4348e-90b7-46cb-83db-ae9a00f8961b None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:52:14.565353 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-97e4348e-90b7-46cb-83db-ae9a00f8961b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:14.667038 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 682/1370] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:52:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:52:15.260857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff7d8e-6d8e-406d-913d-ae4e0493aff5 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:15.260857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff7d8e-6d8e-406d-913d-ae4e0493aff5 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:15.260857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff7d8e-6d8e-406d-913d-ae4e0493aff5 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:15.260857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 689/1371] 10.222.0.25 () {54 vars in 964 bytes} [Tue Aug 30 15:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:52:15.267347 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e224592-3769-4b59-bbdf-57ac765ae827 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:15.267828 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e224592-3769-4b59-bbdf-57ac765ae827 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:15.268032 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e224592-3769-4b59-bbdf-57ac765ae827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:15.348970 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-4e224592-3769-4b59-bbdf-57ac765ae827 None None] MFA Rules not processed for user `130166ecc884456d94dbf6c6905168fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:52:15.350304 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-4e224592-3769-4b59-bbdf-57ac765ae827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:15.403182 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:15.440197 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 683/1372] 10.222.0.25 () {58 vars in 1061 bytes} [Tue Aug 30 15:52:15 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:52:15.447530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff7d8e-6d8e-406d-913d-ae4e0493aff5 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:52:15.449398 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-a3ff7d8e-6d8e-406d-913d-ae4e0493aff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:15.504581 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:15.564234 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff7d8e-6d8e-406d-913d-ae4e0493aff5 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:52:15.645538 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c03e0-bab0-420c-acf6-fa563b50d661 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:52:15.646423 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c03e0-bab0-420c-acf6-fa563b50d661 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:15.646800 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c03e0-bab0-420c-acf6-fa563b50d661 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:15.647189 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c03e0-bab0-420c-acf6-fa563b50d661 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:15.649287 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-248c03e0-bab0-420c-acf6-fa563b50d661 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:15.769451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:15.785992 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248c03e0-bab0-420c-acf6-fa563b50d661 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:52:15.787475 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248c03e0-bab0-420c-acf6-fa563b50d661 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:52:15.813609 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 690/1373] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:52:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:52:16.010832 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcccfd4-d43e-40ed-91a3-2c2162668c8c None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:16.011081 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcccfd4-d43e-40ed-91a3-2c2162668c8c None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:16.011533 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcccfd4-d43e-40ed-91a3-2c2162668c8c None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:16.017677 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 684/1374] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:52:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:52:16.023510 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cabdf8-25b6-4c06-af74-410d591699e6 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:16.023510 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cabdf8-25b6-4c06-af74-410d591699e6 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:16.025129 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cabdf8-25b6-4c06-af74-410d591699e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:16.111226 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-22cabdf8-25b6-4c06-af74-410d591699e6 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:52:16.112427 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-22cabdf8-25b6-4c06-af74-410d591699e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:16.207756 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 691/1375] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:52:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:52:16.502720 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcccfd4-d43e-40ed-91a3-2c2162668c8c None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:52:16.504256 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-5dcccfd4-d43e-40ed-91a3-2c2162668c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:16.656080 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcccfd4-d43e-40ed-91a3-2c2162668c8c None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:52:16.715857 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:16.783382 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d00682-903e-4888-8614-bbb74b585bb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:52:16.783920 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d00682-903e-4888-8614-bbb74b585bb3 service nova] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:16.784196 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d00682-903e-4888-8614-bbb74b585bb3 service nova] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:16.784465 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d00682-903e-4888-8614-bbb74b585bb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:16.786107 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-00d00682-903e-4888-8614-bbb74b585bb3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:16.875054 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d00682-903e-4888-8614-bbb74b585bb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:52:16.876651 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d00682-903e-4888-8614-bbb74b585bb3 service nova] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:52:16.894509 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 685/1376] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:52:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:52:18.828134 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fa4a7-e1ee-48e4-b0a9-5b748b263296 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:18.828134 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fa4a7-e1ee-48e4-b0a9-5b748b263296 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:18.828684 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fa4a7-e1ee-48e4-b0a9-5b748b263296 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:18.829774 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 692/1377] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:52:18.835066 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba0f6c-7b92-4ea5-bb8a-137fef049130 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:18.835491 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba0f6c-7b92-4ea5-bb8a-137fef049130 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:18.836029 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba0f6c-7b92-4ea5-bb8a-137fef049130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:18.909182 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-7bba0f6c-7b92-4ea5-bb8a-137fef049130 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:52:18.910404 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-7bba0f6c-7b92-4ea5-bb8a-137fef049130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:18.919867 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:19.025067 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 686/1378] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:52:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:52:19.325311 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82fa4a7-e1ee-48e4-b0a9-5b748b263296 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:52:19.326877 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-f82fa4a7-e1ee-48e4-b0a9-5b748b263296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:19.407977 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:19.517039 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82fa4a7-e1ee-48e4-b0a9-5b748b263296 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:52:19.649065 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67ce3e-83eb-4bee-9f7d-947e7f659c16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:52:19.649685 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67ce3e-83eb-4bee-9f7d-947e7f659c16 service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:19.649967 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67ce3e-83eb-4bee-9f7d-947e7f659c16 service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:19.650240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67ce3e-83eb-4bee-9f7d-947e7f659c16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:19.652192 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-2f67ce3e-83eb-4bee-9f7d-947e7f659c16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:19.673614 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:19.761882 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f67ce3e-83eb-4bee-9f7d-947e7f659c16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:52:19.763632 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f67ce3e-83eb-4bee-9f7d-947e7f659c16 service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:52:19.786682 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 693/1379] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:52:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:52:21.738723 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35f52a-247e-4c89-857a-fc2df1cd78a2 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:21.739154 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35f52a-247e-4c89-857a-fc2df1cd78a2 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:21.739807 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35f52a-247e-4c89-857a-fc2df1cd78a2 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:21.741058 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 687/1380] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:52:21.746635 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37aeb9-bac9-4679-af95-ae7abfcb7c75 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:21.747145 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37aeb9-bac9-4679-af95-ae7abfcb7c75 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:21.747145 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37aeb9-bac9-4679-af95-ae7abfcb7c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:21.818090 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-9d37aeb9-bac9-4679-af95-ae7abfcb7c75 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:52:21.819441 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-9d37aeb9-bac9-4679-af95-ae7abfcb7c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:21.915061 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:21.923187 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 694/1381] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:52:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:52:22.211670 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35f52a-247e-4c89-857a-fc2df1cd78a2 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:52:22.213318 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-7c35f52a-247e-4c89-857a-fc2df1cd78a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:22.369907 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:22.382257 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35f52a-247e-4c89-857a-fc2df1cd78a2 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:52:22.502473 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c96c6-521f-4052-b80b-7397b2ded51d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:52:22.503129 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c96c6-521f-4052-b80b-7397b2ded51d service nova] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:22.503484 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c96c6-521f-4052-b80b-7397b2ded51d service nova] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:22.503760 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c96c6-521f-4052-b80b-7397b2ded51d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:22.505357 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-f02c96c6-521f-4052-b80b-7397b2ded51d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:22.599088 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c96c6-521f-4052-b80b-7397b2ded51d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:52:22.600711 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c96c6-521f-4052-b80b-7397b2ded51d service nova] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:52:22.611685 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:22.621596 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 688/1382] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:52:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:52:24.554680 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0f942-15e5-4ca6-9dc9-2c8a0ba0ac6b None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:24.555216 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0f942-15e5-4ca6-9dc9-2c8a0ba0ac6b None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:24.555216 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0f942-15e5-4ca6-9dc9-2c8a0ba0ac6b None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:24.556542 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 695/1383] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:52:24.562186 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe0147-e5a8-4ec0-a353-0f374cd85653 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:24.562617 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe0147-e5a8-4ec0-a353-0f374cd85653 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:24.562747 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe0147-e5a8-4ec0-a353-0f374cd85653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:24.629504 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-edbe0147-e5a8-4ec0-a353-0f374cd85653 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:52:24.630741 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-edbe0147-e5a8-4ec0-a353-0f374cd85653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:24.730482 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 689/1384] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:52:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:52:25.025399 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0f942-15e5-4ca6-9dc9-2c8a0ba0ac6b None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:52:25.027835 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-4bb0f942-15e5-4ca6-9dc9-2c8a0ba0ac6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:25.176667 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0f942-15e5-4ca6-9dc9-2c8a0ba0ac6b None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:52:25.245221 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:25.292024 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e0c65-ca7b-4df7-8154-15937a10726b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:52:25.292535 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e0c65-ca7b-4df7-8154-15937a10726b service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:25.292831 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e0c65-ca7b-4df7-8154-15937a10726b service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:25.293100 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e0c65-ca7b-4df7-8154-15937a10726b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:25.294678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-a20e0c65-ca7b-4df7-8154-15937a10726b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:25.392987 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20e0c65-ca7b-4df7-8154-15937a10726b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:52:25.394695 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20e0c65-ca7b-4df7-8154-15937a10726b service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:52:25.415809 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 696/1385] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:52:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:52:27.372456 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819c9af-1761-4e9e-8156-fe2770d8cdad None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:27.373046 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819c9af-1761-4e9e-8156-fe2770d8cdad None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:27.373143 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819c9af-1761-4e9e-8156-fe2770d8cdad None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:27.374474 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 690/1386] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:52:27.379738 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39900dcc-2302-4e8c-8932-2571e22dcb45 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:27.380148 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39900dcc-2302-4e8c-8932-2571e22dcb45 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:27.380283 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39900dcc-2302-4e8c-8932-2571e22dcb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:27.445799 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-39900dcc-2302-4e8c-8932-2571e22dcb45 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:52:27.447010 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-39900dcc-2302-4e8c-8932-2571e22dcb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:27.480120 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:27.544604 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 697/1387] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:52:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:52:27.833477 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819c9af-1761-4e9e-8156-fe2770d8cdad None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:52:27.835246 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-7819c9af-1761-4e9e-8156-fe2770d8cdad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:27.915270 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:27.984968 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819c9af-1761-4e9e-8156-fe2770d8cdad None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:52:28.113862 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7053a8d-cc67-4936-ab2c-7e0f64fce3f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:52:28.114477 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7053a8d-cc67-4936-ab2c-7e0f64fce3f7 service nova] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:28.114756 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7053a8d-cc67-4936-ab2c-7e0f64fce3f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:28.115026 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7053a8d-cc67-4936-ab2c-7e0f64fce3f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:28.116641 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-d7053a8d-cc67-4936-ab2c-7e0f64fce3f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:28.157670 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:28.216020 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7053a8d-cc67-4936-ab2c-7e0f64fce3f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:52:28.217660 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7053a8d-cc67-4936-ab2c-7e0f64fce3f7 service nova] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:52:28.236742 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 691/1388] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:52:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:52:30.154014 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473d596-6310-4f07-95ce-eb6badb26552 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:30.154571 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473d596-6310-4f07-95ce-eb6badb26552 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:30.154571 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473d596-6310-4f07-95ce-eb6badb26552 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:30.155905 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 698/1389] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:52:30.161109 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7719461-b5ea-4285-8b44-ddd8faae0461 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:30.161510 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7719461-b5ea-4285-8b44-ddd8faae0461 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:30.161640 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7719461-b5ea-4285-8b44-ddd8faae0461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:30.226720 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-a7719461-b5ea-4285-8b44-ddd8faae0461 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:52:30.227913 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-a7719461-b5ea-4285-8b44-ddd8faae0461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:30.334465 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 692/1390] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:52:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:52:30.621174 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b473d596-6310-4f07-95ce-eb6badb26552 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:52:30.622689 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-b473d596-6310-4f07-95ce-eb6badb26552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:30.770313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b473d596-6310-4f07-95ce-eb6badb26552 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:52:30.787371 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:30.883538 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f92ee-98a5-4bf5-93e8-7e145c861068 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:52:30.884064 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f92ee-98a5-4bf5-93e8-7e145c861068 service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:30.884360 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f92ee-98a5-4bf5-93e8-7e145c861068 service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:30.884629 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f92ee-98a5-4bf5-93e8-7e145c861068 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:30.887020 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-d90f92ee-98a5-4bf5-93e8-7e145c861068 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:30.980164 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90f92ee-98a5-4bf5-93e8-7e145c861068 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:52:30.981782 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90f92ee-98a5-4bf5-93e8-7e145c861068 service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:52:31.001577 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 699/1391] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:52:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:52:32.963015 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901e9d1-a8c8-4bc3-bfb5-7f59f2d146ea None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:32.963933 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901e9d1-a8c8-4bc3-bfb5-7f59f2d146ea None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:32.963933 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901e9d1-a8c8-4bc3-bfb5-7f59f2d146ea None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:32.965104 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 693/1392] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:52:32.970906 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385df6e8-bc3b-4ec8-830b-a2f92b6faf91 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:32.971365 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385df6e8-bc3b-4ec8-830b-a2f92b6faf91 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:32.971680 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385df6e8-bc3b-4ec8-830b-a2f92b6faf91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:33.002203 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:33.045755 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-385df6e8-bc3b-4ec8-830b-a2f92b6faf91 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:52:33.046961 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-385df6e8-bc3b-4ec8-830b-a2f92b6faf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:33.162960 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 700/1393] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:52:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:52:33.453212 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e901e9d1-a8c8-4bc3-bfb5-7f59f2d146ea None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:52:33.454732 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-e901e9d1-a8c8-4bc3-bfb5-7f59f2d146ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:33.468351 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:33.611668 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e901e9d1-a8c8-4bc3-bfb5-7f59f2d146ea None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:52:33.704104 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:33.733002 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4645a-c890-4995-b10f-afdd137f6966 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:52:33.733628 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4645a-c890-4995-b10f-afdd137f6966 service nova] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:33.733902 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4645a-c890-4995-b10f-afdd137f6966 service nova] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:33.734169 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4645a-c890-4995-b10f-afdd137f6966 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:33.735879 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-ccc4645a-c890-4995-b10f-afdd137f6966 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:33.829992 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc4645a-c890-4995-b10f-afdd137f6966 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:52:33.831608 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc4645a-c890-4995-b10f-afdd137f6966 service nova] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:52:33.850529 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 694/1394] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:52:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:52:35.776571 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3464a-3f05-4c7a-ad62-bf590723fa7b None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:35.777204 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3464a-3f05-4c7a-ad62-bf590723fa7b None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:35.777204 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3464a-3f05-4c7a-ad62-bf590723fa7b None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:35.778680 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 701/1395] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:52:35.783811 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b99a3-ccb9-422e-9678-d261cd84a515 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:35.784266 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b99a3-ccb9-422e-9678-d261cd84a515 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:35.784374 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b99a3-ccb9-422e-9678-d261cd84a515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:35.847021 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce4646-b10c-46de-bacb-8118150b3173 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:35.847308 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce4646-b10c-46de-bacb-8118150b3173 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:35.847579 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce4646-b10c-46de-bacb-8118150b3173 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:35.848956 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 702/1396] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 15:52:35.851221 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-7f2b99a3-ccb9-422e-9678-d261cd84a515 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:52:35.852511 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-7f2b99a3-ccb9-422e-9678-d261cd84a515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:35.854909 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca704af4-1b28-4cdc-8bd8-2c988d512e43 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:35.855350 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca704af4-1b28-4cdc-8bd8-2c988d512e43 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:35.855629 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca704af4-1b28-4cdc-8bd8-2c988d512e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:35.905369 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:35.923934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-ca704af4-1b28-4cdc-8bd8-2c988d512e43 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:52:35.925206 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-ca704af4-1b28-4cdc-8bd8-2c988d512e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:35.953668 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 695/1397] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:52:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:52:35.975392 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:36.023167 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 703/1398] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:52:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:52:36.240183 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b99a3-ccb9-422e-9678-d261cd84a515 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:52:36.241427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-7f2b99a3-ccb9-422e-9678-d261cd84a515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:36.326702 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd36d1-652a-448c-b100-5c6307b522ed None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:36.326991 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd36d1-652a-448c-b100-5c6307b522ed None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:36.327267 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd36d1-652a-448c-b100-5c6307b522ed None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:36.328609 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 704/1399] 10.222.0.25 () {54 vars in 967 bytes} [Tue Aug 30 15:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 15:52:36.333590 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ad54b-23b8-4c15-8222-2d506c4c54ce None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:36.333871 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ad54b-23b8-4c15-8222-2d506c4c54ce None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:36.334141 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ad54b-23b8-4c15-8222-2d506c4c54ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:36.360504 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b99a3-ccb9-422e-9678-d261cd84a515 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:52:36.410763 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-5b3ad54b-23b8-4c15-8222-2d506c4c54ce None None] MFA Rules not processed for user `f9bd815f8fe54d7d99e00a47212ad9ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:52:36.411978 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-5b3ad54b-23b8-4c15-8222-2d506c4c54ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:36.425777 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:36.479492 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d908222-373d-4bc4-afef-f49793de490a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:52:36.480015 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d908222-373d-4bc4-afef-f49793de490a service nova] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:36.480289 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d908222-373d-4bc4-afef-f49793de490a service nova] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:36.480556 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d908222-373d-4bc4-afef-f49793de490a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:36.482205 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-9d908222-373d-4bc4-afef-f49793de490a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:36.490638 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 705/1400] 10.222.0.25 () {58 vars in 1064 bytes} [Tue Aug 30 15:52:36 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:52:36.498095 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ad54b-23b8-4c15-8222-2d506c4c54ce None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:52:36.507305 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ad54b-23b8-4c15-8222-2d506c4c54ce None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:52:36.551993 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:36.580629 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d908222-373d-4bc4-afef-f49793de490a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:52:36.582264 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d908222-373d-4bc4-afef-f49793de490a service nova] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:52:36.586501 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e464914-3c49-43af-b6d2-eea9cf0464a2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9bd815f8fe54d7d99e00a47212ad9ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:52:36.587107 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e464914-3c49-43af-b6d2-eea9cf0464a2 service glance] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:36.587382 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e464914-3c49-43af-b6d2-eea9cf0464a2 service glance] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:36.587651 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e464914-3c49-43af-b6d2-eea9cf0464a2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:36.589842 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-5e464914-3c49-43af-b6d2-eea9cf0464a2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:36.601045 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 696/1401] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:52:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:52:36.708560 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e464914-3c49-43af-b6d2-eea9cf0464a2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:52:36.710555 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e464914-3c49-43af-b6d2-eea9cf0464a2 service glance] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:52:36.738634 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 706/1402] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:52:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:52:37.506010 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ad3e9-045f-4ab2-a5db-7ee89412dc49 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:37.506780 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ad3e9-045f-4ab2-a5db-7ee89412dc49 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:37.506959 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ad3e9-045f-4ab2-a5db-7ee89412dc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:37.577121 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-d73ad3e9-045f-4ab2-a5db-7ee89412dc49 None None] MFA Rules not processed for user `d7958b395d5e4f5da37927536b1856ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:52:37.578405 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-d73ad3e9-045f-4ab2-a5db-7ee89412dc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:37.601969 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:37.670539 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 697/1403] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Aug 30 15:52:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:52:37.711699 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32630edf-a9b7-4ff5-9cb8-b49daaf11f1a None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:37.712282 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32630edf-a9b7-4ff5-9cb8-b49daaf11f1a None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:37.712282 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32630edf-a9b7-4ff5-9cb8-b49daaf11f1a None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:37.714225 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 707/1404] 10.222.0.25 () {54 vars in 943 bytes} [Tue Aug 30 15:52:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:52:37.723348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1800d0d-b363-4302-8a64-8704d515f300 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:37.723645 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1800d0d-b363-4302-8a64-8704d515f300 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:37.723933 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1800d0d-b363-4302-8a64-8704d515f300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:37.800914 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-d1800d0d-b363-4302-8a64-8704d515f300 None None] MFA Rules not processed for user `94765f224c734beabe83b4dc0c5e511f`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:52:37.802129 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-d1800d0d-b363-4302-8a64-8704d515f300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:37.904198 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:37.910958 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 698/1405] 10.222.0.25 () {58 vars in 1040 bytes} [Tue Aug 30 15:52:37 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:52:37.922010 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32630edf-a9b7-4ff5-9cb8-b49daaf11f1a None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:52:37.923596 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-32630edf-a9b7-4ff5-9cb8-b49daaf11f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:37.999543 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:38.069120 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32630edf-a9b7-4ff5-9cb8-b49daaf11f1a None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:52:38.179602 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f03c49-33c5-42df-a7df-9274e60ef37c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94765f224c734beabe83b4dc0c5e511f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:52:38.180609 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f03c49-33c5-42df-a7df-9274e60ef37c service swift] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:38.180928 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f03c49-33c5-42df-a7df-9274e60ef37c service swift] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:38.181202 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f03c49-33c5-42df-a7df-9274e60ef37c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:38.182867 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-82f03c49-33c5-42df-a7df-9274e60ef37c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:38.238160 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:38.268376 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f03c49-33c5-42df-a7df-9274e60ef37c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:52:38.270106 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f03c49-33c5-42df-a7df-9274e60ef37c service swift] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:52:38.278659 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 708/1406] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Aug 30 15:52:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 15:52:38.547605 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae781d3c-d6c5-43e8-bbf5-cb729fc6eed2 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:38.548128 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae781d3c-d6c5-43e8-bbf5-cb729fc6eed2 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:38.548128 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae781d3c-d6c5-43e8-bbf5-cb729fc6eed2 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:38.551235 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 699/1407] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:52:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 15:52:38.557395 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f5be4-1fd0-4911-ac8d-c30a7658340c None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:38.558086 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f5be4-1fd0-4911-ac8d-c30a7658340c None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:38.558579 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f5be4-1fd0-4911-ac8d-c30a7658340c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:38.631898 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-884f5be4-1fd0-4911-ac8d-c30a7658340c None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:52:38.633544 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-884f5be4-1fd0-4911-ac8d-c30a7658340c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:38.741834 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 709/1408] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:52:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:52:39.035541 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae781d3c-d6c5-43e8-bbf5-cb729fc6eed2 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:52:39.035541 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-ae781d3c-d6c5-43e8-bbf5-cb729fc6eed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:39.229472 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae781d3c-d6c5-43e8-bbf5-cb729fc6eed2 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:52:39.317749 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:39.371643 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e158c-0ee2-44cb-8d00-a5427b805d3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:52:39.372265 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e158c-0ee2-44cb-8d00-a5427b805d3a service nova] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:52:39.372549 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e158c-0ee2-44cb-8d00-a5427b805d3a service nova] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:52:39.372859 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e158c-0ee2-44cb-8d00-a5427b805d3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:52:39.374502 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-8b9e158c-0ee2-44cb-8d00-a5427b805d3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:52:39.473175 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e158c-0ee2-44cb-8d00-a5427b805d3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:52:39.475084 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e158c-0ee2-44cb-8d00-a5427b805d3a service nova] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:52:39.498301 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 700/1409] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:52:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:52:48.738868 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=79 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:49.495389 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=64 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:00.512942 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc89989-d20c-4e33-b768-e2fc9baa1dc4 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:00.513513 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc89989-d20c-4e33-b768-e2fc9baa1dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:00.513513 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc89989-d20c-4e33-b768-e2fc9baa1dc4 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:00.514803 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 710/1410] 10.222.0.25 () {54 vars in 918 bytes} [Tue Aug 30 15:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:53:00.519860 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555b586-72a0-46dd-8d67-4bf1ebadd39b None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:00.520298 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555b586-72a0-46dd-8d67-4bf1ebadd39b None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:00.520447 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555b586-72a0-46dd-8d67-4bf1ebadd39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:00.596051 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-7555b586-72a0-46dd-8d67-4bf1ebadd39b None None] MFA Rules not processed for user `2bba851e1a0d4601b5d4841662f645dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:53:00.597285 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-7555b586-72a0-46dd-8d67-4bf1ebadd39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:00.704457 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 701/1411] 10.222.0.25 () {58 vars in 1015 bytes} [Tue Aug 30 15:53:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:53:00.718832 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38c328-3b07-467e-9a40-efd3480a35cf None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:00.719152 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38c328-3b07-467e-9a40-efd3480a35cf None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:00.719447 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38c328-3b07-467e-9a40-efd3480a35cf None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:00.721042 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 711/1412] 10.222.0.25 () {54 vars in 918 bytes} [Tue Aug 30 15:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:53:00.725611 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d1055-06ea-432b-b4ab-9551e92ae489 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:00.725898 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d1055-06ea-432b-b4ab-9551e92ae489 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:00.726193 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d1055-06ea-432b-b4ab-9551e92ae489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:00.800237 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:00.803334 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-da2d1055-06ea-432b-b4ab-9551e92ae489 None None] MFA Rules not processed for user `ebc80bf891614fb895af33ca1ded6b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:53:00.805116 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-da2d1055-06ea-432b-b4ab-9551e92ae489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:00.923316 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 702/1413] 10.222.0.25 () {58 vars in 1015 bytes} [Tue Aug 30 15:53:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:53:03.316393 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f9b24-df83-43e1-bfad-2c258e591734 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:03.316946 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f9b24-df83-43e1-bfad-2c258e591734 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:03.317042 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f9b24-df83-43e1-bfad-2c258e591734 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:03.318295 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 712/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 15:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:53:03.324094 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db84d3-f5d6-4286-8c16-663b6e6e6bb0 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:03.324470 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db84d3-f5d6-4286-8c16-663b6e6e6bb0 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:03.324645 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db84d3-f5d6-4286-8c16-663b6e6e6bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:03.390596 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-89db84d3-f5d6-4286-8c16-663b6e6e6bb0 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:53:03.391792 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-89db84d3-f5d6-4286-8c16-663b6e6e6bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:03.446483 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:03.488237 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 703/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 15:53:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:53:03.776844 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f9b24-df83-43e1-bfad-2c258e591734 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:53:03.778364 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-754f9b24-df83-43e1-bfad-2c258e591734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:03.921404 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f9b24-df83-43e1-bfad-2c258e591734 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:53:03.993412 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:04.034392 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b10224-c5b6-41d3-82a5-d91efd14d447 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:53:04.035005 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b10224-c5b6-41d3-82a5-d91efd14d447 service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:04.035280 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b10224-c5b6-41d3-82a5-d91efd14d447 service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:04.035549 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b10224-c5b6-41d3-82a5-d91efd14d447 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:04.037169 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-d2b10224-c5b6-41d3-82a5-d91efd14d447 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:04.124530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b10224-c5b6-41d3-82a5-d91efd14d447 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:53:04.126691 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b10224-c5b6-41d3-82a5-d91efd14d447 service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:53:04.144379 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 713/1416] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:53:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:53:05.032444 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb5467-7f56-4796-9cd3-9fbbabd154b5 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:05.032996 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb5467-7f56-4796-9cd3-9fbbabd154b5 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:05.032996 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb5467-7f56-4796-9cd3-9fbbabd154b5 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:05.034313 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 704/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 15:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:53:05.039239 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1a374-f5da-4bdf-aa8d-892942119609 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:05.039630 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1a374-f5da-4bdf-aa8d-892942119609 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:05.039773 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1a374-f5da-4bdf-aa8d-892942119609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:05.115938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-05b1a374-f5da-4bdf-aa8d-892942119609 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:53:05.117191 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-05b1a374-f5da-4bdf-aa8d-892942119609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:05.144222 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:05.214895 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 714/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 15:53:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:53:05.361725 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb5467-7f56-4796-9cd3-9fbbabd154b5 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:53:05.363323 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-9ecb5467-7f56-4796-9cd3-9fbbabd154b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:05.507937 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb5467-7f56-4796-9cd3-9fbbabd154b5 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:53:05.548868 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:05.626655 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c38893-d0f8-478d-b23f-f6dce2ec0cc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:53:05.627161 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c38893-d0f8-478d-b23f-f6dce2ec0cc7 service nova] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:05.627444 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c38893-d0f8-478d-b23f-f6dce2ec0cc7 service nova] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:05.627713 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c38893-d0f8-478d-b23f-f6dce2ec0cc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:05.629337 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-c5c38893-d0f8-478d-b23f-f6dce2ec0cc7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:05.719995 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c38893-d0f8-478d-b23f-f6dce2ec0cc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:53:05.719995 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c38893-d0f8-478d-b23f-f6dce2ec0cc7 service nova] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:53:05.737828 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 705/1419] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:53:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:53:06.615080 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63c921-f435-4d14-9bf1-211e68ef77e0 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:06.615606 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63c921-f435-4d14-9bf1-211e68ef77e0 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:06.615715 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63c921-f435-4d14-9bf1-211e68ef77e0 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:06.617025 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 715/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 15:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 15:53:06.622094 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab50895-7006-412e-9303-b6bbd072811e None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:06.622541 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab50895-7006-412e-9303-b6bbd072811e None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:06.622667 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab50895-7006-412e-9303-b6bbd072811e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:06.677325 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:06.699799 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-2ab50895-7006-412e-9303-b6bbd072811e None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:53:06.701092 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-2ab50895-7006-412e-9303-b6bbd072811e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:06.801353 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 706/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 15:53:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:53:06.951088 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63c921-f435-4d14-9bf1-211e68ef77e0 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:53:06.952620 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-ca63c921-f435-4d14-9bf1-211e68ef77e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:07.096427 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63c921-f435-4d14-9bf1-211e68ef77e0 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:53:07.109603 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:07.210764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065d540-6839-40cc-830f-e97e682cb0e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:53:07.211372 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065d540-6839-40cc-830f-e97e682cb0e6 service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:07.211650 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065d540-6839-40cc-830f-e97e682cb0e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:07.211918 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065d540-6839-40cc-830f-e97e682cb0e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:07.214218 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-8065d540-6839-40cc-830f-e97e682cb0e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:07.301675 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8065d540-6839-40cc-830f-e97e682cb0e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:53:07.303257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8065d540-6839-40cc-830f-e97e682cb0e6 service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:53:07.320772 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 716/1422] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:53:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:53:08.177844 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59ac47-45e7-4345-b2b4-f479dcc59181 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:08.178399 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59ac47-45e7-4345-b2b4-f479dcc59181 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:08.178399 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59ac47-45e7-4345-b2b4-f479dcc59181 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:08.179744 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 707/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 15:53:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:53:08.184837 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daabe16-dba6-4196-aa9f-347db48779fe None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:08.185252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daabe16-dba6-4196-aa9f-347db48779fe None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:08.185411 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daabe16-dba6-4196-aa9f-347db48779fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:08.205453 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:08.262897 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-8daabe16-dba6-4196-aa9f-347db48779fe None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:53:08.264091 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-8daabe16-dba6-4196-aa9f-347db48779fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:08.361123 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 717/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 15:53:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:53:08.511801 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59ac47-45e7-4345-b2b4-f479dcc59181 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:53:08.513367 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-0d59ac47-45e7-4345-b2b4-f479dcc59181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:08.622856 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:08.659094 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59ac47-45e7-4345-b2b4-f479dcc59181 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:53:08.772967 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0354e2-ecd5-4262-a421-3fa1dd288150 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:53:08.773580 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0354e2-ecd5-4262-a421-3fa1dd288150 service nova] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:08.773861 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0354e2-ecd5-4262-a421-3fa1dd288150 service nova] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:08.774135 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0354e2-ecd5-4262-a421-3fa1dd288150 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:08.775749 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-af0354e2-ecd5-4262-a421-3fa1dd288150 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:08.854786 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:08.868799 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0354e2-ecd5-4262-a421-3fa1dd288150 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:53:08.871002 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0354e2-ecd5-4262-a421-3fa1dd288150 service nova] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:53:08.890067 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 708/1425] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:53:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:53:09.753778 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a244834-b684-4a7f-9e24-d16e67180a18 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:09.754235 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a244834-b684-4a7f-9e24-d16e67180a18 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:09.754349 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a244834-b684-4a7f-9e24-d16e67180a18 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:09.755674 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 718/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 15:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:53:09.760998 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59b155-a9c9-4fe1-9022-bdb2f745c42b None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:09.761382 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59b155-a9c9-4fe1-9022-bdb2f745c42b None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:09.761550 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59b155-a9c9-4fe1-9022-bdb2f745c42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:09.850560 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-dc59b155-a9c9-4fe1-9022-bdb2f745c42b None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:53:09.851772 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-dc59b155-a9c9-4fe1-9022-bdb2f745c42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:09.984746 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 709/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 15:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:53:10.180191 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a244834-b684-4a7f-9e24-d16e67180a18 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:53:10.182607 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7a244834-b684-4a7f-9e24-d16e67180a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:10.279775 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:10.357895 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a244834-b684-4a7f-9e24-d16e67180a18 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:53:10.484701 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f069e-174d-4e0c-a270-577017e93f41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:53:10.485357 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f069e-174d-4e0c-a270-577017e93f41 service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:10.485632 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f069e-174d-4e0c-a270-577017e93f41 service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:10.485900 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f069e-174d-4e0c-a270-577017e93f41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:10.488386 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-f10f069e-174d-4e0c-a270-577017e93f41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:10.547790 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:10.593689 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10f069e-174d-4e0c-a270-577017e93f41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:53:10.595289 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10f069e-174d-4e0c-a270-577017e93f41 service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:53:10.613142 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 719/1428] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:53:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:53:11.411997 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed10d76-2338-4e87-ba1e-d451c4c669b1 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:11.412565 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed10d76-2338-4e87-ba1e-d451c4c669b1 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:11.412565 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed10d76-2338-4e87-ba1e-d451c4c669b1 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:11.413934 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 710/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 15:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:53:11.419427 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee7cca-9a33-4909-87db-690f97566de7 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:11.419851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee7cca-9a33-4909-87db-690f97566de7 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:11.420002 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee7cca-9a33-4909-87db-690f97566de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:11.497171 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-b0ee7cca-9a33-4909-87db-690f97566de7 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:53:11.498385 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-b0ee7cca-9a33-4909-87db-690f97566de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:11.602258 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 720/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 15:53:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:53:11.756487 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed10d76-2338-4e87-ba1e-d451c4c669b1 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:53:11.758301 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-8ed10d76-2338-4e87-ba1e-d451c4c669b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:11.806701 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:11.905488 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed10d76-2338-4e87-ba1e-d451c4c669b1 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:53:12.020832 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a9f01-f25e-4a69-ae67-3fdf72e1a5eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:53:12.021448 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a9f01-f25e-4a69-ae67-3fdf72e1a5eb service nova] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:12.021726 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a9f01-f25e-4a69-ae67-3fdf72e1a5eb service nova] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:12.021997 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a9f01-f25e-4a69-ae67-3fdf72e1a5eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:12.023648 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-e23a9f01-f25e-4a69-ae67-3fdf72e1a5eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:12.031617 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:12.115257 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a9f01-f25e-4a69-ae67-3fdf72e1a5eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:53:12.116912 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a9f01-f25e-4a69-ae67-3fdf72e1a5eb service nova] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:53:12.135781 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 711/1431] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:53:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:53:12.956194 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b34dd4-71ba-4c59-b478-18f2bf7df443 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:12.956768 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b34dd4-71ba-4c59-b478-18f2bf7df443 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:12.956919 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b34dd4-71ba-4c59-b478-18f2bf7df443 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:12.958149 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 721/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 15:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:53:12.963113 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7946a1d-309e-430e-b3ed-4794b39742b4 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:12.963687 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7946a1d-309e-430e-b3ed-4794b39742b4 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:12.963868 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7946a1d-309e-430e-b3ed-4794b39742b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:13.038704 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-d7946a1d-309e-430e-b3ed-4794b39742b4 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:53:13.039819 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-d7946a1d-309e-430e-b3ed-4794b39742b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:13.109211 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:13.139967 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 712/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 15:53:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:53:13.289349 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b34dd4-71ba-4c59-b478-18f2bf7df443 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:53:13.290847 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-38b34dd4-71ba-4c59-b478-18f2bf7df443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:13.309298 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:13.435365 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b34dd4-71ba-4c59-b478-18f2bf7df443 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:53:13.520385 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:13.547183 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267519f-7972-4705-85de-a05d3a2ab32f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:53:13.547730 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267519f-7972-4705-85de-a05d3a2ab32f service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:13.548010 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267519f-7972-4705-85de-a05d3a2ab32f service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:13.548283 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267519f-7972-4705-85de-a05d3a2ab32f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:13.549915 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-8267519f-7972-4705-85de-a05d3a2ab32f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:13.639837 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8267519f-7972-4705-85de-a05d3a2ab32f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:53:13.641478 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8267519f-7972-4705-85de-a05d3a2ab32f service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:53:13.659809 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 722/1434] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:53:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:53:14.462208 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897fcf8-1204-4601-8f29-cc534e54027c None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:14.462770 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897fcf8-1204-4601-8f29-cc534e54027c None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:14.462770 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897fcf8-1204-4601-8f29-cc534e54027c None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:14.464890 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 713/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 15:53:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:53:14.469538 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4106545-045c-4052-8cef-056ed29e7165 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:14.469923 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4106545-045c-4052-8cef-056ed29e7165 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:14.470089 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4106545-045c-4052-8cef-056ed29e7165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:14.546613 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-a4106545-045c-4052-8cef-056ed29e7165 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:53:14.547870 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-a4106545-045c-4052-8cef-056ed29e7165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:14.587682 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:14.642371 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 723/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 15:53:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:53:14.792553 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897fcf8-1204-4601-8f29-cc534e54027c None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:53:14.794092 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-4897fcf8-1204-4601-8f29-cc534e54027c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:14.936564 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897fcf8-1204-4601-8f29-cc534e54027c None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:53:14.988992 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:15.047634 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b2581-3b36-4ebb-ac08-68e9eb279651 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:53:15.048281 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b2581-3b36-4ebb-ac08-68e9eb279651 service nova] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:15.048561 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b2581-3b36-4ebb-ac08-68e9eb279651 service nova] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:15.048864 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b2581-3b36-4ebb-ac08-68e9eb279651 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:15.050485 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-c36b2581-3b36-4ebb-ac08-68e9eb279651 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:15.140324 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36b2581-3b36-4ebb-ac08-68e9eb279651 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:53:15.141946 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36b2581-3b36-4ebb-ac08-68e9eb279651 service nova] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:53:15.159723 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 714/1437] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:53:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:53:15.961623 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be29fcf-5d37-417b-9c56-e3dc86c2cece None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:15.962034 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be29fcf-5d37-417b-9c56-e3dc86c2cece None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:15.962168 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be29fcf-5d37-417b-9c56-e3dc86c2cece None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:15.963623 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 724/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 15:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:53:15.968537 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ada34-9531-4703-910c-0e1ab915a8ba None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:15.968994 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ada34-9531-4703-910c-0e1ab915a8ba None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:15.969131 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ada34-9531-4703-910c-0e1ab915a8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:16.045677 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-8a2ada34-9531-4703-910c-0e1ab915a8ba None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:53:16.046896 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-8a2ada34-9531-4703-910c-0e1ab915a8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:16.048939 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:16.144544 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 715/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 15:53:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:53:16.295506 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be29fcf-5d37-417b-9c56-e3dc86c2cece None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:53:16.297140 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-4be29fcf-5d37-417b-9c56-e3dc86c2cece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:16.444609 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be29fcf-5d37-417b-9c56-e3dc86c2cece None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:53:16.470481 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:16.554996 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9e5ab-52fa-4636-bf13-4efe43574f16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:53:16.555502 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9e5ab-52fa-4636-bf13-4efe43574f16 service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:16.555775 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9e5ab-52fa-4636-bf13-4efe43574f16 service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:16.556042 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9e5ab-52fa-4636-bf13-4efe43574f16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:16.558210 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-54a9e5ab-52fa-4636-bf13-4efe43574f16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:16.662462 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9e5ab-52fa-4636-bf13-4efe43574f16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:53:16.664733 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9e5ab-52fa-4636-bf13-4efe43574f16 service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:53:16.688425 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 725/1440] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:53:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:53:18.636321 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5aa84-07d1-438e-8a59-1c79ab45e37b None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:18.636897 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5aa84-07d1-438e-8a59-1c79ab45e37b None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:18.636897 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5aa84-07d1-438e-8a59-1c79ab45e37b None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:18.638270 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 716/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 15:53:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:53:18.643596 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f28690-a5c5-422d-bc11-d1a494643ebb None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:18.644021 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f28690-a5c5-422d-bc11-d1a494643ebb None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:18.644124 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f28690-a5c5-422d-bc11-d1a494643ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:18.684301 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:18.711836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-a8f28690-a5c5-422d-bc11-d1a494643ebb None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:53:18.713097 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-a8f28690-a5c5-422d-bc11-d1a494643ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:18.811990 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 726/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 15:53:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:53:19.093624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5aa84-07d1-438e-8a59-1c79ab45e37b None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:53:19.095179 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-dcf5aa84-07d1-438e-8a59-1c79ab45e37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:19.199723 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5aa84-07d1-438e-8a59-1c79ab45e37b None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:53:19.231572 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:19.273345 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc3da9-17c6-4276-942f-228a50e156a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:53:19.273953 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc3da9-17c6-4276-942f-228a50e156a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:19.274235 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc3da9-17c6-4276-942f-228a50e156a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:19.274507 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc3da9-17c6-4276-942f-228a50e156a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:19.276413 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-7dbc3da9-17c6-4276-942f-228a50e156a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:19.384323 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc3da9-17c6-4276-942f-228a50e156a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:53:19.385735 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc3da9-17c6-4276-942f-228a50e156a7 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:53:19.403274 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 717/1443] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:53:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:53:21.440216 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a8755-7245-4c59-9039-5a8ea1358d2a None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:21.440798 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a8755-7245-4c59-9039-5a8ea1358d2a None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:21.440798 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a8755-7245-4c59-9039-5a8ea1358d2a None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:21.442117 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 727/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 15:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:53:21.447620 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785cd55-e836-4df6-96ea-f4a0809c9d9c None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:21.448140 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785cd55-e836-4df6-96ea-f4a0809c9d9c None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:21.448309 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785cd55-e836-4df6-96ea-f4a0809c9d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:21.513211 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-c785cd55-e836-4df6-96ea-f4a0809c9d9c None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:53:21.514396 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-c785cd55-e836-4df6-96ea-f4a0809c9d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:21.526961 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:21.610966 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 718/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 15:53:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:53:21.896732 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a8755-7245-4c59-9039-5a8ea1358d2a None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:53:21.898349 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-4b6a8755-7245-4c59-9039-5a8ea1358d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:22.000717 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a8755-7245-4c59-9039-5a8ea1358d2a None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:53:22.013695 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:22.076204 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edfa294-7e66-4840-9a61-9225b1203b66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:53:22.076923 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfa294-7e66-4840-9a61-9225b1203b66 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:22.077209 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfa294-7e66-4840-9a61-9225b1203b66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:22.077483 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfa294-7e66-4840-9a61-9225b1203b66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:22.079093 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-8edfa294-7e66-4840-9a61-9225b1203b66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:22.188453 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edfa294-7e66-4840-9a61-9225b1203b66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:53:22.189925 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edfa294-7e66-4840-9a61-9225b1203b66 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:53:22.208206 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 728/1446] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:53:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:53:24.424648 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d588b-5660-4dee-9896-9fd69724efac None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:24.425300 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d588b-5660-4dee-9896-9fd69724efac None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:24.425300 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d588b-5660-4dee-9896-9fd69724efac None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:24.426606 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 719/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 15:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:53:24.431708 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0406f-43ad-4465-92ca-eccb6a4667d9 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:24.432130 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0406f-43ad-4465-92ca-eccb6a4667d9 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:24.432973 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0406f-43ad-4465-92ca-eccb6a4667d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:24.480163 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:24.498671 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-10a0406f-43ad-4465-92ca-eccb6a4667d9 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:53:24.499886 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-10a0406f-43ad-4465-92ca-eccb6a4667d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:24.596651 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 729/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 15:53:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:53:24.880304 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d588b-5660-4dee-9896-9fd69724efac None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:53:24.881944 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-2e7d588b-5660-4dee-9896-9fd69724efac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:24.984317 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d588b-5660-4dee-9896-9fd69724efac None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:53:25.024295 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:25.059376 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0ff7e-2cb9-4a87-b7f8-9c0bfcbd5d6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:53:25.059982 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0ff7e-2cb9-4a87-b7f8-9c0bfcbd5d6a service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:25.060258 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0ff7e-2cb9-4a87-b7f8-9c0bfcbd5d6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:25.060526 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0ff7e-2cb9-4a87-b7f8-9c0bfcbd5d6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:25.062171 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-06b0ff7e-2cb9-4a87-b7f8-9c0bfcbd5d6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:25.171327 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0ff7e-2cb9-4a87-b7f8-9c0bfcbd5d6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:53:25.172771 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0ff7e-2cb9-4a87-b7f8-9c0bfcbd5d6a service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:53:25.190406 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 720/1449] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:53:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:53:27.211081 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a249662-43cc-4437-afe6-88c943685cf2 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:27.211649 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a249662-43cc-4437-afe6-88c943685cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:27.211649 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a249662-43cc-4437-afe6-88c943685cf2 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:27.213008 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 730/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 15:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:53:27.218493 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83543a4f-200e-45e2-8c80-43a23872892f None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:27.218947 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83543a4f-200e-45e2-8c80-43a23872892f None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:27.219043 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83543a4f-200e-45e2-8c80-43a23872892f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:27.284381 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-83543a4f-200e-45e2-8c80-43a23872892f None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:53:27.285607 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-83543a4f-200e-45e2-8c80-43a23872892f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:27.305896 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:27.381689 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 721/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 15:53:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:53:27.671142 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a249662-43cc-4437-afe6-88c943685cf2 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:53:27.672713 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-5a249662-43cc-4437-afe6-88c943685cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:27.779288 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a249662-43cc-4437-afe6-88c943685cf2 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:53:27.799325 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:27.852927 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c10c3-32c7-405f-a02e-4f3c22440993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:53:27.853541 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c10c3-32c7-405f-a02e-4f3c22440993 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:27.853821 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c10c3-32c7-405f-a02e-4f3c22440993 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:27.854145 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c10c3-32c7-405f-a02e-4f3c22440993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:27.856314 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-6b1c10c3-32c7-405f-a02e-4f3c22440993 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:27.963936 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c10c3-32c7-405f-a02e-4f3c22440993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:53:27.965015 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c10c3-32c7-405f-a02e-4f3c22440993 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:53:27.983404 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 731/1452] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:53:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:53:29.924711 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91cddf-5779-41c2-9b01-f32c035d06dc None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:29.925335 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91cddf-5779-41c2-9b01-f32c035d06dc None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:29.925335 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91cddf-5779-41c2-9b01-f32c035d06dc None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:29.926650 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 722/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 15:53:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:53:29.931726 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d0672-4eb0-4b30-89d3-6e4918e84769 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:29.932120 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d0672-4eb0-4b30-89d3-6e4918e84769 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:29.932465 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d0672-4eb0-4b30-89d3-6e4918e84769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:29.997271 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:29.999892 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-cb2d0672-4eb0-4b30-89d3-6e4918e84769 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:53:30.001672 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-cb2d0672-4eb0-4b30-89d3-6e4918e84769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:30.097221 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 732/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 15:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:53:30.382647 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91cddf-5779-41c2-9b01-f32c035d06dc None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:53:30.384450 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-5d91cddf-5779-41c2-9b01-f32c035d06dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:30.487369 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91cddf-5779-41c2-9b01-f32c035d06dc None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:53:30.536094 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:30.561849 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a184ed5-9987-4423-ae45-d6a8b80f91b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:53:30.562457 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a184ed5-9987-4423-ae45-d6a8b80f91b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:30.562738 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a184ed5-9987-4423-ae45-d6a8b80f91b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:30.563010 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a184ed5-9987-4423-ae45-d6a8b80f91b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:30.564623 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-5a184ed5-9987-4423-ae45-d6a8b80f91b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:30.673129 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a184ed5-9987-4423-ae45-d6a8b80f91b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:53:30.674503 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a184ed5-9987-4423-ae45-d6a8b80f91b0 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:53:30.692558 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 723/1455] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:53:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:53:32.669082 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ad553-8e68-45b2-aa35-a68735527f5a None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:32.669660 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ad553-8e68-45b2-aa35-a68735527f5a None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:32.669660 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ad553-8e68-45b2-aa35-a68735527f5a None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:32.670990 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 733/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 15:53:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 15:53:32.676481 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b007809-b1c9-448d-aeba-41c64fbc8829 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:32.676905 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b007809-b1c9-448d-aeba-41c64fbc8829 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:32.677051 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b007809-b1c9-448d-aeba-41c64fbc8829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:32.742999 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-6b007809-b1c9-448d-aeba-41c64fbc8829 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:53:32.744207 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-6b007809-b1c9-448d-aeba-41c64fbc8829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:32.773379 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:32.841688 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 724/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 15:53:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:53:33.127791 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ad553-8e68-45b2-aa35-a68735527f5a None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:53:33.129408 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-1f6ad553-8e68-45b2-aa35-a68735527f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:33.234371 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ad553-8e68-45b2-aa35-a68735527f5a None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:53:33.262602 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:33.307969 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c7d5de-6ba7-40ec-bebb-f4aea28458d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:53:33.308510 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7d5de-6ba7-40ec-bebb-f4aea28458d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:33.308813 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7d5de-6ba7-40ec-bebb-f4aea28458d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:33.309096 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7d5de-6ba7-40ec-bebb-f4aea28458d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:33.310702 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-79c7d5de-6ba7-40ec-bebb-f4aea28458d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:33.418001 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c7d5de-6ba7-40ec-bebb-f4aea28458d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:53:33.419432 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c7d5de-6ba7-40ec-bebb-f4aea28458d5 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:53:33.437062 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 734/1458] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:53:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:53:35.451471 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9a987-3aa9-445b-aa50-4af9872452b0 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:35.452043 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9a987-3aa9-445b-aa50-4af9872452b0 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:35.452043 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9a987-3aa9-445b-aa50-4af9872452b0 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:35.453467 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 725/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 15:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:53:35.458550 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5c706-ef7f-483b-b3db-c3dbc3565d9a None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:35.458990 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5c706-ef7f-483b-b3db-c3dbc3565d9a None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:35.459127 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5c706-ef7f-483b-b3db-c3dbc3565d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:35.526801 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-85d5c706-ef7f-483b-b3db-c3dbc3565d9a None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:53:35.527994 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-85d5c706-ef7f-483b-b3db-c3dbc3565d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:35.536190 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:35.626571 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 735/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 15:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:53:35.915603 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9a987-3aa9-445b-aa50-4af9872452b0 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:53:35.917673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-8ce9a987-3aa9-445b-aa50-4af9872452b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:36.020612 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9a987-3aa9-445b-aa50-4af9872452b0 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:53:36.075525 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:36.094456 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78690089-de94-47c7-b3ff-3b01ad214d42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:53:36.095067 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78690089-de94-47c7-b3ff-3b01ad214d42 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:36.095346 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78690089-de94-47c7-b3ff-3b01ad214d42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:36.095649 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78690089-de94-47c7-b3ff-3b01ad214d42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:36.097295 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-78690089-de94-47c7-b3ff-3b01ad214d42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:36.206342 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78690089-de94-47c7-b3ff-3b01ad214d42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:53:36.208508 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78690089-de94-47c7-b3ff-3b01ad214d42 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:53:36.226803 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 726/1461] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:53:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:53:38.185540 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1020b-5078-45be-977f-e1f9edaac59d None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:38.186066 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1020b-5078-45be-977f-e1f9edaac59d None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:38.186066 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1020b-5078-45be-977f-e1f9edaac59d None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:38.187398 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 736/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 15:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:53:38.192554 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836bf73-8b75-4ebb-a01f-10a644f06da8 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:38.193041 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836bf73-8b75-4ebb-a01f-10a644f06da8 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:38.193151 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836bf73-8b75-4ebb-a01f-10a644f06da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:38.261860 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-b836bf73-8b75-4ebb-a01f-10a644f06da8 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:53:38.263079 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-b836bf73-8b75-4ebb-a01f-10a644f06da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:38.301171 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:38.360606 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 727/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 15:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:53:38.646050 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1020b-5078-45be-977f-e1f9edaac59d None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:53:38.647616 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-a9b1020b-5078-45be-977f-e1f9edaac59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:38.752477 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1020b-5078-45be-977f-e1f9edaac59d None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:53:38.797822 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:38.828843 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b16e1c-7001-41b1-859d-6d6f663dd647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:53:38.829480 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b16e1c-7001-41b1-859d-6d6f663dd647 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:38.829759 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b16e1c-7001-41b1-859d-6d6f663dd647 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:38.830027 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b16e1c-7001-41b1-859d-6d6f663dd647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:38.831628 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-d8b16e1c-7001-41b1-859d-6d6f663dd647 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:38.943465 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b16e1c-7001-41b1-859d-6d6f663dd647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:53:38.944845 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b16e1c-7001-41b1-859d-6d6f663dd647 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:53:38.962556 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 737/1464] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:53:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:53:40.896638 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0c041-abe4-445e-aad8-c49560f9f0f0 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:40.897254 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0c041-abe4-445e-aad8-c49560f9f0f0 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:40.897254 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0c041-abe4-445e-aad8-c49560f9f0f0 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:40.898604 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 728/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 15:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:53:40.904374 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a42a9-8bb4-4b38-bfc0-4ac8be0f7ba8 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:40.904905 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a42a9-8bb4-4b38-bfc0-4ac8be0f7ba8 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:40.905016 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a42a9-8bb4-4b38-bfc0-4ac8be0f7ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:40.971786 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-822a42a9-8bb4-4b38-bfc0-4ac8be0f7ba8 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:53:40.973069 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-822a42a9-8bb4-4b38-bfc0-4ac8be0f7ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:40.990898 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:41.069031 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 738/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 15:53:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:53:41.374612 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0c041-abe4-445e-aad8-c49560f9f0f0 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:53:41.376163 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-fae0c041-abe4-445e-aad8-c49560f9f0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:41.479651 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0c041-abe4-445e-aad8-c49560f9f0f0 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:53:41.544069 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:41.551298 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23709ff4-e91d-4783-8412-0dc0d7b2ef85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:53:41.551900 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23709ff4-e91d-4783-8412-0dc0d7b2ef85 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:41.552175 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23709ff4-e91d-4783-8412-0dc0d7b2ef85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:41.552441 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23709ff4-e91d-4783-8412-0dc0d7b2ef85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:41.554057 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-23709ff4-e91d-4783-8412-0dc0d7b2ef85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:41.660216 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23709ff4-e91d-4783-8412-0dc0d7b2ef85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:53:41.661619 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23709ff4-e91d-4783-8412-0dc0d7b2ef85 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:53:41.679452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 729/1467] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:53:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:53:43.597042 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168d7ed-5c74-48ab-9431-54a32ed007a7 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:43.597578 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168d7ed-5c74-48ab-9431-54a32ed007a7 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:43.597578 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168d7ed-5c74-48ab-9431-54a32ed007a7 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:43.598943 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 739/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 15:53:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:53:43.604286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541eb64-d900-4b41-90c5-44de8993ddf6 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:43.604741 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541eb64-d900-4b41-90c5-44de8993ddf6 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:43.605075 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541eb64-d900-4b41-90c5-44de8993ddf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:43.670246 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-2541eb64-d900-4b41-90c5-44de8993ddf6 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:53:43.671426 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-2541eb64-d900-4b41-90c5-44de8993ddf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:43.720933 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:43.770696 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 730/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 15:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:53:44.055735 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168d7ed-5c74-48ab-9431-54a32ed007a7 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:53:44.058000 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-6168d7ed-5c74-48ab-9431-54a32ed007a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:44.161937 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168d7ed-5c74-48ab-9431-54a32ed007a7 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:53:44.209747 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:44.236509 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73cdcb-d84b-435e-9297-6e1dd15a8c01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:53:44.237092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73cdcb-d84b-435e-9297-6e1dd15a8c01 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:53:44.237374 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73cdcb-d84b-435e-9297-6e1dd15a8c01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:53:44.237645 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73cdcb-d84b-435e-9297-6e1dd15a8c01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:53:44.239233 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-dc73cdcb-d84b-435e-9297-6e1dd15a8c01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:53:44.350527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73cdcb-d84b-435e-9297-6e1dd15a8c01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:53:44.351961 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73cdcb-d84b-435e-9297-6e1dd15a8c01 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:53:44.494055 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 740/1470] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:53:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:53:53.768857 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=22 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:54.491481 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=66 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:54:03.922702 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c9356-0603-4ef8-befe-5ba85e28486d None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:54:03.923266 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c9356-0603-4ef8-befe-5ba85e28486d None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:54:03.923266 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c9356-0603-4ef8-befe-5ba85e28486d None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:54:03.924585 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 731/1471] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:54:03.929767 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8ec0c-8f4f-4fb5-9850-1c2d017bfc8d None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:54:03.930171 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8ec0c-8f4f-4fb5-9850-1c2d017bfc8d None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:54:03.930320 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8ec0c-8f4f-4fb5-9850-1c2d017bfc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:54:03.997522 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-a1c8ec0c-8f4f-4fb5-9850-1c2d017bfc8d None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:54:03.998730 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-a1c8ec0c-8f4f-4fb5-9850-1c2d017bfc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:54:04.092866 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 741/1472] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:54:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:54:04.388303 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5561c9-65eb-4704-99dc-f8744506f525 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:54:04.388592 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5561c9-65eb-4704-99dc-f8744506f525 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:54:04.388912 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5561c9-65eb-4704-99dc-f8744506f525 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:54:04.390253 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 732/1473] 10.222.0.25 () {54 vars in 967 bytes} [Tue Aug 30 15:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:54:04.394895 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3995f-3c22-450f-aa12-69c1d75ff23d None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:54:04.395203 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3995f-3c22-450f-aa12-69c1d75ff23d None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:54:04.395498 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3995f-3c22-450f-aa12-69c1d75ff23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:54:04.469697 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-d9a3995f-3c22-450f-aa12-69c1d75ff23d None None] MFA Rules not processed for user `f9bd815f8fe54d7d99e00a47212ad9ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:54:04.470880 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-d9a3995f-3c22-450f-aa12-69c1d75ff23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:54:04.490920 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:54:04.546455 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 742/1474] 10.222.0.25 () {58 vars in 1064 bytes} [Tue Aug 30 15:54:04 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:54:04.553981 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5561c9-65eb-4704-99dc-f8744506f525 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:54:04.555588 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-9e5561c9-65eb-4704-99dc-f8744506f525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:54:04.659969 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5561c9-65eb-4704-99dc-f8744506f525 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:54:04.733649 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43417f35-8cab-4f3b-a95b-6239728e8779 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9bd815f8fe54d7d99e00a47212ad9ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:54:04.734268 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43417f35-8cab-4f3b-a95b-6239728e8779 service glance] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:54:04.734547 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43417f35-8cab-4f3b-a95b-6239728e8779 service glance] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:54:04.734851 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43417f35-8cab-4f3b-a95b-6239728e8779 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:54:04.736463 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-43417f35-8cab-4f3b-a95b-6239728e8779 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:54:04.789682 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:54:04.844950 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43417f35-8cab-4f3b-a95b-6239728e8779 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:54:04.846411 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43417f35-8cab-4f3b-a95b-6239728e8779 service glance] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:54:04.865368 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 733/1475] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:54:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:54:06.879089 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45017469-9144-4c28-b340-16a0ea562715 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:54:06.879644 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45017469-9144-4c28-b340-16a0ea562715 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:54:06.879644 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45017469-9144-4c28-b340-16a0ea562715 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:54:06.881012 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 743/1476] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:54:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:54:06.887257 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08518b2b-f730-4a1e-8b39-c04aaf1a29dd None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:54:06.887668 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08518b2b-f730-4a1e-8b39-c04aaf1a29dd None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:54:06.887829 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08518b2b-f730-4a1e-8b39-c04aaf1a29dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:54:06.953284 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-08518b2b-f730-4a1e-8b39-c04aaf1a29dd None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:54:06.954484 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-08518b2b-f730-4a1e-8b39-c04aaf1a29dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:54:07.051247 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 734/1477] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:54:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:54:07.325245 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45017469-9144-4c28-b340-16a0ea562715 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:54:07.326763 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-45017469-9144-4c28-b340-16a0ea562715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:54:07.454139 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45017469-9144-4c28-b340-16a0ea562715 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:54:07.502279 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:54:07.546709 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86aedbc-f661-482d-a850-5e3f5f19a066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:54:07.547312 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86aedbc-f661-482d-a850-5e3f5f19a066 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:54:07.547585 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86aedbc-f661-482d-a850-5e3f5f19a066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:54:07.547851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86aedbc-f661-482d-a850-5e3f5f19a066 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:54:07.548482 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86aedbc-f661-482d-a850-5e3f5f19a066 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:54:07.550227 dv-cinder-855058-1-smb devstack@keystone.service[81419]: WARNING py.warnings [None req-e86aedbc-f661-482d-a850-5e3f5f19a066 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 15:54:07.550227 dv-cinder-855058-1-smb devstack@keystone.service[81419]: warnings.warn(msg) Aug 30 15:54:07.550227 dv-cinder-855058-1-smb devstack@keystone.service[81419]: Aug 30 15:54:07.551340 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86aedbc-f661-482d-a850-5e3f5f19a066 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:54:07.569777 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 744/1478] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 30 15:54:07 2022] GET /identity/v3/projects => generated 2553 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:54:09.485711 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4315a-a712-40d6-9078-d422d43b1123 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:54:09.486249 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4315a-a712-40d6-9078-d422d43b1123 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:54:09.486249 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4315a-a712-40d6-9078-d422d43b1123 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:54:09.487602 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 735/1479] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:54:09.492861 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b768bf-93dd-4d53-9f82-c24d8a69d80c None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:54:09.493258 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b768bf-93dd-4d53-9f82-c24d8a69d80c None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:54:09.493413 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b768bf-93dd-4d53-9f82-c24d8a69d80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:54:09.558960 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-41b768bf-93dd-4d53-9f82-c24d8a69d80c None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:54:09.560147 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-41b768bf-93dd-4d53-9f82-c24d8a69d80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:54:09.655109 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 745/1480] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:54:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:54:09.946468 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4315a-a712-40d6-9078-d422d43b1123 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:54:09.948741 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-2fd4315a-a712-40d6-9078-d422d43b1123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:54:09.958764 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:54:10.112044 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4315a-a712-40d6-9078-d422d43b1123 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:54:10.193652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:54:10.225845 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e253f20-df85-4380-8e73-54fa55b49b46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:54:10.226452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e253f20-df85-4380-8e73-54fa55b49b46 service nova] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:54:10.226729 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e253f20-df85-4380-8e73-54fa55b49b46 service nova] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:54:10.226997 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e253f20-df85-4380-8e73-54fa55b49b46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:54:10.228589 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-2e253f20-df85-4380-8e73-54fa55b49b46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:54:10.316312 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e253f20-df85-4380-8e73-54fa55b49b46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:54:10.317974 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e253f20-df85-4380-8e73-54fa55b49b46 service nova] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:54:10.335950 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 736/1481] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:54:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:54:12.559731 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91ea0a-246d-4b64-b22d-15131c005957 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:54:12.560335 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91ea0a-246d-4b64-b22d-15131c005957 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:54:12.560440 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91ea0a-246d-4b64-b22d-15131c005957 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:54:12.562308 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 746/1482] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:54:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:54:12.567837 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6ece0-0311-40b1-9d5a-a8afe71d98f0 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:54:12.568282 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6ece0-0311-40b1-9d5a-a8afe71d98f0 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:54:12.568381 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6ece0-0311-40b1-9d5a-a8afe71d98f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:54:12.639961 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-30e6ece0-0311-40b1-9d5a-a8afe71d98f0 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:54:12.641213 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-30e6ece0-0311-40b1-9d5a-a8afe71d98f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:54:12.687744 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:54:12.739860 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 737/1483] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:54:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:54:13.029759 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91ea0a-246d-4b64-b22d-15131c005957 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:54:13.031323 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-0c91ea0a-246d-4b64-b22d-15131c005957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:54:13.055739 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:54:13.137273 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91ea0a-246d-4b64-b22d-15131c005957 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:54:13.210600 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3d93f-e87a-4232-abb3-a9f67e76a485 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:54:13.211212 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3d93f-e87a-4232-abb3-a9f67e76a485 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:54:13.211490 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3d93f-e87a-4232-abb3-a9f67e76a485 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:54:13.211758 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3d93f-e87a-4232-abb3-a9f67e76a485 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:54:13.214160 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-8ae3d93f-e87a-4232-abb3-a9f67e76a485 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:54:13.286525 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:54:13.322189 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3d93f-e87a-4232-abb3-a9f67e76a485 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:54:13.324068 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3d93f-e87a-4232-abb3-a9f67e76a485 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:54:13.342231 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 747/1484] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:54:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:54:15.265519 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ed5d2-1d53-42fd-b3dc-747ff9e33269 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:54:15.266092 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ed5d2-1d53-42fd-b3dc-747ff9e33269 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:54:15.266092 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ed5d2-1d53-42fd-b3dc-747ff9e33269 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:54:15.267417 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 738/1485] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:54:15.272601 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430705d-08b5-461b-82fa-3613c060ba97 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:54:15.273059 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430705d-08b5-461b-82fa-3613c060ba97 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:54:15.273170 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430705d-08b5-461b-82fa-3613c060ba97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:54:15.337272 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-6430705d-08b5-461b-82fa-3613c060ba97 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:54:15.338989 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-6430705d-08b5-461b-82fa-3613c060ba97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:54:15.432512 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 748/1486] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:54:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:54:15.717747 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ed5d2-1d53-42fd-b3dc-747ff9e33269 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:54:15.719328 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-4e5ed5d2-1d53-42fd-b3dc-747ff9e33269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:54:15.822411 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ed5d2-1d53-42fd-b3dc-747ff9e33269 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:54:15.894324 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:54:15.896476 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77930c3f-5baf-4913-a48b-3bb020e865ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:54:15.897123 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77930c3f-5baf-4913-a48b-3bb020e865ee service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:54:15.897627 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77930c3f-5baf-4913-a48b-3bb020e865ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:54:15.898108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77930c3f-5baf-4913-a48b-3bb020e865ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:54:15.899935 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-77930c3f-5baf-4913-a48b-3bb020e865ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:54:16.007771 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77930c3f-5baf-4913-a48b-3bb020e865ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:54:16.009275 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77930c3f-5baf-4913-a48b-3bb020e865ee service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:54:16.029257 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 739/1487] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:54:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:54:18.080121 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48787b7f-f7b4-4024-b32a-0dcd69107479 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:54:18.080571 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48787b7f-f7b4-4024-b32a-0dcd69107479 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:54:18.080748 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48787b7f-f7b4-4024-b32a-0dcd69107479 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:54:18.082435 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 749/1488] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:54:18.088209 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5effb2a-2e1f-4b84-a882-216dc43c3835 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:54:18.088720 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5effb2a-2e1f-4b84-a882-216dc43c3835 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:54:18.089096 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5effb2a-2e1f-4b84-a882-216dc43c3835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:54:18.168473 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-b5effb2a-2e1f-4b84-a882-216dc43c3835 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:54:18.169717 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-b5effb2a-2e1f-4b84-a882-216dc43c3835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:54:18.221643 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:54:18.266684 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 740/1489] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:54:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:54:18.566014 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48787b7f-f7b4-4024-b32a-0dcd69107479 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:54:18.567542 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-48787b7f-f7b4-4024-b32a-0dcd69107479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:54:18.603388 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:54:18.671551 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48787b7f-f7b4-4024-b32a-0dcd69107479 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:54:18.751146 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43917cc2-c447-4d93-93ad-ac6c00f90757 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:54:18.751757 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43917cc2-c447-4d93-93ad-ac6c00f90757 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:54:18.752034 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43917cc2-c447-4d93-93ad-ac6c00f90757 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:54:18.752303 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43917cc2-c447-4d93-93ad-ac6c00f90757 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:54:18.754877 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-43917cc2-c447-4d93-93ad-ac6c00f90757 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:54:18.836686 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:54:18.865886 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43917cc2-c447-4d93-93ad-ac6c00f90757 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:54:18.867320 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43917cc2-c447-4d93-93ad-ac6c00f90757 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:54:18.886508 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 750/1490] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:54:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:54:20.979667 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36afef14-6eb1-4ec7-b5d5-0afc83088aae None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:54:20.980294 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36afef14-6eb1-4ec7-b5d5-0afc83088aae None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:54:20.980294 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36afef14-6eb1-4ec7-b5d5-0afc83088aae None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:54:20.981575 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 741/1491] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 30 15:54:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:54:20.986824 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39ad93-317c-4cd3-9c86-01ce75fd5b7d None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:54:20.987260 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39ad93-317c-4cd3-9c86-01ce75fd5b7d None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:54:20.987368 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39ad93-317c-4cd3-9c86-01ce75fd5b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:54:21.052830 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-cb39ad93-317c-4cd3-9c86-01ce75fd5b7d None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:54:21.054025 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-cb39ad93-317c-4cd3-9c86-01ce75fd5b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:54:21.151247 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 751/1492] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 30 15:54:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:54:21.443466 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36afef14-6eb1-4ec7-b5d5-0afc83088aae None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:54:21.445045 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-36afef14-6eb1-4ec7-b5d5-0afc83088aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:54:21.550477 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36afef14-6eb1-4ec7-b5d5-0afc83088aae None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:54:21.623026 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d450e3-6344-4252-b451-ba3fd5f44225 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:54:21.623633 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d450e3-6344-4252-b451-ba3fd5f44225 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:54:21.623912 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d450e3-6344-4252-b451-ba3fd5f44225 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:54:21.624174 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d450e3-6344-4252-b451-ba3fd5f44225 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:54:21.625796 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-39d450e3-6344-4252-b451-ba3fd5f44225 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:54:21.634645 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:54:21.734512 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d450e3-6344-4252-b451-ba3fd5f44225 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:54:21.736064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d450e3-6344-4252-b451-ba3fd5f44225 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:54:21.755001 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 742/1493] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:54:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:54:31.149186 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=82 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:54:31.752658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=50 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:55:38.730467 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02221c0c-121b-4b3d-892e-b4b0e1cda426 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:55:38.730966 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02221c0c-121b-4b3d-892e-b4b0e1cda426 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:55:38.731078 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02221c0c-121b-4b3d-892e-b4b0e1cda426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:55:38.808635 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-02221c0c-121b-4b3d-892e-b4b0e1cda426 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:55:38.809896 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-02221c0c-121b-4b3d-892e-b4b0e1cda426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:55:38.907614 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 752/1494] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:55:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:55:38.916183 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7766c-3e5f-423d-915a-64d97a1ad7e6 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:55:38.916689 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7766c-3e5f-423d-915a-64d97a1ad7e6 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:55:38.916827 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7766c-3e5f-423d-915a-64d97a1ad7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:55:38.991286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-b2e7766c-3e5f-423d-915a-64d97a1ad7e6 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:55:38.992415 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-b2e7766c-3e5f-423d-915a-64d97a1ad7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:55:39.089044 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 743/1495] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:55:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:55:39.093662 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02221c0c-121b-4b3d-892e-b4b0e1cda426 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:55:39.094855 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-02221c0c-121b-4b3d-892e-b4b0e1cda426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:55:39.106929 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02221c0c-121b-4b3d-892e-b4b0e1cda426 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:55:39.167530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:55:39.202166 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9202b23a-69fe-4b62-9d4b-6d2ebefc1495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:55:39.202775 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202b23a-69fe-4b62-9d4b-6d2ebefc1495 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:55:39.203052 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202b23a-69fe-4b62-9d4b-6d2ebefc1495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:55:39.203323 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202b23a-69fe-4b62-9d4b-6d2ebefc1495 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:55:39.203968 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9202b23a-69fe-4b62-9d4b-6d2ebefc1495 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:55:39.204270 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9202b23a-69fe-4b62-9d4b-6d2ebefc1495 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:55:39.205314 dv-cinder-855058-1-smb devstack@keystone.service[81419]: WARNING py.warnings [None req-9202b23a-69fe-4b62-9d4b-6d2ebefc1495 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 15:55:39.205314 dv-cinder-855058-1-smb devstack@keystone.service[81419]: warnings.warn(msg) Aug 30 15:55:39.205314 dv-cinder-855058-1-smb devstack@keystone.service[81419]: Aug 30 15:55:39.206196 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9202b23a-69fe-4b62-9d4b-6d2ebefc1495 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:55:39.217800 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 753/1496] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 15:55:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:55:39.226017 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7766c-3e5f-423d-915a-64d97a1ad7e6 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:55:39.235210 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7766c-3e5f-423d-915a-64d97a1ad7e6 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:55:39.295876 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:55:39.329191 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a94467-36b7-42b5-8fa1-5987f73eee6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:55:39.329798 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a94467-36b7-42b5-8fa1-5987f73eee6c admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:55:39.330078 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a94467-36b7-42b5-8fa1-5987f73eee6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:55:39.330350 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a94467-36b7-42b5-8fa1-5987f73eee6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:55:39.330990 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a94467-36b7-42b5-8fa1-5987f73eee6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:55:39.332795 dv-cinder-855058-1-smb devstack@keystone.service[81420]: WARNING py.warnings [None req-a7a94467-36b7-42b5-8fa1-5987f73eee6c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 15:55:39.332795 dv-cinder-855058-1-smb devstack@keystone.service[81420]: warnings.warn(msg) Aug 30 15:55:39.332795 dv-cinder-855058-1-smb devstack@keystone.service[81420]: Aug 30 15:55:39.333996 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a94467-36b7-42b5-8fa1-5987f73eee6c admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:55:39.391185 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 744/1497] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 15:55:39 2022] POST /identity/v3/projects => generated 379 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:55:39.395519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9202b23a-69fe-4b62-9d4b-6d2ebefc1495 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:55:39.397105 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-9202b23a-69fe-4b62-9d4b-6d2ebefc1495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:55:39.430043 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9202b23a-69fe-4b62-9d4b-6d2ebefc1495 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:55:39.522118 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c8ff2-b6c8-4c79-b6f5-bd2cdd49cf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:55:39.522716 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c8ff2-b6c8-4c79-b6f5-bd2cdd49cf4e admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:55:39.522989 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c8ff2-b6c8-4c79-b6f5-bd2cdd49cf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:55:39.523254 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c8ff2-b6c8-4c79-b6f5-bd2cdd49cf4e admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:55:39.523871 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c8ff2-b6c8-4c79-b6f5-bd2cdd49cf4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:55:39.525452 dv-cinder-855058-1-smb devstack@keystone.service[81419]: WARNING py.warnings [None req-a36c8ff2-b6c8-4c79-b6f5-bd2cdd49cf4e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 15:55:39.525452 dv-cinder-855058-1-smb devstack@keystone.service[81419]: warnings.warn(msg) Aug 30 15:55:39.525452 dv-cinder-855058-1-smb devstack@keystone.service[81419]: Aug 30 15:55:39.526635 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c8ff2-b6c8-4c79-b6f5-bd2cdd49cf4e admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:55:39.566516 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 754/1498] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:55:39 2022] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:55:39.570808 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a94467-36b7-42b5-8fa1-5987f73eee6c admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:55:39.573071 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-a7a94467-36b7-42b5-8fa1-5987f73eee6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:55:39.635244 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a94467-36b7-42b5-8fa1-5987f73eee6c admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:55:39.716338 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:55:39.728573 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef07d6-dd3d-49fc-8886-20c3e6b20900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:55:39.729225 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef07d6-dd3d-49fc-8886-20c3e6b20900 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:55:39.729509 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef07d6-dd3d-49fc-8886-20c3e6b20900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:55:39.729784 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef07d6-dd3d-49fc-8886-20c3e6b20900 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:55:39.730466 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef07d6-dd3d-49fc-8886-20c3e6b20900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:55:39.731487 dv-cinder-855058-1-smb devstack@keystone.service[81420]: WARNING py.warnings [None req-48ef07d6-dd3d-49fc-8886-20c3e6b20900 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 15:55:39.731487 dv-cinder-855058-1-smb devstack@keystone.service[81420]: warnings.warn(msg) Aug 30 15:55:39.731487 dv-cinder-855058-1-smb devstack@keystone.service[81420]: Aug 30 15:55:39.732378 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef07d6-dd3d-49fc-8886-20c3e6b20900 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:55:39.745497 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 745/1499] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:55:39.749653 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c8ff2-b6c8-4c79-b6f5-bd2cdd49cf4e admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:55:39.751171 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-a36c8ff2-b6c8-4c79-b6f5-bd2cdd49cf4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:55:39.763374 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c8ff2-b6c8-4c79-b6f5-bd2cdd49cf4e admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:55:39.787847 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:55:39.857187 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604dd4b2-21a4-4ab6-8dd3-e848b44d8aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:55:39.857723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604dd4b2-21a4-4ab6-8dd3-e848b44d8aac admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:55:39.857998 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604dd4b2-21a4-4ab6-8dd3-e848b44d8aac admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:55:39.858266 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604dd4b2-21a4-4ab6-8dd3-e848b44d8aac admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:55:39.858904 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604dd4b2-21a4-4ab6-8dd3-e848b44d8aac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:55:39.859903 dv-cinder-855058-1-smb devstack@keystone.service[81419]: WARNING py.warnings [None req-604dd4b2-21a4-4ab6-8dd3-e848b44d8aac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 15:55:39.859903 dv-cinder-855058-1-smb devstack@keystone.service[81419]: warnings.warn(msg) Aug 30 15:55:39.859903 dv-cinder-855058-1-smb devstack@keystone.service[81419]: Aug 30 15:55:39.860799 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604dd4b2-21a4-4ab6-8dd3-e848b44d8aac admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:55:39.873451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 755/1500] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:55:39.877567 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef07d6-dd3d-49fc-8886-20c3e6b20900 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:55:39.879110 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-48ef07d6-dd3d-49fc-8886-20c3e6b20900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:55:39.912938 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef07d6-dd3d-49fc-8886-20c3e6b20900 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:55:40.005998 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603bcd2-3e3b-4947-8467-5f2f56ca3747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:55:40.006642 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603bcd2-3e3b-4947-8467-5f2f56ca3747 admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:55:40.006917 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603bcd2-3e3b-4947-8467-5f2f56ca3747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:55:40.007187 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603bcd2-3e3b-4947-8467-5f2f56ca3747 admin admin] PATH_INFO: `/v3/projects/d60976b9a36a4f388a158cb5863b3256/users/cb904a667c48402d9f0df3fcccc8d683/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:55:40.029054 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2603bcd2-3e3b-4947-8467-5f2f56ca3747 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d60976b9a36a4f388a158cb5863b3256, user_id=cb904a667c48402d9f0df3fcccc8d683, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:55:40.030105 dv-cinder-855058-1-smb devstack@keystone.service[81420]: WARNING py.warnings [None req-2603bcd2-3e3b-4947-8467-5f2f56ca3747 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 15:55:40.030105 dv-cinder-855058-1-smb devstack@keystone.service[81420]: warnings.warn(msg) Aug 30 15:55:40.030105 dv-cinder-855058-1-smb devstack@keystone.service[81420]: Aug 30 15:55:40.032059 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2603bcd2-3e3b-4947-8467-5f2f56ca3747 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:55:40.057954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 746/1501] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:55:39 2022] PUT /identity/v3/projects/d60976b9a36a4f388a158cb5863b3256/users/cb904a667c48402d9f0df3fcccc8d683/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:55:40.069932 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf994fb8-8606-4670-ab48-953c7c289ca6 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:55:40.070219 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf994fb8-8606-4670-ab48-953c7c289ca6 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:55:40.070497 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf994fb8-8606-4670-ab48-953c7c289ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:55:40.126124 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-cf994fb8-8606-4670-ab48-953c7c289ca6 None None] MFA Rules not processed for user `cb904a667c48402d9f0df3fcccc8d683`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:55:40.127248 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-cf994fb8-8606-4670-ab48-953c7c289ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:55:40.203217 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 756/1502] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:55:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:55:40.216338 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac468680-1a79-4ea6-b8c0-97502c6dd128 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:55:40.216621 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac468680-1a79-4ea6-b8c0-97502c6dd128 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:55:40.216920 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac468680-1a79-4ea6-b8c0-97502c6dd128 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:55:40.218248 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 747/1503] 10.222.0.25 () {54 vars in 964 bytes} [Tue Aug 30 15:55:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:55:40.223009 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a59fa1-4e52-49ec-b86d-840dd6626d7d None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:55:40.223298 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a59fa1-4e52-49ec-b86d-840dd6626d7d None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:55:40.223572 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a59fa1-4e52-49ec-b86d-840dd6626d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:55:40.254950 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:55:40.299595 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-a8a59fa1-4e52-49ec-b86d-840dd6626d7d None None] MFA Rules not processed for user `130166ecc884456d94dbf6c6905168fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:55:40.300805 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-a8a59fa1-4e52-49ec-b86d-840dd6626d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:55:40.376748 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 757/1504] 10.222.0.25 () {58 vars in 1061 bytes} [Tue Aug 30 15:55:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:55:40.387525 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac468680-1a79-4ea6-b8c0-97502c6dd128 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:55:40.389068 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-ac468680-1a79-4ea6-b8c0-97502c6dd128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:55:40.439384 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:55:40.494196 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac468680-1a79-4ea6-b8c0-97502c6dd128 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:55:40.565867 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc645b9b-8385-412a-ac2e-eb410eb42ac8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:55:40.566473 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc645b9b-8385-412a-ac2e-eb410eb42ac8 service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:55:40.566750 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc645b9b-8385-412a-ac2e-eb410eb42ac8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:55:40.567019 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc645b9b-8385-412a-ac2e-eb410eb42ac8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:55:40.568614 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-dc645b9b-8385-412a-ac2e-eb410eb42ac8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:55:40.786514 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc645b9b-8385-412a-ac2e-eb410eb42ac8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:55:40.787958 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc645b9b-8385-412a-ac2e-eb410eb42ac8 service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:55:40.791922 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:55:40.807693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 748/1505] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:55:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:55:40.851540 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728c5d0-8552-44d4-9c44-0eb9da18ee1c None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:55:40.851936 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728c5d0-8552-44d4-9c44-0eb9da18ee1c None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:55:40.852084 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728c5d0-8552-44d4-9c44-0eb9da18ee1c None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:55:40.853986 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 758/1506] 10.222.0.25 () {52 vars in 830 bytes} [Tue Aug 30 15:55:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:55:40.857548 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc645b9b-8385-412a-ac2e-eb410eb42ac8 service cinder] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:55:40.858790 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-dc645b9b-8385-412a-ac2e-eb410eb42ac8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:55:40.955854 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc645b9b-8385-412a-ac2e-eb410eb42ac8 service cinder] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:55:41.048034 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f129d-9f68-4e0f-a8cc-8cfd18c7dc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:55:41.048657 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f129d-9f68-4e0f-a8cc-8cfd18c7dc27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:55:41.048885 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f129d-9f68-4e0f-a8cc-8cfd18c7dc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:55:41.049160 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f129d-9f68-4e0f-a8cc-8cfd18c7dc27 admin admin] PATH_INFO: `/v3/users/cb904a667c48402d9f0df3fcccc8d683` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:55:41.062553 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01f129d-9f68-4e0f-a8cc-8cfd18c7dc27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb904a667c48402d9f0df3fcccc8d683)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:55:41.063634 dv-cinder-855058-1-smb devstack@keystone.service[81420]: WARNING py.warnings [None req-d01f129d-9f68-4e0f-a8cc-8cfd18c7dc27 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 15:55:41.063634 dv-cinder-855058-1-smb devstack@keystone.service[81420]: warnings.warn(msg) Aug 30 15:55:41.063634 dv-cinder-855058-1-smb devstack@keystone.service[81420]: Aug 30 15:55:41.064890 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01f129d-9f68-4e0f-a8cc-8cfd18c7dc27 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:55:41.074510 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:55:41.130032 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-d01f129d-9f68-4e0f-a8cc-8cfd18c7dc27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb904a667c48402d9f0df3fcccc8d683'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:55:41.153491 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-d01f129d-9f68-4e0f-a8cc-8cfd18c7dc27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb904a667c48402d9f0df3fcccc8d683'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:55:41.153944 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-d01f129d-9f68-4e0f-a8cc-8cfd18c7dc27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb904a667c48402d9f0df3fcccc8d683'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:55:41.154466 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-d01f129d-9f68-4e0f-a8cc-8cfd18c7dc27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb904a667c48402d9f0df3fcccc8d683'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:55:41.163379 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-d01f129d-9f68-4e0f-a8cc-8cfd18c7dc27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb904a667c48402d9f0df3fcccc8d683'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:55:41.188865 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 749/1507] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 15:55:40 2022] DELETE /identity/v3/users/cb904a667c48402d9f0df3fcccc8d683 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:55:41.194722 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4d904-04eb-46c8-a518-a72b8b7ff72a None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:55:41.195006 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4d904-04eb-46c8-a518-a72b8b7ff72a None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:55:41.195279 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4d904-04eb-46c8-a518-a72b8b7ff72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:55:41.256565 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-33b4d904-04eb-46c8-a518-a72b8b7ff72a None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:55:41.257855 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-33b4d904-04eb-46c8-a518-a72b8b7ff72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:55:41.335561 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:55:41.349333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 759/1508] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:55:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:55:41.359128 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f129d-9f68-4e0f-a8cc-8cfd18c7dc27 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:55:41.360364 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-d01f129d-9f68-4e0f-a8cc-8cfd18c7dc27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:55:41.474572 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f129d-9f68-4e0f-a8cc-8cfd18c7dc27 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:55:41.535803 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:55:41.557154 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bfab58-88af-4c82-8080-3be0c8b8122c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:55:41.557769 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfab58-88af-4c82-8080-3be0c8b8122c service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:55:41.558045 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfab58-88af-4c82-8080-3be0c8b8122c service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:55:41.558313 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfab58-88af-4c82-8080-3be0c8b8122c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:55:41.559954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-29bfab58-88af-4c82-8080-3be0c8b8122c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:55:41.665943 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bfab58-88af-4c82-8080-3be0c8b8122c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:55:41.667328 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bfab58-88af-4c82-8080-3be0c8b8122c service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:55:41.685994 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 750/1509] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:55:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:55:42.015107 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4d904-04eb-46c8-a518-a72b8b7ff72a None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:55:42.016391 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-33b4d904-04eb-46c8-a518-a72b8b7ff72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:55:42.032266 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4d904-04eb-46c8-a518-a72b8b7ff72a None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:55:42.132845 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114df592-5cb3-45df-8aec-a1164190c708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:55:42.133495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114df592-5cb3-45df-8aec-a1164190c708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:55:42.133812 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114df592-5cb3-45df-8aec-a1164190c708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:55:42.134105 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114df592-5cb3-45df-8aec-a1164190c708 admin admin] PATH_INFO: `/v3/projects/d60976b9a36a4f388a158cb5863b3256` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:55:42.144670 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114df592-5cb3-45df-8aec-a1164190c708 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d60976b9a36a4f388a158cb5863b3256)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:55:42.145737 dv-cinder-855058-1-smb devstack@keystone.service[81419]: WARNING py.warnings [None req-114df592-5cb3-45df-8aec-a1164190c708 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 15:55:42.145737 dv-cinder-855058-1-smb devstack@keystone.service[81419]: warnings.warn(msg) Aug 30 15:55:42.145737 dv-cinder-855058-1-smb devstack@keystone.service[81419]: Aug 30 15:55:42.146937 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114df592-5cb3-45df-8aec-a1164190c708 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:55:42.206098 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-114df592-5cb3-45df-8aec-a1164190c708 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd60976b9a36a4f388a158cb5863b3256', 'request_id': 'req-114df592-5cb3-45df-8aec-a1164190c708'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:55:42.216057 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-114df592-5cb3-45df-8aec-a1164190c708 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd60976b9a36a4f388a158cb5863b3256', 'request_id': 'req-114df592-5cb3-45df-8aec-a1164190c708'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:55:42.230875 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-114df592-5cb3-45df-8aec-a1164190c708 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd60976b9a36a4f388a158cb5863b3256', 'request_id': 'req-114df592-5cb3-45df-8aec-a1164190c708'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:55:42.253480 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-114df592-5cb3-45df-8aec-a1164190c708 admin admin] The token cache is being invalidate because project d60976b9a36a4f388a158cb5863b3256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:55:42.253696 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-114df592-5cb3-45df-8aec-a1164190c708 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:55:42.254214 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-114df592-5cb3-45df-8aec-a1164190c708 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:55:42.255503 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 760/1510] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 15:55:42 2022] DELETE /identity/v3/projects/d60976b9a36a4f388a158cb5863b3256 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:55:51.683746 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=62 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:55:52.251432 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:57:18.993148 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f689a2-9956-403c-bb28-d25dfbfda362 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:57:18.993709 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f689a2-9956-403c-bb28-d25dfbfda362 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:57:18.993709 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f689a2-9956-403c-bb28-d25dfbfda362 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:57:18.995129 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 751/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 15:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:57:18.999738 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb978ee-ba83-44a2-8f0e-4f2ed4ed6791 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:57:19.000177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb978ee-ba83-44a2-8f0e-4f2ed4ed6791 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:57:19.000320 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb978ee-ba83-44a2-8f0e-4f2ed4ed6791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:57:19.081112 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-7bb978ee-ba83-44a2-8f0e-4f2ed4ed6791 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:57:19.082317 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7bb978ee-ba83-44a2-8f0e-4f2ed4ed6791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:57:19.182623 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 761/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 15:57:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:57:19.339034 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f689a2-9956-403c-bb28-d25dfbfda362 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:57:19.341148 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-96f689a2-9956-403c-bb28-d25dfbfda362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:57:19.458636 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f689a2-9956-403c-bb28-d25dfbfda362 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:57:19.464100 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a90483-0476-4cd6-a0b6-13d7a6088359 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:57:19.464702 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a90483-0476-4cd6-a0b6-13d7a6088359 service nova] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:57:19.465010 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a90483-0476-4cd6-a0b6-13d7a6088359 service nova] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:57:19.465280 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a90483-0476-4cd6-a0b6-13d7a6088359 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:57:19.473096 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a90483-0476-4cd6-a0b6-13d7a6088359 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:57:19.474768 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a90483-0476-4cd6-a0b6-13d7a6088359 service nova] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:57:19.484122 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 752/1513] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:57:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:57:20.253008 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91b1e4-3be8-4185-9e44-03e2a61c08bf None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:57:20.253561 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91b1e4-3be8-4185-9e44-03e2a61c08bf None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:57:20.253643 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91b1e4-3be8-4185-9e44-03e2a61c08bf None None] PATH_INFO: `/v3` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:57:20.254873 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 762/1514] 10.222.0.44 () {54 vars in 925 bytes} [Tue Aug 30 15:57:20 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:57:20.261345 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd89bd-deef-4d46-a2b5-090054c3965e None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:57:20.261797 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd89bd-deef-4d46-a2b5-090054c3965e None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:57:20.262013 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd89bd-deef-4d46-a2b5-090054c3965e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:57:20.310315 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7495d41-92ce-46ba-ae14-fdb12bc797b8 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:57:20.310594 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7495d41-92ce-46ba-ae14-fdb12bc797b8 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:57:20.310868 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7495d41-92ce-46ba-ae14-fdb12bc797b8 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:57:20.312173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 763/1515] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 15:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 15:57:20.316644 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba33811-34a7-4bf1-ab83-d49cb93d2051 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:57:20.316954 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba33811-34a7-4bf1-ab83-d49cb93d2051 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:57:20.317230 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba33811-34a7-4bf1-ab83-d49cb93d2051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:57:20.322518 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-b9bd89bd-deef-4d46-a2b5-090054c3965e None None] MFA Rules not processed for user `2bba851e1a0d4601b5d4841662f645dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:57:20.323677 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-b9bd89bd-deef-4d46-a2b5-090054c3965e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:57:20.338135 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-dba33811-34a7-4bf1-ab83-d49cb93d2051 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:57:20.339339 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-dba33811-34a7-4bf1-ab83-d49cb93d2051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:57:20.347252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 764/1516] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 15:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:57:20.391291 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:57:20.397500 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 753/1517] 10.222.0.44 () {58 vars in 1015 bytes} [Tue Aug 30 15:57:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:57:20.498340 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba33811-34a7-4bf1-ab83-d49cb93d2051 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:57:20.511528 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba33811-34a7-4bf1-ab83-d49cb93d2051 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:57:20.516941 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f0ea3-3c31-422e-bd71-a2de8e338e78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:57:20.517535 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f0ea3-3c31-422e-bd71-a2de8e338e78 service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:57:20.517810 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f0ea3-3c31-422e-bd71-a2de8e338e78 service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:57:20.518078 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f0ea3-3c31-422e-bd71-a2de8e338e78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:57:20.526588 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f0ea3-3c31-422e-bd71-a2de8e338e78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:57:20.528160 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f0ea3-3c31-422e-bd71-a2de8e338e78 service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:57:20.537516 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 765/1518] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:57:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:57:29.580654 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858c04f-8bcb-4c29-b857-a17d7feeadaa None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:57:29.581243 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858c04f-8bcb-4c29-b857-a17d7feeadaa None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:57:29.581243 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858c04f-8bcb-4c29-b857-a17d7feeadaa None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:57:29.582593 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 754/1519] 10.222.0.25 () {54 vars in 961 bytes} [Tue Aug 30 15:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:57:29.587771 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab7fa4-ce4e-4d85-b421-613b54368f9c None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:57:29.588192 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab7fa4-ce4e-4d85-b421-613b54368f9c None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:57:29.588327 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab7fa4-ce4e-4d85-b421-613b54368f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:57:29.608195 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-c0ab7fa4-ce4e-4d85-b421-613b54368f9c None None] MFA Rules not processed for user `2bba851e1a0d4601b5d4841662f645dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:57:29.609442 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c0ab7fa4-ce4e-4d85-b421-613b54368f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:57:29.619120 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 766/1520] 10.222.0.25 () {58 vars in 1058 bytes} [Tue Aug 30 15:57:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:57:29.626620 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858c04f-8bcb-4c29-b857-a17d7feeadaa None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:57:29.640060 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858c04f-8bcb-4c29-b857-a17d7feeadaa None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:57:29.645082 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f477c5cf-1962-4739-bf70-1ddd4c3e0aec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bba851e1a0d4601b5d4841662f645dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:57:29.645671 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477c5cf-1962-4739-bf70-1ddd4c3e0aec service placement] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:57:29.645954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477c5cf-1962-4739-bf70-1ddd4c3e0aec service placement] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:57:29.646218 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477c5cf-1962-4739-bf70-1ddd4c3e0aec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:57:29.654469 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f477c5cf-1962-4739-bf70-1ddd4c3e0aec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:57:29.656045 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f477c5cf-1962-4739-bf70-1ddd4c3e0aec service placement] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:57:29.666150 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 755/1521] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:57:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:57:31.754971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d7dc2-b3eb-4bd2-a384-37050e308287 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:57:31.760589 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d7dc2-b3eb-4bd2-a384-37050e308287 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:57:31.760589 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d7dc2-b3eb-4bd2-a384-37050e308287 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:57:31.760589 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 767/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 15:57:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:57:31.763324 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4a93d-fa61-459d-a6d0-9d266bb9566a None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:57:31.763750 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4a93d-fa61-459d-a6d0-9d266bb9566a None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:57:31.763872 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4a93d-fa61-459d-a6d0-9d266bb9566a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:57:31.783175 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-a2d4a93d-fa61-459d-a6d0-9d266bb9566a None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:57:31.784352 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-a2d4a93d-fa61-459d-a6d0-9d266bb9566a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:57:31.792706 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 756/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 15:57:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:57:31.944085 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d7dc2-b3eb-4bd2-a384-37050e308287 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:57:31.958616 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d7dc2-b3eb-4bd2-a384-37050e308287 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:57:31.964067 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158f837-05b6-4bdb-aa1c-5eb7ee9c9d80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:57:31.964665 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158f837-05b6-4bdb-aa1c-5eb7ee9c9d80 service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:57:31.964980 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158f837-05b6-4bdb-aa1c-5eb7ee9c9d80 service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:57:31.965257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158f837-05b6-4bdb-aa1c-5eb7ee9c9d80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:57:31.973174 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158f837-05b6-4bdb-aa1c-5eb7ee9c9d80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:57:31.975553 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158f837-05b6-4bdb-aa1c-5eb7ee9c9d80 service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:57:31.985107 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 768/1524] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:57:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:57:32.814838 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2769d6-9b23-41c9-b6d1-75017b95f989 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:57:32.815375 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2769d6-9b23-41c9-b6d1-75017b95f989 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:57:32.815375 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2769d6-9b23-41c9-b6d1-75017b95f989 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:57:32.816713 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 757/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 15:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:57:32.821947 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098bde5-d5fa-4c88-8f31-4a235c6e2765 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:57:32.822402 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098bde5-d5fa-4c88-8f31-4a235c6e2765 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:57:32.822512 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098bde5-d5fa-4c88-8f31-4a235c6e2765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:57:32.842646 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-2098bde5-d5fa-4c88-8f31-4a235c6e2765 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:57:32.843831 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-2098bde5-d5fa-4c88-8f31-4a235c6e2765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:57:32.851595 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 769/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 15:57:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:57:33.001964 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2769d6-9b23-41c9-b6d1-75017b95f989 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:57:33.017385 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2769d6-9b23-41c9-b6d1-75017b95f989 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:57:33.023182 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c5971-fa32-4bbf-abea-84d42f65385f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:57:33.023789 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c5971-fa32-4bbf-abea-84d42f65385f service nova] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:57:33.024069 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c5971-fa32-4bbf-abea-84d42f65385f service nova] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:57:33.024343 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c5971-fa32-4bbf-abea-84d42f65385f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:57:33.032584 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c5971-fa32-4bbf-abea-84d42f65385f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:57:33.034235 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c5971-fa32-4bbf-abea-84d42f65385f service nova] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:57:33.043635 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 758/1527] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:57:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:57:37.031272 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1e7c0-0477-462b-99dc-4917ef00709f None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:57:37.031840 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1e7c0-0477-462b-99dc-4917ef00709f None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:57:37.031840 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1e7c0-0477-462b-99dc-4917ef00709f None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:57:37.033210 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 770/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 15:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:57:37.039001 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879d2a6-91aa-4daa-b2cf-e18158473086 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:57:37.039426 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879d2a6-91aa-4daa-b2cf-e18158473086 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:57:37.039532 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879d2a6-91aa-4daa-b2cf-e18158473086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:57:37.059355 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-8879d2a6-91aa-4daa-b2cf-e18158473086 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:57:37.060536 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-8879d2a6-91aa-4daa-b2cf-e18158473086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:57:37.068482 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 759/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 15:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:57:37.355641 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1e7c0-0477-462b-99dc-4917ef00709f None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:57:37.357372 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-98c1e7c0-0477-462b-99dc-4917ef00709f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:57:37.383079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:57:37.435407 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1e7c0-0477-462b-99dc-4917ef00709f None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:57:37.438981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44c8ad-ef1c-4813-ae85-3de4a4eb9169 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:57:37.439584 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44c8ad-ef1c-4813-ae85-3de4a4eb9169 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:57:37.439862 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44c8ad-ef1c-4813-ae85-3de4a4eb9169 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:57:37.440131 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44c8ad-ef1c-4813-ae85-3de4a4eb9169 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:57:37.449074 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44c8ad-ef1c-4813-ae85-3de4a4eb9169 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:57:37.450527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44c8ad-ef1c-4813-ae85-3de4a4eb9169 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:57:37.460255 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 771/1530] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:57:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:57:39.339563 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6e0bf-7cb1-4a1c-83e9-6e089bcb3e8a None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:57:39.340138 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6e0bf-7cb1-4a1c-83e9-6e089bcb3e8a None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:57:39.340138 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6e0bf-7cb1-4a1c-83e9-6e089bcb3e8a None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:57:39.341528 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 760/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 15:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:57:39.346477 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aba559-19a1-406b-b1d0-a9c89d8c2c1c None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:57:39.346874 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aba559-19a1-406b-b1d0-a9c89d8c2c1c None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:57:39.347029 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aba559-19a1-406b-b1d0-a9c89d8c2c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:57:39.367434 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-90aba559-19a1-406b-b1d0-a9c89d8c2c1c None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:57:39.368634 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-90aba559-19a1-406b-b1d0-a9c89d8c2c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:57:39.376621 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 772/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 15:57:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:57:39.670323 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6e0bf-7cb1-4a1c-83e9-6e089bcb3e8a None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:57:39.681236 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6e0bf-7cb1-4a1c-83e9-6e089bcb3e8a None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:57:39.684681 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c8c90-e05a-4826-ac08-d594e941c2ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:57:39.685301 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c8c90-e05a-4826-ac08-d594e941c2ca service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:57:39.685579 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c8c90-e05a-4826-ac08-d594e941c2ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:57:39.685846 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c8c90-e05a-4826-ac08-d594e941c2ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:57:39.694531 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c8c90-e05a-4826-ac08-d594e941c2ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:57:39.696006 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c8c90-e05a-4826-ac08-d594e941c2ca service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:57:39.705041 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 761/1533] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:57:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:57:43.235511 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d98f3-2fb6-4d4c-899d-6213145ec01d None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:57:43.236080 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d98f3-2fb6-4d4c-899d-6213145ec01d None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:57:43.236080 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d98f3-2fb6-4d4c-899d-6213145ec01d None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:57:43.237469 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 773/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 15:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:57:43.242549 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16718461-d1f3-4118-b666-a794b00ab62c None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:57:43.242997 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16718461-d1f3-4118-b666-a794b00ab62c None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:57:43.243100 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16718461-d1f3-4118-b666-a794b00ab62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:57:43.263011 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-16718461-d1f3-4118-b666-a794b00ab62c None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:57:43.264195 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-16718461-d1f3-4118-b666-a794b00ab62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:57:43.272729 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 762/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 15:57:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:57:43.825310 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d98f3-2fb6-4d4c-899d-6213145ec01d None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:57:43.827286 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-262d98f3-2fb6-4d4c-899d-6213145ec01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:57:43.906235 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d98f3-2fb6-4d4c-899d-6213145ec01d None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:57:43.909819 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76f854-0d57-4e61-af21-eb09e62d646b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:57:43.910420 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76f854-0d57-4e61-af21-eb09e62d646b service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:57:43.910698 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76f854-0d57-4e61-af21-eb09e62d646b service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:57:43.911511 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76f854-0d57-4e61-af21-eb09e62d646b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:57:43.920420 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc76f854-0d57-4e61-af21-eb09e62d646b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:57:43.921874 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc76f854-0d57-4e61-af21-eb09e62d646b service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:57:43.931995 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 774/1536] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:57:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:57:45.887329 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8addab7-aaf8-44df-8735-e5b35da38a5c None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:57:45.887898 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8addab7-aaf8-44df-8735-e5b35da38a5c None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:57:45.887898 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8addab7-aaf8-44df-8735-e5b35da38a5c None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:57:45.889248 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 763/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 15:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:57:45.894305 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264daa78-e7bb-4ec1-bd81-fd0a7be67553 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:57:45.894698 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264daa78-e7bb-4ec1-bd81-fd0a7be67553 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:57:45.894861 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264daa78-e7bb-4ec1-bd81-fd0a7be67553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:57:45.915270 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-264daa78-e7bb-4ec1-bd81-fd0a7be67553 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:57:45.916478 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-264daa78-e7bb-4ec1-bd81-fd0a7be67553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:57:45.924294 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 775/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 15:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:57:46.489665 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8addab7-aaf8-44df-8735-e5b35da38a5c None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:57:46.491310 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-c8addab7-aaf8-44df-8735-e5b35da38a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:57:46.503988 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8addab7-aaf8-44df-8735-e5b35da38a5c None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:57:46.507442 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c914b-b9fe-4461-8bfe-a073f15f2c9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:57:46.508025 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c914b-b9fe-4461-8bfe-a073f15f2c9f service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:57:46.508299 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c914b-b9fe-4461-8bfe-a073f15f2c9f service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:57:46.508566 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c914b-b9fe-4461-8bfe-a073f15f2c9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:57:46.517493 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c914b-b9fe-4461-8bfe-a073f15f2c9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:57:46.518918 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c914b-b9fe-4461-8bfe-a073f15f2c9f service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:57:46.528611 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 764/1539] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:57:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:57:55.909737 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=66 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:57:56.524567 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=34 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:14.040466 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee9e9f-0335-40f1-b5f9-7dba663f4aab None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:14.041094 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee9e9f-0335-40f1-b5f9-7dba663f4aab None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:14.041094 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee9e9f-0335-40f1-b5f9-7dba663f4aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:14.067919 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-47ee9e9f-0335-40f1-b5f9-7dba663f4aab None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:14.069175 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-47ee9e9f-0335-40f1-b5f9-7dba663f4aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:14.084815 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 776/1540] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:14.094196 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4a184-6680-47b1-ab01-92c0c0c07228 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:14.094966 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4a184-6680-47b1-ab01-92c0c0c07228 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:14.094966 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4a184-6680-47b1-ab01-92c0c0c07228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:14.127640 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-7bb4a184-6680-47b1-ab01-92c0c0c07228 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:14.129051 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-7bb4a184-6680-47b1-ab01-92c0c0c07228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:14.143853 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 765/1541] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:14.148424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee9e9f-0335-40f1-b5f9-7dba663f4aab None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:14.163472 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee9e9f-0335-40f1-b5f9-7dba663f4aab None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:14.178396 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779e34e-8971-40a0-9086-f5bcf3c8e2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:14.179039 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779e34e-8971-40a0-9086-f5bcf3c8e2a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:14.179316 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779e34e-8971-40a0-9086-f5bcf3c8e2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:14.179588 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779e34e-8971-40a0-9086-f5bcf3c8e2a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:14.180774 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779e34e-8971-40a0-9086-f5bcf3c8e2a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:59:14.181214 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779e34e-8971-40a0-9086-f5bcf3c8e2a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:14.182825 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779e34e-8971-40a0-9086-f5bcf3c8e2a2 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:14.200954 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 777/1542] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 15:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:59:14.208811 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4a184-6680-47b1-ab01-92c0c0c07228 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:14.219064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4a184-6680-47b1-ab01-92c0c0c07228 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:14.230125 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05990d8b-54ce-4dc4-ba73-e242df3c7056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:14.230776 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05990d8b-54ce-4dc4-ba73-e242df3c7056 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:14.231062 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05990d8b-54ce-4dc4-ba73-e242df3c7056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:14.231330 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05990d8b-54ce-4dc4-ba73-e242df3c7056 admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:14.231990 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05990d8b-54ce-4dc4-ba73-e242df3c7056 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:14.233963 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05990d8b-54ce-4dc4-ba73-e242df3c7056 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:14.273909 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c8899-4066-45da-b745-c76cbc689b7b None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:14.274269 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c8899-4066-45da-b745-c76cbc689b7b None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:14.274472 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c8899-4066-45da-b745-c76cbc689b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:14.300459 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 766/1543] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 15:59:14 2022] POST /identity/v3/projects => generated 379 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:14.305269 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05990d8b-54ce-4dc4-ba73-e242df3c7056 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:14.316988 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-ed3c8899-4066-45da-b745-c76cbc689b7b None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:14.317775 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-ed3c8899-4066-45da-b745-c76cbc689b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:14.437125 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05990d8b-54ce-4dc4-ba73-e242df3c7056 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:14.451060 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b73be-c8a0-4f8f-9842-dee3c148ea17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:14.451921 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b73be-c8a0-4f8f-9842-dee3c148ea17 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:14.452361 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b73be-c8a0-4f8f-9842-dee3c148ea17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:14.452638 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b73be-c8a0-4f8f-9842-dee3c148ea17 admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:14.453447 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62b73be-c8a0-4f8f-9842-dee3c148ea17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:14.455242 dv-cinder-855058-1-smb devstack@keystone.service[81420]: WARNING py.warnings [None req-b62b73be-c8a0-4f8f-9842-dee3c148ea17 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 15:59:14.455242 dv-cinder-855058-1-smb devstack@keystone.service[81420]: warnings.warn(msg) Aug 30 15:59:14.455242 dv-cinder-855058-1-smb devstack@keystone.service[81420]: Aug 30 15:59:14.455680 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 778/1544] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:14.456575 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62b73be-c8a0-4f8f-9842-dee3c148ea17 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:14.456965 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f227a-8be3-4505-95bd-9e4e5d8632ef None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:14.457249 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f227a-8be3-4505-95bd-9e4e5d8632ef None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:14.457521 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f227a-8be3-4505-95bd-9e4e5d8632ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:14.492581 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-3a4f227a-8be3-4505-95bd-9e4e5d8632ef None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:14.494019 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-3a4f227a-8be3-4505-95bd-9e4e5d8632ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:14.504140 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 767/1545] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:59:14 2022] POST /identity/v3/users => generated 290 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:59:14.505454 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3232a-40a8-4c68-a23a-0aec85777a23 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:14.505873 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3232a-40a8-4c68-a23a-0aec85777a23 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:14.506153 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3232a-40a8-4c68-a23a-0aec85777a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:14.512106 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 779/1546] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:14.513366 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0e8b9-c45a-4167-b959-e6a8fd0f881c None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:14.513646 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0e8b9-c45a-4167-b959-e6a8fd0f881c None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:14.513919 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0e8b9-c45a-4167-b959-e6a8fd0f881c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:14.550458 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-32c3232a-40a8-4c68-a23a-0aec85777a23 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:14.551897 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-32c3232a-40a8-4c68-a23a-0aec85777a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:14.553183 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-29f0e8b9-c45a-4167-b959-e6a8fd0f881c None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:14.554332 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-29f0e8b9-c45a-4167-b959-e6a8fd0f881c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:14.568005 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 768/1547] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:14.571561 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08e877-42a6-418a-8e71-98d3f7eb0969 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:14.571561 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08e877-42a6-418a-8e71-98d3f7eb0969 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:14.571561 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08e877-42a6-418a-8e71-98d3f7eb0969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:14.574004 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 780/1548] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:14.574831 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0e8b9-c45a-4167-b959-e6a8fd0f881c None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:14.597006 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0e8b9-c45a-4167-b959-e6a8fd0f881c None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:14.607328 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0cefd6-b21a-49e9-8e32-4457439525d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:14.607948 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cefd6-b21a-49e9-8e32-4457439525d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:14.608225 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cefd6-b21a-49e9-8e32-4457439525d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:14.608491 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cefd6-b21a-49e9-8e32-4457439525d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:14.609164 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0cefd6-b21a-49e9-8e32-4457439525d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:14.612354 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-bf08e877-42a6-418a-8e71-98d3f7eb0969 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:14.613855 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-bf08e877-42a6-418a-8e71-98d3f7eb0969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:14.615330 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0cefd6-b21a-49e9-8e32-4457439525d2 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:14.631013 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 781/1549] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:14.632749 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04214c6-00e5-4d10-99eb-a18e59765f31 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:14.632900 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 769/1550] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:14.633104 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04214c6-00e5-4d10-99eb-a18e59765f31 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:14.633331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04214c6-00e5-4d10-99eb-a18e59765f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:14.633709 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf08e877-42a6-418a-8e71-98d3f7eb0969 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:14.647861 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf08e877-42a6-418a-8e71-98d3f7eb0969 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:14.652504 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223df42-8263-465b-aa51-935a0c15a28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:14.653143 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223df42-8263-465b-aa51-935a0c15a28e admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:14.653437 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223df42-8263-465b-aa51-935a0c15a28e admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:14.653559 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-c04214c6-00e5-4d10-99eb-a18e59765f31 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:14.653678 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223df42-8263-465b-aa51-935a0c15a28e admin admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:14.654340 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3223df42-8263-465b-aa51-935a0c15a28e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:59:14.654640 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3223df42-8263-465b-aa51-935a0c15a28e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:14.654748 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c04214c6-00e5-4d10-99eb-a18e59765f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:14.655654 dv-cinder-855058-1-smb devstack@keystone.service[81420]: WARNING py.warnings [None req-3223df42-8263-465b-aa51-935a0c15a28e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 15:59:14.655654 dv-cinder-855058-1-smb devstack@keystone.service[81420]: warnings.warn(msg) Aug 30 15:59:14.655654 dv-cinder-855058-1-smb devstack@keystone.service[81420]: Aug 30 15:59:14.656540 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3223df42-8263-465b-aa51-935a0c15a28e admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:14.663129 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 782/1551] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:14.664298 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457c2d5-5f19-4ca0-a8c5-82f2c73e8f10 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:14.664573 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457c2d5-5f19-4ca0-a8c5-82f2c73e8f10 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:14.664868 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457c2d5-5f19-4ca0-a8c5-82f2c73e8f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:14.673299 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 770/1552] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 15:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:59:14.674029 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721dc8c5-4f24-4c27-86a9-d5fa1bc64927 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:14.674314 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721dc8c5-4f24-4c27-86a9-d5fa1bc64927 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:14.674594 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721dc8c5-4f24-4c27-86a9-d5fa1bc64927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:14.686766 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-c457c2d5-5f19-4ca0-a8c5-82f2c73e8f10 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:14.687991 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c457c2d5-5f19-4ca0-a8c5-82f2c73e8f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:14.694738 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-721dc8c5-4f24-4c27-86a9-d5fa1bc64927 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:14.696068 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-721dc8c5-4f24-4c27-86a9-d5fa1bc64927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:14.709220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 771/1553] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:14.709504 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 783/1554] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:14.709632 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0936be-89ef-4659-956c-f4c8d8596830 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:14.709736 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119fc7e-a3d4-4d69-9250-250451d7c70c None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:14.709833 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0936be-89ef-4659-956c-f4c8d8596830 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:14.709941 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119fc7e-a3d4-4d69-9250-250451d7c70c None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:14.710036 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0936be-89ef-4659-956c-f4c8d8596830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:14.710142 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119fc7e-a3d4-4d69-9250-250451d7c70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:14.728838 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-c119fc7e-a3d4-4d69-9250-250451d7c70c None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:14.728974 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-cd0936be-89ef-4659-956c-f4c8d8596830 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:14.730027 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c119fc7e-a3d4-4d69-9250-250451d7c70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:14.730148 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-cd0936be-89ef-4659-956c-f4c8d8596830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:14.738692 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 784/1555] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:14.746090 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 772/1556] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:14.746331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c119fc7e-a3d4-4d69-9250-250451d7c70c None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:14.746441 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948577cc-ce32-46d2-bf93-e03ac7e38078 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:14.746441 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948577cc-ce32-46d2-bf93-e03ac7e38078 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:14.746441 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948577cc-ce32-46d2-bf93-e03ac7e38078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:14.755600 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c119fc7e-a3d4-4d69-9250-250451d7c70c None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:14.760443 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fb570-1304-465d-9bf2-c031950437ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:14.761069 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fb570-1304-465d-9bf2-c031950437ce admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:14.761345 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fb570-1304-465d-9bf2-c031950437ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:14.761527 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-948577cc-ce32-46d2-bf93-e03ac7e38078 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:14.761645 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fb570-1304-465d-9bf2-c031950437ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:14.762234 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04fb570-1304-465d-9bf2-c031950437ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:14.762807 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-948577cc-ce32-46d2-bf93-e03ac7e38078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:14.763805 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04fb570-1304-465d-9bf2-c031950437ce admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:14.771782 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 773/1557] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:14.772739 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948577cc-ce32-46d2-bf93-e03ac7e38078 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:14.773646 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 785/1558] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:14.774280 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fb570-1304-465d-9bf2-c031950437ce admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:14.785054 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948577cc-ce32-46d2-bf93-e03ac7e38078 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:14.785221 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fb570-1304-465d-9bf2-c031950437ce admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:14.789825 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3ca47-a121-4a85-a4cd-d1a50ddf3bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:14.790058 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de69fc-a4b4-4f7a-939a-cc872dd3bbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:14.790443 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3ca47-a121-4a85-a4cd-d1a50ddf3bae admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:14.790658 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de69fc-a4b4-4f7a-939a-cc872dd3bbe8 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:14.790772 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3ca47-a121-4a85-a4cd-d1a50ddf3bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:14.790938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de69fc-a4b4-4f7a-939a-cc872dd3bbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:14.791048 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3ca47-a121-4a85-a4cd-d1a50ddf3bae admin admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:14.791345 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de69fc-a4b4-4f7a-939a-cc872dd3bbe8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:14.791628 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d3ca47-a121-4a85-a4cd-d1a50ddf3bae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:59:14.791935 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d3ca47-a121-4a85-a4cd-d1a50ddf3bae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:14.792045 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de69fc-a4b4-4f7a-939a-cc872dd3bbe8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:14.793021 dv-cinder-855058-1-smb devstack@keystone.service[81419]: WARNING py.warnings [None req-64de69fc-a4b4-4f7a-939a-cc872dd3bbe8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 15:59:14.793021 dv-cinder-855058-1-smb devstack@keystone.service[81419]: warnings.warn(msg) Aug 30 15:59:14.793021 dv-cinder-855058-1-smb devstack@keystone.service[81419]: Aug 30 15:59:14.793586 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d3ca47-a121-4a85-a4cd-d1a50ddf3bae admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:14.794199 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de69fc-a4b4-4f7a-939a-cc872dd3bbe8 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:14.807521 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 774/1559] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 15:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:59:14.808918 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3ca47-a121-4a85-a4cd-d1a50ddf3bae admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:14.820549 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3ca47-a121-4a85-a4cd-d1a50ddf3bae admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:14.825714 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35307a-013d-49de-9934-ee4b01ad143c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:14.826321 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35307a-013d-49de-9934-ee4b01ad143c admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:14.826599 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35307a-013d-49de-9934-ee4b01ad143c admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:14.826826 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 786/1560] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 15:59:14 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:14.827209 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35307a-013d-49de-9934-ee4b01ad143c admin admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:14.827938 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35307a-013d-49de-9934-ee4b01ad143c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:59:14.828253 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35307a-013d-49de-9934-ee4b01ad143c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:14.830840 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9683f-6795-4849-9ca7-9ff07123f75d None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:14.831130 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35307a-013d-49de-9934-ee4b01ad143c admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:14.831255 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9683f-6795-4849-9ca7-9ff07123f75d None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:14.831597 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9683f-6795-4849-9ca7-9ff07123f75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:14.846460 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 775/1561] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 15:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:59:14.847869 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7956a29-13df-4648-89db-55f42738a19c None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:14.848155 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7956a29-13df-4648-89db-55f42738a19c None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:14.848432 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7956a29-13df-4648-89db-55f42738a19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:14.861706 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-07e9683f-6795-4849-9ca7-9ff07123f75d None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:14.862986 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-07e9683f-6795-4849-9ca7-9ff07123f75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:14.868666 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-e7956a29-13df-4648-89db-55f42738a19c None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:14.870018 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-e7956a29-13df-4648-89db-55f42738a19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:14.904747 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:14.933787 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 787/1562] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:14.935343 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 776/1563] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:14.935343 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf75142-32be-4297-beea-c87bfc6d8da4 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:14.935343 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf75142-32be-4297-beea-c87bfc6d8da4 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:14.935343 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf75142-32be-4297-beea-c87bfc6d8da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:14.940080 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9683f-6795-4849-9ca7-9ff07123f75d None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:14.945602 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:14.949860 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9683f-6795-4849-9ca7-9ff07123f75d None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:14.957342 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df5fa9-5cea-4721-ac56-38c4530b33af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:14.958117 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df5fa9-5cea-4721-ac56-38c4530b33af admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:14.958495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df5fa9-5cea-4721-ac56-38c4530b33af admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:14.958862 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df5fa9-5cea-4721-ac56-38c4530b33af admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:14.959681 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92df5fa9-5cea-4721-ac56-38c4530b33af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:59:14.960075 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92df5fa9-5cea-4721-ac56-38c4530b33af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:14.961810 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-edf75142-32be-4297-beea-c87bfc6d8da4 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:14.961950 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92df5fa9-5cea-4721-ac56-38c4530b33af admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:14.963759 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-edf75142-32be-4297-beea-c87bfc6d8da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:14.974160 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 777/1564] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:14.975106 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 788/1565] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 15:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:59:14.975235 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf75142-32be-4297-beea-c87bfc6d8da4 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:14.975770 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df5fa9-5cea-4721-ac56-38c4530b33af admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:14.986897 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf75142-32be-4297-beea-c87bfc6d8da4 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:14.988217 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df5fa9-5cea-4721-ac56-38c4530b33af admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:14.991630 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8aa7b1-67d4-479b-a501-2594ac85f64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:14.992325 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8aa7b1-67d4-479b-a501-2594ac85f64a admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:14.992606 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8aa7b1-67d4-479b-a501-2594ac85f64a admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:14.992918 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8aa7b1-67d4-479b-a501-2594ac85f64a admin admin] PATH_INFO: `/v3/projects/b554cb6b0296443b82cfbdc03cc96a21/users/07922cc9c51e434db741e966a34f767c/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:14.993934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6a06b-9f08-4eb0-9d38-93b8d14aa862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:14.995017 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6a06b-9f08-4eb0-9d38-93b8d14aa862 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:14.995457 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6a06b-9f08-4eb0-9d38-93b8d14aa862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:14.995894 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6a06b-9f08-4eb0-9d38-93b8d14aa862 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:14.996995 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a6a06b-9f08-4eb0-9d38-93b8d14aa862 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:15.000358 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a6a06b-9f08-4eb0-9d38-93b8d14aa862 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:15.009103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8aa7b1-67d4-479b-a501-2594ac85f64a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b554cb6b0296443b82cfbdc03cc96a21, user_id=07922cc9c51e434db741e966a34f767c, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:15.012719 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8aa7b1-67d4-479b-a501-2594ac85f64a admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:15.028158 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 778/1566] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:14 2022] PUT /identity/v3/projects/b554cb6b0296443b82cfbdc03cc96a21/users/07922cc9c51e434db741e966a34f767c/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:15.032523 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8aa7b1-67d4-479b-a501-2594ac85f64a admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:15.032639 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 789/1567] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 15:59:14 2022] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:15.032639 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6a06b-9f08-4eb0-9d38-93b8d14aa862 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:15.100257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6a06b-9f08-4eb0-9d38-93b8d14aa862 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:15.102445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8aa7b1-67d4-479b-a501-2594ac85f64a admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:15.106159 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5c683-43ed-4468-9ea5-55b55f373d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:15.106774 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5c683-43ed-4468-9ea5-55b55f373d3b admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:15.107050 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5c683-43ed-4468-9ea5-55b55f373d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:15.107316 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5c683-43ed-4468-9ea5-55b55f373d3b admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:15.107426 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ae5c7-2ef7-46bc-95d1-0fb0bbb62ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:15.107964 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5c683-43ed-4468-9ea5-55b55f373d3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:15.108077 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ae5c7-2ef7-46bc-95d1-0fb0bbb62ccf admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:15.108299 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ae5c7-2ef7-46bc-95d1-0fb0bbb62ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:15.108740 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ae5c7-2ef7-46bc-95d1-0fb0bbb62ccf admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:15.109427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ae5c7-2ef7-46bc-95d1-0fb0bbb62ccf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:15.110662 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5c683-43ed-4468-9ea5-55b55f373d3b admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:15.111920 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ae5c7-2ef7-46bc-95d1-0fb0bbb62ccf admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:15.141674 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 779/1568] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:59:15 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:15.141674 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ae5c7-2ef7-46bc-95d1-0fb0bbb62ccf admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:15.142452 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 790/1569] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 15:59:15 2022] POST /identity/v3/projects => generated 371 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:15.142564 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5c683-43ed-4468-9ea5-55b55f373d3b admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:15.151534 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ae5c7-2ef7-46bc-95d1-0fb0bbb62ccf admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:15.213538 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e11f7-a907-4668-8ea8-e330a62730a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:15.214268 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e11f7-a907-4668-8ea8-e330a62730a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:15.214556 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e11f7-a907-4668-8ea8-e330a62730a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:15.214832 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e11f7-a907-4668-8ea8-e330a62730a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:15.215484 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689e11f7-a907-4668-8ea8-e330a62730a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:59:15.215789 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689e11f7-a907-4668-8ea8-e330a62730a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:15.217481 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689e11f7-a907-4668-8ea8-e330a62730a2 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:15.221136 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5c683-43ed-4468-9ea5-55b55f373d3b admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:15.226376 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046c497-e19c-471c-b82f-547d007159c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:15.227014 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046c497-e19c-471c-b82f-547d007159c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:15.227314 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046c497-e19c-471c-b82f-547d007159c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:15.227583 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046c497-e19c-471c-b82f-547d007159c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:15.228265 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046c497-e19c-471c-b82f-547d007159c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:59:15.228563 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046c497-e19c-471c-b82f-547d007159c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:15.230216 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046c497-e19c-471c-b82f-547d007159c1 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:15.230789 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 780/1570] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 15:59:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:59:15.231618 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e11f7-a907-4668-8ea8-e330a62730a2 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:15.242804 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e11f7-a907-4668-8ea8-e330a62730a2 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:15.247561 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef166bcc-d02f-413c-8007-646bfaa8f9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:15.248179 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef166bcc-d02f-413c-8007-646bfaa8f9b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:15.248464 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef166bcc-d02f-413c-8007-646bfaa8f9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:15.248735 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef166bcc-d02f-413c-8007-646bfaa8f9b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:15.249410 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef166bcc-d02f-413c-8007-646bfaa8f9b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:15.257071 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 791/1571] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 15:59:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:59:15.257071 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046c497-e19c-471c-b82f-547d007159c1 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:15.257323 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef166bcc-d02f-413c-8007-646bfaa8f9b3 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:15.267908 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046c497-e19c-471c-b82f-547d007159c1 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:15.273492 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8bd0c8-805b-4621-957f-0240dacd1a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:15.274314 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bd0c8-805b-4621-957f-0240dacd1a3f admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:15.274697 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bd0c8-805b-4621-957f-0240dacd1a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:15.275066 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bd0c8-805b-4621-957f-0240dacd1a3f admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:15.275880 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8bd0c8-805b-4621-957f-0240dacd1a3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:59:15.276438 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8bd0c8-805b-4621-957f-0240dacd1a3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:15.278824 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8bd0c8-805b-4621-957f-0240dacd1a3f admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:15.285675 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 781/1572] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 15:59:15 2022] POST /identity/v3/projects => generated 391 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:15.286964 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e123abe-b788-4735-ae46-3a287f1c15c5 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:15.287251 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e123abe-b788-4735-ae46-3a287f1c15c5 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:15.287981 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e123abe-b788-4735-ae46-3a287f1c15c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:15.303082 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 792/1573] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 15:59:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:59:15.303082 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8bd0c8-805b-4621-957f-0240dacd1a3f admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:15.308003 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8bd0c8-805b-4621-957f-0240dacd1a3f admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:15.309392 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-3e123abe-b788-4735-ae46-3a287f1c15c5 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:15.311120 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-3e123abe-b788-4735-ae46-3a287f1c15c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:15.317748 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:15.343552 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:15.372558 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d15af7-9428-4303-84d4-00dc8294691e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:15.373098 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d15af7-9428-4303-84d4-00dc8294691e admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:15.373375 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d15af7-9428-4303-84d4-00dc8294691e admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:15.373642 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d15af7-9428-4303-84d4-00dc8294691e admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:15.374448 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d15af7-9428-4303-84d4-00dc8294691e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:15.377261 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d15af7-9428-4303-84d4-00dc8294691e admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:15.379457 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 782/1574] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:15.380312 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e123abe-b788-4735-ae46-3a287f1c15c5 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:15.391815 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e123abe-b788-4735-ae46-3a287f1c15c5 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:15.398142 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a5092-4c64-4af7-9d92-ca895ccaa57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:15.399402 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a5092-4c64-4af7-9d92-ca895ccaa57d admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:15.399705 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a5092-4c64-4af7-9d92-ca895ccaa57d admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:15.399981 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a5092-4c64-4af7-9d92-ca895ccaa57d admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:15.400829 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a5092-4c64-4af7-9d92-ca895ccaa57d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:15.402460 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a5092-4c64-4af7-9d92-ca895ccaa57d admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:15.403532 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 793/1575] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:59:15 2022] POST /identity/v3/users => generated 284 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:15.404525 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d15af7-9428-4303-84d4-00dc8294691e admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:15.414363 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 783/1576] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:15.415256 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a5092-4c64-4af7-9d92-ca895ccaa57d admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:15.420350 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d15af7-9428-4303-84d4-00dc8294691e admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:15.425847 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a5092-4c64-4af7-9d92-ca895ccaa57d admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:15.426712 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b841f2-d977-459f-90e5-83fdebbc9b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:15.427326 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b841f2-d977-459f-90e5-83fdebbc9b8d admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:15.427600 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b841f2-d977-459f-90e5-83fdebbc9b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:15.427867 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b841f2-d977-459f-90e5-83fdebbc9b8d admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:15.428498 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b841f2-d977-459f-90e5-83fdebbc9b8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:15.430786 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1e1ce-f35c-4f18-9dcd-a081d672edd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:15.431110 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b841f2-d977-459f-90e5-83fdebbc9b8d admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:15.431390 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1e1ce-f35c-4f18-9dcd-a081d672edd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:15.431673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1e1ce-f35c-4f18-9dcd-a081d672edd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:15.431950 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1e1ce-f35c-4f18-9dcd-a081d672edd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:15.432585 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d1e1ce-f35c-4f18-9dcd-a081d672edd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:15.434576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d1e1ce-f35c-4f18-9dcd-a081d672edd2 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:15.453410 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 794/1577] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:59:15 2022] POST /identity/v3/users => generated 286 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:15.458246 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b841f2-d977-459f-90e5-83fdebbc9b8d admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:15.464709 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 784/1578] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 15:59:15 2022] POST /identity/v3/projects => generated 403 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:15.466232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1e1ce-f35c-4f18-9dcd-a081d672edd2 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:15.472188 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b841f2-d977-459f-90e5-83fdebbc9b8d admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:15.543921 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61f165-515a-4750-893b-f7befac5fe90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:15.544552 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61f165-515a-4750-893b-f7befac5fe90 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:15.544861 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61f165-515a-4750-893b-f7befac5fe90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:15.545134 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61f165-515a-4750-893b-f7befac5fe90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:15.545777 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61f165-515a-4750-893b-f7befac5fe90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:15.547103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1e1ce-f35c-4f18-9dcd-a081d672edd2 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:15.548297 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61f165-515a-4750-893b-f7befac5fe90 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:15.552897 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668a74e-e654-4942-8318-f7593714f090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:15.553449 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668a74e-e654-4942-8318-f7593714f090 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:15.553725 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668a74e-e654-4942-8318-f7593714f090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:15.554236 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668a74e-e654-4942-8318-f7593714f090 admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:15.554625 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9668a74e-e654-4942-8318-f7593714f090 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:15.556618 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9668a74e-e654-4942-8318-f7593714f090 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:15.581601 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 795/1579] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 15:59:15 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:15.581601 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61f165-515a-4750-893b-f7befac5fe90 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:15.589316 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 785/1580] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:59:15 2022] POST /identity/v3/users => generated 296 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:15.590151 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668a74e-e654-4942-8318-f7593714f090 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:15.591918 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-9668a74e-e654-4942-8318-f7593714f090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:15.645892 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61f165-515a-4750-893b-f7befac5fe90 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:15.650569 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27dc88-3e4c-4638-8047-c5024cc95174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:15.651189 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27dc88-3e4c-4638-8047-c5024cc95174 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:15.651469 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27dc88-3e4c-4638-8047-c5024cc95174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:15.651742 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27dc88-3e4c-4638-8047-c5024cc95174 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:15.652413 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27dc88-3e4c-4638-8047-c5024cc95174 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:15.654357 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27dc88-3e4c-4638-8047-c5024cc95174 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:15.665814 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668a74e-e654-4942-8318-f7593714f090 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:15.681168 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 796/1581] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 15:59:15 2022] POST /identity/v3/projects => generated 361 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:15.682067 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27dc88-3e4c-4638-8047-c5024cc95174 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:15.689723 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:15.702405 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:15.730512 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a475b37-c0c5-4910-b022-a53947cb0f50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:15.731219 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a475b37-c0c5-4910-b022-a53947cb0f50 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:15.731503 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a475b37-c0c5-4910-b022-a53947cb0f50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:15.731780 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a475b37-c0c5-4910-b022-a53947cb0f50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:15.741328 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a475b37-c0c5-4910-b022-a53947cb0f50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:15.742810 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a475b37-c0c5-4910-b022-a53947cb0f50 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:15.752547 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 786/1582] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:15.753453 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a475b37-c0c5-4910-b022-a53947cb0f50 service neutron] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:15.760383 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27dc88-3e4c-4638-8047-c5024cc95174 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:15.762862 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a475b37-c0c5-4910-b022-a53947cb0f50 service neutron] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:15.765185 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029dc9c-271a-4532-81a9-db52848f48ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:15.765805 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029dc9c-271a-4532-81a9-db52848f48ed admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:15.766085 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029dc9c-271a-4532-81a9-db52848f48ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:15.767592 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029dc9c-271a-4532-81a9-db52848f48ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:15.768271 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029dc9c-271a-4532-81a9-db52848f48ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:15.769134 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19883e21-4b3c-4b72-b643-008e2fcf3ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:15.769867 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19883e21-4b3c-4b72-b643-008e2fcf3ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:15.769984 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029dc9c-271a-4532-81a9-db52848f48ed admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:15.770146 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19883e21-4b3c-4b72-b643-008e2fcf3ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:15.770418 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19883e21-4b3c-4b72-b643-008e2fcf3ee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:15.771227 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19883e21-4b3c-4b72-b643-008e2fcf3ee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:15.772693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19883e21-4b3c-4b72-b643-008e2fcf3ee1 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:15.786941 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 787/1583] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:15.786941 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19883e21-4b3c-4b72-b643-008e2fcf3ee1 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:15.792908 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 797/1584] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:15.792908 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029dc9c-271a-4532-81a9-db52848f48ed admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:15.797966 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19883e21-4b3c-4b72-b643-008e2fcf3ee1 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:15.803142 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e744cb-219e-4370-939e-2ced5dd9c864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:15.803443 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029dc9c-271a-4532-81a9-db52848f48ed admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:15.803816 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e744cb-219e-4370-939e-2ced5dd9c864 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:15.804089 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e744cb-219e-4370-939e-2ced5dd9c864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:15.804361 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e744cb-219e-4370-939e-2ced5dd9c864 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:15.805065 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e744cb-219e-4370-939e-2ced5dd9c864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:15.806632 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e744cb-219e-4370-939e-2ced5dd9c864 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:15.808373 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48cea8-9cf4-46fe-85d0-5b52cc3bcf16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:15.809300 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48cea8-9cf4-46fe-85d0-5b52cc3bcf16 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:15.809532 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48cea8-9cf4-46fe-85d0-5b52cc3bcf16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:15.809674 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48cea8-9cf4-46fe-85d0-5b52cc3bcf16 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:15.810304 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db48cea8-9cf4-46fe-85d0-5b52cc3bcf16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:15.812240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db48cea8-9cf4-46fe-85d0-5b52cc3bcf16 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:15.818364 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 788/1585] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:15.822411 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e744cb-219e-4370-939e-2ced5dd9c864 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:15.835986 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e744cb-219e-4370-939e-2ced5dd9c864 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:15.842139 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ade1a0-466d-4b5f-80ac-43cb625b458c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:15.843226 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ade1a0-466d-4b5f-80ac-43cb625b458c admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:15.843611 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ade1a0-466d-4b5f-80ac-43cb625b458c admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:15.844008 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ade1a0-466d-4b5f-80ac-43cb625b458c admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:15.847980 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 798/1586] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:59:15 2022] POST /identity/v3/users => generated 302 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:15.848096 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ade1a0-466d-4b5f-80ac-43cb625b458c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:15.848207 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48cea8-9cf4-46fe-85d0-5b52cc3bcf16 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:15.848308 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ade1a0-466d-4b5f-80ac-43cb625b458c admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:15.859063 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48cea8-9cf4-46fe-85d0-5b52cc3bcf16 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:15.866190 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348275c-304e-4c81-9ab9-ec0fedb2348f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:15.866995 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348275c-304e-4c81-9ab9-ec0fedb2348f admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:15.867214 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348275c-304e-4c81-9ab9-ec0fedb2348f admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:15.867486 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348275c-304e-4c81-9ab9-ec0fedb2348f admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:15.868141 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348275c-304e-4c81-9ab9-ec0fedb2348f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:15.869763 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348275c-304e-4c81-9ab9-ec0fedb2348f admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:15.874968 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 789/1587] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:59:15 2022] POST /identity/v3/users => generated 293 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:15.874968 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ade1a0-466d-4b5f-80ac-43cb625b458c admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:15.882623 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 799/1588] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:15.886871 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348275c-304e-4c81-9ab9-ec0fedb2348f admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:15.889761 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ade1a0-466d-4b5f-80ac-43cb625b458c admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:15.896043 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432afe3-b7bd-48f3-94cb-7f78094da219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:15.896670 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432afe3-b7bd-48f3-94cb-7f78094da219 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:15.897041 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432afe3-b7bd-48f3-94cb-7f78094da219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:15.897377 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432afe3-b7bd-48f3-94cb-7f78094da219 admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:15.897581 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348275c-304e-4c81-9ab9-ec0fedb2348f admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:15.898138 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d432afe3-b7bd-48f3-94cb-7f78094da219 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:15.900476 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d432afe3-b7bd-48f3-94cb-7f78094da219 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:15.903799 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888577e-d6e0-4eb8-bd3f-f1fba530296e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:15.904514 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888577e-d6e0-4eb8-bd3f-f1fba530296e admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:15.905015 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888577e-d6e0-4eb8-bd3f-f1fba530296e admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:15.905371 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888577e-d6e0-4eb8-bd3f-f1fba530296e admin admin] PATH_INFO: `/v3/projects/164598d832474531a3326c748531194b/users/a5b950f64746494fb2f024e0c7147f93/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:15.926847 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a888577e-d6e0-4eb8-bd3f-f1fba530296e admin admin] RBAC: Authorizing `identity:create_grant(project_id=164598d832474531a3326c748531194b, user_id=a5b950f64746494fb2f024e0c7147f93, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:15.927807 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 790/1589] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:59:15 2022] POST /identity/v3/users => generated 281 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:15.928063 dv-cinder-855058-1-smb devstack@keystone.service[81419]: WARNING py.warnings [None req-a888577e-d6e0-4eb8-bd3f-f1fba530296e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 15:59:15.928063 dv-cinder-855058-1-smb devstack@keystone.service[81419]: warnings.warn(msg) Aug 30 15:59:15.928063 dv-cinder-855058-1-smb devstack@keystone.service[81419]: Aug 30 15:59:15.930317 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a888577e-d6e0-4eb8-bd3f-f1fba530296e admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:15.931857 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432afe3-b7bd-48f3-94cb-7f78094da219 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:15.943655 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432afe3-b7bd-48f3-94cb-7f78094da219 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:15.946565 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 800/1590] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:15 2022] PUT /identity/v3/projects/164598d832474531a3326c748531194b/users/a5b950f64746494fb2f024e0c7147f93/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:15.952553 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888577e-d6e0-4eb8-bd3f-f1fba530296e admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:16.006858 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60024fb-ef00-4245-a317-61b77edf31c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:16.007491 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60024fb-ef00-4245-a317-61b77edf31c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:16.007770 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60024fb-ef00-4245-a317-61b77edf31c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:16.008039 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60024fb-ef00-4245-a317-61b77edf31c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:16.008687 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60024fb-ef00-4245-a317-61b77edf31c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:16.010581 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60024fb-ef00-4245-a317-61b77edf31c9 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:16.022393 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 791/1591] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:16.022393 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60024fb-ef00-4245-a317-61b77edf31c9 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:16.029965 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888577e-d6e0-4eb8-bd3f-f1fba530296e admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:16.036553 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320f86d-a879-4e9a-8c86-21f38580243e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:16.037212 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320f86d-a879-4e9a-8c86-21f38580243e admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:16.037486 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320f86d-a879-4e9a-8c86-21f38580243e admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:16.037771 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320f86d-a879-4e9a-8c86-21f38580243e admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:16.038430 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320f86d-a879-4e9a-8c86-21f38580243e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:16.039691 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60024fb-ef00-4245-a317-61b77edf31c9 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:16.040147 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320f86d-a879-4e9a-8c86-21f38580243e admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:16.044820 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee81b2-f393-4e8f-8fe8-3d347720de53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:16.045530 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee81b2-f393-4e8f-8fe8-3d347720de53 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:16.045820 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee81b2-f393-4e8f-8fe8-3d347720de53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:16.046445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee81b2-f393-4e8f-8fe8-3d347720de53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:16.047401 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee81b2-f393-4e8f-8fe8-3d347720de53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:16.050587 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee81b2-f393-4e8f-8fe8-3d347720de53 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:16.056147 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 801/1592] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:16.057583 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320f86d-a879-4e9a-8c86-21f38580243e admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:16.066253 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 792/1593] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:16.067178 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee81b2-f393-4e8f-8fe8-3d347720de53 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:16.070064 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320f86d-a879-4e9a-8c86-21f38580243e admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:16.075818 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e01d78-b677-4f34-ae27-c70d892a60a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:16.076555 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e01d78-b677-4f34-ae27-c70d892a60a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:16.077009 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e01d78-b677-4f34-ae27-c70d892a60a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:16.077276 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee81b2-f393-4e8f-8fe8-3d347720de53 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:16.077670 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e01d78-b677-4f34-ae27-c70d892a60a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:16.078420 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e01d78-b677-4f34-ae27-c70d892a60a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:16.080372 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e01d78-b677-4f34-ae27-c70d892a60a0 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:16.082692 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766e7e5-eb82-4432-b1f4-de27267a2d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:16.083366 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766e7e5-eb82-4432-b1f4-de27267a2d5d admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:16.083688 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766e7e5-eb82-4432-b1f4-de27267a2d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:16.083962 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766e7e5-eb82-4432-b1f4-de27267a2d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:16.084612 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c766e7e5-eb82-4432-b1f4-de27267a2d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:16.086609 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c766e7e5-eb82-4432-b1f4-de27267a2d5d admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:16.091433 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 802/1594] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:16.092302 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e01d78-b677-4f34-ae27-c70d892a60a0 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:16.104311 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 793/1595] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:16.104311 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70574bf-6277-459a-a0ca-a3a2113d6a6a None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:16.105324 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e01d78-b677-4f34-ae27-c70d892a60a0 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:16.105721 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70574bf-6277-459a-a0ca-a3a2113d6a6a None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:16.105721 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70574bf-6277-459a-a0ca-a3a2113d6a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:16.111308 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75963525-c2f0-48c1-85b9-e2976147ca07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:16.112143 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75963525-c2f0-48c1-85b9-e2976147ca07 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:16.112460 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75963525-c2f0-48c1-85b9-e2976147ca07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:16.112915 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75963525-c2f0-48c1-85b9-e2976147ca07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:16.113653 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75963525-c2f0-48c1-85b9-e2976147ca07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:16.115648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75963525-c2f0-48c1-85b9-e2976147ca07 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:16.125456 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-f70574bf-6277-459a-a0ca-a3a2113d6a6a None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:16.126627 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-f70574bf-6277-459a-a0ca-a3a2113d6a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:16.127892 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 803/1596] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:16.128900 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75963525-c2f0-48c1-85b9-e2976147ca07 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:16.140285 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75963525-c2f0-48c1-85b9-e2976147ca07 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:16.141629 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 794/1597] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:16.143090 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70574bf-6277-459a-a0ca-a3a2113d6a6a None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:16.145828 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba41c6e-3fdc-4f32-96c7-17e7ad44c578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:16.146644 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba41c6e-3fdc-4f32-96c7-17e7ad44c578 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:16.146936 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba41c6e-3fdc-4f32-96c7-17e7ad44c578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:16.147280 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba41c6e-3fdc-4f32-96c7-17e7ad44c578 admin admin] PATH_INFO: `/v3/projects/41ca7af458254a8ead703a54de503390/users/839cf55ba062488f9dfd2e54475466a1/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:16.155413 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70574bf-6277-459a-a0ca-a3a2113d6a6a None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:16.162933 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7275c3d-a7bf-401d-aa79-aa74df7e4996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:16.163616 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7275c3d-a7bf-401d-aa79-aa74df7e4996 admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:16.163899 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7275c3d-a7bf-401d-aa79-aa74df7e4996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:16.164174 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7275c3d-a7bf-401d-aa79-aa74df7e4996 admin admin] PATH_INFO: `/v3/projects/1a132abc47914b5db6f88f8bb43aa124/users/d5e00de41fe34d9fb2aa8d2972700586/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:16.168827 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba41c6e-3fdc-4f32-96c7-17e7ad44c578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41ca7af458254a8ead703a54de503390, user_id=839cf55ba062488f9dfd2e54475466a1, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:16.172287 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba41c6e-3fdc-4f32-96c7-17e7ad44c578 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:16.184324 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7275c3d-a7bf-401d-aa79-aa74df7e4996 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a132abc47914b5db6f88f8bb43aa124, user_id=d5e00de41fe34d9fb2aa8d2972700586, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:16.188241 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7275c3d-a7bf-401d-aa79-aa74df7e4996 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:16.197223 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 804/1598] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:16 2022] PUT /identity/v3/projects/41ca7af458254a8ead703a54de503390/users/839cf55ba062488f9dfd2e54475466a1/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:16.198077 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba41c6e-3fdc-4f32-96c7-17e7ad44c578 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:16.211447 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:16.229227 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 795/1599] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:16 2022] PUT /identity/v3/projects/1a132abc47914b5db6f88f8bb43aa124/users/d5e00de41fe34d9fb2aa8d2972700586/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:16.233009 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7275c3d-a7bf-401d-aa79-aa74df7e4996 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:16.258815 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:16.284886 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba41c6e-3fdc-4f32-96c7-17e7ad44c578 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:16.319048 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7275c3d-a7bf-401d-aa79-aa74df7e4996 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:16.324981 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea131ac3-3c2b-4ac2-b431-f73e2b22317a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:16.325606 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea131ac3-3c2b-4ac2-b431-f73e2b22317a admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:16.325885 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea131ac3-3c2b-4ac2-b431-f73e2b22317a admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:16.326160 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea131ac3-3c2b-4ac2-b431-f73e2b22317a admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:16.326818 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea131ac3-3c2b-4ac2-b431-f73e2b22317a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:16.328436 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea131ac3-3c2b-4ac2-b431-f73e2b22317a admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:16.340817 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 796/1600] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:16 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:16.341625 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea131ac3-3c2b-4ac2-b431-f73e2b22317a admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:16.353762 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea131ac3-3c2b-4ac2-b431-f73e2b22317a admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:16.358483 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4187a2-1bca-4af8-80a0-b6f1dcb2aa4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:16.359147 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4187a2-1bca-4af8-80a0-b6f1dcb2aa4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:16.359429 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4187a2-1bca-4af8-80a0-b6f1dcb2aa4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:16.359582 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb3462-42d9-493d-b516-de0a38cd621b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:16.359719 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4187a2-1bca-4af8-80a0-b6f1dcb2aa4a admin admin] PATH_INFO: `/v3/projects/0bc4d8cac273429585b23fe362cb76b0/users/041323d39916493aa4318309904f4ef2/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:16.360635 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb3462-42d9-493d-b516-de0a38cd621b admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:16.361149 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb3462-42d9-493d-b516-de0a38cd621b admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:16.361588 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb3462-42d9-493d-b516-de0a38cd621b admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:16.362598 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb3462-42d9-493d-b516-de0a38cd621b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:16.365623 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb3462-42d9-493d-b516-de0a38cd621b admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:16.375700 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4187a2-1bca-4af8-80a0-b6f1dcb2aa4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bc4d8cac273429585b23fe362cb76b0, user_id=041323d39916493aa4318309904f4ef2, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:16.376561 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 805/1601] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:16 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:16.380084 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb3462-42d9-493d-b516-de0a38cd621b admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:16.380222 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4187a2-1bca-4af8-80a0-b6f1dcb2aa4a admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:16.392553 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb3462-42d9-493d-b516-de0a38cd621b admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:16.397728 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 797/1602] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:16 2022] PUT /identity/v3/projects/0bc4d8cac273429585b23fe362cb76b0/users/041323d39916493aa4318309904f4ef2/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:16.398616 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4187a2-1bca-4af8-80a0-b6f1dcb2aa4a admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:16.452314 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a997b5-ae79-4194-886e-a3a142946d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:16.452970 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a997b5-ae79-4194-886e-a3a142946d6c admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:16.453251 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a997b5-ae79-4194-886e-a3a142946d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:16.453552 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a997b5-ae79-4194-886e-a3a142946d6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:16.454702 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a997b5-ae79-4194-886e-a3a142946d6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:16.457554 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a997b5-ae79-4194-886e-a3a142946d6c admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:16.467611 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 806/1603] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:16 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:16.468896 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b5a90-7b2a-4f92-8841-c8c2ed6a6544 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:16.469185 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b5a90-7b2a-4f92-8841-c8c2ed6a6544 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:16.469529 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b5a90-7b2a-4f92-8841-c8c2ed6a6544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:16.473079 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4187a2-1bca-4af8-80a0-b6f1dcb2aa4a admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:16.477373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a761b-f048-4102-9e80-546ff3b9e167 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:16.478863 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a761b-f048-4102-9e80-546ff3b9e167 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:16.479144 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a761b-f048-4102-9e80-546ff3b9e167 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:16.479417 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a761b-f048-4102-9e80-546ff3b9e167 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:16.491067 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a761b-f048-4102-9e80-546ff3b9e167 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:16.492636 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a761b-f048-4102-9e80-546ff3b9e167 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:16.501332 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-495b5a90-7b2a-4f92-8841-c8c2ed6a6544 None None] MFA Rules not processed for user `839cf55ba062488f9dfd2e54475466a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:16.502584 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-495b5a90-7b2a-4f92-8841-c8c2ed6a6544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:16.504233 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 798/1604] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:16.505585 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f82b1-317c-474f-a43c-9dd9be7da4e5 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:16.505890 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f82b1-317c-474f-a43c-9dd9be7da4e5 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:16.506212 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f82b1-317c-474f-a43c-9dd9be7da4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:16.551420 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-e84f82b1-317c-474f-a43c-9dd9be7da4e5 None None] MFA Rules not processed for user `d5e00de41fe34d9fb2aa8d2972700586`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:16.552749 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-e84f82b1-317c-474f-a43c-9dd9be7da4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:16.555182 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:16.613614 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 807/1605] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:16.614595 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b5a90-7b2a-4f92-8841-c8c2ed6a6544 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:16.635921 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b5a90-7b2a-4f92-8841-c8c2ed6a6544 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:16.644574 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb363f4b-df19-400d-9d93-f21a9cff095b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:16.645318 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb363f4b-df19-400d-9d93-f21a9cff095b admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:16.645603 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb363f4b-df19-400d-9d93-f21a9cff095b admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:16.645886 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb363f4b-df19-400d-9d93-f21a9cff095b admin admin] PATH_INFO: `/v3/projects/de070d75ab054703af6a2efc6be8a773/users/dfefb218af92485aa807a9669cfb9067/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:16.669199 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb363f4b-df19-400d-9d93-f21a9cff095b admin admin] RBAC: Authorizing `identity:create_grant(project_id=de070d75ab054703af6a2efc6be8a773, user_id=dfefb218af92485aa807a9669cfb9067, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:16.672269 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb363f4b-df19-400d-9d93-f21a9cff095b admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:16.692220 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 808/1607] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:16 2022] PUT /identity/v3/projects/de070d75ab054703af6a2efc6be8a773/users/dfefb218af92485aa807a9669cfb9067/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:16.703730 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 799/1607] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:16.703730 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f82b1-317c-474f-a43c-9dd9be7da4e5 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:16.715597 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fb1d2-15a9-4671-9015-d257a33e7684 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:16.716281 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fb1d2-15a9-4671-9015-d257a33e7684 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:16.716547 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fb1d2-15a9-4671-9015-d257a33e7684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:16.718534 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f82b1-317c-474f-a43c-9dd9be7da4e5 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:16.748636 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:16.790913 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-397fb1d2-15a9-4671-9015-d257a33e7684 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:16.792717 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-397fb1d2-15a9-4671-9015-d257a33e7684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:16.852294 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb631f-01cb-4325-ad43-1d72cf875b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:16.853576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb631f-01cb-4325-ad43-1d72cf875b76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:16.854000 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb631f-01cb-4325-ad43-1d72cf875b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:16.854463 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb631f-01cb-4325-ad43-1d72cf875b76 admin admin] PATH_INFO: `/v3/projects/faee73875d6d48d6a4823f7fe4fe626b/users/2ffc08db0f5b44538b32a781e59bdd10/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:16.875875 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb631f-01cb-4325-ad43-1d72cf875b76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faee73875d6d48d6a4823f7fe4fe626b, user_id=2ffc08db0f5b44538b32a781e59bdd10, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:16.878479 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 809/1608] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:16.879291 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397fb1d2-15a9-4671-9015-d257a33e7684 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:16.882947 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb631f-01cb-4325-ad43-1d72cf875b76 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:16.890821 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397fb1d2-15a9-4671-9015-d257a33e7684 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:16.896820 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d552891a-66c9-4a55-b781-c46782bdc107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:16.897810 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552891a-66c9-4a55-b781-c46782bdc107 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:16.898093 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552891a-66c9-4a55-b781-c46782bdc107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:16.898974 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552891a-66c9-4a55-b781-c46782bdc107 admin admin] PATH_INFO: `/v3/projects/9569c92cbd724361ae13bc0e385b17d5/users/db2c0226736f481386c1e764b3eb366b/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:16.905957 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 800/1609] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:16 2022] PUT /identity/v3/projects/faee73875d6d48d6a4823f7fe4fe626b/users/2ffc08db0f5b44538b32a781e59bdd10/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:16.907862 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb631f-01cb-4325-ad43-1d72cf875b76 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:16.919163 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d552891a-66c9-4a55-b781-c46782bdc107 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9569c92cbd724361ae13bc0e385b17d5, user_id=db2c0226736f481386c1e764b3eb366b, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:16.921805 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d552891a-66c9-4a55-b781-c46782bdc107 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:16.957968 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 810/1610] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:16 2022] PUT /identity/v3/projects/9569c92cbd724361ae13bc0e385b17d5/users/db2c0226736f481386c1e764b3eb366b/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:16.959034 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7bff7-09b8-4151-91d4-5cebe13d5103 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:16.959311 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7bff7-09b8-4151-91d4-5cebe13d5103 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:16.959609 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7bff7-09b8-4151-91d4-5cebe13d5103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:16.986755 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb631f-01cb-4325-ad43-1d72cf875b76 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:16.999955 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-eef7bff7-09b8-4151-91d4-5cebe13d5103 None None] MFA Rules not processed for user `dfefb218af92485aa807a9669cfb9067`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:17.001919 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-eef7bff7-09b8-4151-91d4-5cebe13d5103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:17.045409 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c0fef-6279-45b8-9c49-5ff8657c5120 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:17.045844 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c0fef-6279-45b8-9c49-5ff8657c5120 service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:17.046121 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c0fef-6279-45b8-9c49-5ff8657c5120 service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:17.046442 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c0fef-6279-45b8-9c49-5ff8657c5120 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:17.132872 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 811/1611] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:17.134180 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a82f4-fd7d-4a5d-8daf-4a8098ab43b5 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:17.134713 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a82f4-fd7d-4a5d-8daf-4a8098ab43b5 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:17.134992 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a82f4-fd7d-4a5d-8daf-4a8098ab43b5 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:17.141039 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 812/1612] 10.222.0.25 () {54 vars in 962 bytes} [Tue Aug 30 15:59:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:59:17.147386 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a82f4-fd7d-4a5d-8daf-4a8098ab43b5 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:17.161442 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c0fef-6279-45b8-9c49-5ff8657c5120 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:17.163203 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c0fef-6279-45b8-9c49-5ff8657c5120 service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:17.174285 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 801/1613] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:17.175545 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28e64b-3c3f-4eaf-a011-e13e1fdaf396 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:17.175833 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28e64b-3c3f-4eaf-a011-e13e1fdaf396 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:17.176678 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28e64b-3c3f-4eaf-a011-e13e1fdaf396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:17.199732 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:17.212609 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-0f28e64b-3c3f-4eaf-a011-e13e1fdaf396 None None] MFA Rules not processed for user `2ffc08db0f5b44538b32a781e59bdd10`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:17.214091 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:17.214513 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-0f28e64b-3c3f-4eaf-a011-e13e1fdaf396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:17.284707 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a82f4-fd7d-4a5d-8daf-4a8098ab43b5 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:17.295312 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af75e2-2095-40b0-80b9-de7a5bd8ce47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:17.295898 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af75e2-2095-40b0-80b9-de7a5bd8ce47 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:17.298376 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af75e2-2095-40b0-80b9-de7a5bd8ce47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:17.298658 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af75e2-2095-40b0-80b9-de7a5bd8ce47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:17.324807 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 802/1614] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:17 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:17.328485 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50b692-55a9-42c4-9d56-d3172a40a13b None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:17.328485 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50b692-55a9-42c4-9d56-d3172a40a13b None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:17.328485 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50b692-55a9-42c4-9d56-d3172a40a13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:17.403270 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-7b50b692-55a9-42c4-9d56-d3172a40a13b None None] MFA Rules not processed for user `db2c0226736f481386c1e764b3eb366b`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:17.404568 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-7b50b692-55a9-42c4-9d56-d3172a40a13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:17.462351 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af75e2-2095-40b0-80b9-de7a5bd8ce47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:17.464250 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af75e2-2095-40b0-80b9-de7a5bd8ce47 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:17.492551 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 803/1615] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:17.494066 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7680f37-9c34-4fb5-ac7a-ac73d1018fc0 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:17.494355 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7680f37-9c34-4fb5-ac7a-ac73d1018fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:17.494769 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7680f37-9c34-4fb5-ac7a-ac73d1018fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:17.498058 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 813/1616] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:17.499501 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cc30a-a484-454a-8728-daeb6c4d772e None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:17.504196 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cc30a-a484-454a-8728-daeb6c4d772e None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:17.504622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cc30a-a484-454a-8728-daeb6c4d772e None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:17.506480 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 814/1617] 10.222.0.25 () {54 vars in 962 bytes} [Tue Aug 30 15:59:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:59:17.509746 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5cc30a-a484-454a-8728-daeb6c4d772e None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:17.541147 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-f7680f37-9c34-4fb5-ac7a-ac73d1018fc0 None None] MFA Rules not processed for user `ebc80bf891614fb895af33ca1ded6b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:17.542559 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-f7680f37-9c34-4fb5-ac7a-ac73d1018fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:17.546352 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5cc30a-a484-454a-8728-daeb6c4d772e None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:17.566491 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc28e19-8e27-4e2c-9917-fbb1d9fd4677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:17.568550 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc28e19-8e27-4e2c-9917-fbb1d9fd4677 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:17.571322 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc28e19-8e27-4e2c-9917-fbb1d9fd4677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:17.572629 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc28e19-8e27-4e2c-9917-fbb1d9fd4677 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:17.576878 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc28e19-8e27-4e2c-9917-fbb1d9fd4677 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:17.579524 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc28e19-8e27-4e2c-9917-fbb1d9fd4677 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:17.633962 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 804/1618] 10.222.0.25 () {58 vars in 1059 bytes} [Tue Aug 30 15:59:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:17.634968 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7680f37-9c34-4fb5-ac7a-ac73d1018fc0 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:17.646113 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7680f37-9c34-4fb5-ac7a-ac73d1018fc0 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:17.651614 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661593b-5ca4-4536-a190-abb3fedcc988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:17.652283 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661593b-5ca4-4536-a190-abb3fedcc988 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:17.652551 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661593b-5ca4-4536-a190-abb3fedcc988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:17.652901 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661593b-5ca4-4536-a190-abb3fedcc988 admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:17.653732 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f661593b-5ca4-4536-a190-abb3fedcc988 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:17.656233 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f661593b-5ca4-4536-a190-abb3fedcc988 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:17.663470 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:17.685311 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 815/1619] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 15:59:17 2022] POST /identity/v3/projects => generated 405 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:17.688808 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701c228-cf25-4c6e-b69d-934a3ebc2deb None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:17.689311 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701c228-cf25-4c6e-b69d-934a3ebc2deb None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:17.691218 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701c228-cf25-4c6e-b69d-934a3ebc2deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:17.707102 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 805/1620] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 15:59:17 2022] POST /identity/v3/projects => generated 363 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:17.708430 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661593b-5ca4-4536-a190-abb3fedcc988 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:17.737725 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-b701c228-cf25-4c6e-b69d-934a3ebc2deb None None] MFA Rules not processed for user `ebc80bf891614fb895af33ca1ded6b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:17.741488 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-b701c228-cf25-4c6e-b69d-934a3ebc2deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:17.929048 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 816/1621] 10.222.0.25 () {58 vars in 1059 bytes} [Tue Aug 30 15:59:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:17.930445 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b701c228-cf25-4c6e-b69d-934a3ebc2deb None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:17.944498 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661593b-5ca4-4536-a190-abb3fedcc988 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:17.960490 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30d318-86c6-4100-a8c6-553a009cbba1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:17.961173 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30d318-86c6-4100-a8c6-553a009cbba1 service nova] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:17.962756 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30d318-86c6-4100-a8c6-553a009cbba1 service nova] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:17.963060 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30d318-86c6-4100-a8c6-553a009cbba1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:18.039574 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:18.154443 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30d318-86c6-4100-a8c6-553a009cbba1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:18.154443 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30d318-86c6-4100-a8c6-553a009cbba1 service nova] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:18.154443 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 806/1622] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:18.154443 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30d318-86c6-4100-a8c6-553a009cbba1 service nova] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:18.156215 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b701c228-cf25-4c6e-b69d-934a3ebc2deb None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:18.156215 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe68288-e724-43ce-90e9-f0897bf10795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:18.156215 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe68288-e724-43ce-90e9-f0897bf10795 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:18.156215 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe68288-e724-43ce-90e9-f0897bf10795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:18.157973 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe68288-e724-43ce-90e9-f0897bf10795 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:18.157973 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe68288-e724-43ce-90e9-f0897bf10795 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:18.158456 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30d318-86c6-4100-a8c6-553a009cbba1 service nova] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:18.161100 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe68288-e724-43ce-90e9-f0897bf10795 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:18.178532 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c19c5b-1af4-4188-858d-bc056834b69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:18.179218 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c19c5b-1af4-4188-858d-bc056834b69d admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:18.179452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c19c5b-1af4-4188-858d-bc056834b69d admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:18.179722 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c19c5b-1af4-4188-858d-bc056834b69d admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:18.180457 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c19c5b-1af4-4188-858d-bc056834b69d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:18.190662 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c19c5b-1af4-4188-858d-bc056834b69d admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:18.231837 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 817/1623] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:59:17 2022] POST /identity/v3/users => generated 309 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:18.235792 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe68288-e724-43ce-90e9-f0897bf10795 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:18.246497 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 807/1624] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:59:18 2022] POST /identity/v3/users => generated 288 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:18.247569 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c19c5b-1af4-4188-858d-bc056834b69d admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:18.265888 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe68288-e724-43ce-90e9-f0897bf10795 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:18.268697 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c19c5b-1af4-4188-858d-bc056834b69d admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:18.281645 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999714da-571b-46d1-ba7c-53338fd7f0ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:18.283431 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2d26e-b528-4e3f-87ea-0c21d9aec25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:18.284686 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2d26e-b528-4e3f-87ea-0c21d9aec25f admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:18.284849 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999714da-571b-46d1-ba7c-53338fd7f0ff service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:18.284949 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2d26e-b528-4e3f-87ea-0c21d9aec25f admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:18.285081 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999714da-571b-46d1-ba7c-53338fd7f0ff service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:18.285181 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2d26e-b528-4e3f-87ea-0c21d9aec25f admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:18.285279 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999714da-571b-46d1-ba7c-53338fd7f0ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:18.285368 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c2d26e-b528-4e3f-87ea-0c21d9aec25f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:18.286907 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c2d26e-b528-4e3f-87ea-0c21d9aec25f admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:18.314903 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 808/1625] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:18.320515 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2d26e-b528-4e3f-87ea-0c21d9aec25f admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:18.332461 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2d26e-b528-4e3f-87ea-0c21d9aec25f admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:18.343095 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4e316-bff2-4cd1-b22e-73ba155f9739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:18.343746 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4e316-bff2-4cd1-b22e-73ba155f9739 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:18.344030 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4e316-bff2-4cd1-b22e-73ba155f9739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:18.344844 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4e316-bff2-4cd1-b22e-73ba155f9739 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:18.346103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4e316-bff2-4cd1-b22e-73ba155f9739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:18.349449 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4e316-bff2-4cd1-b22e-73ba155f9739 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:18.369429 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 809/1626] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:18.370930 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4e316-bff2-4cd1-b22e-73ba155f9739 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:18.382736 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4e316-bff2-4cd1-b22e-73ba155f9739 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:18.404719 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa984032-558d-41e2-b23a-6f65c5c15513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:18.405660 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa984032-558d-41e2-b23a-6f65c5c15513 admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:18.406044 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa984032-558d-41e2-b23a-6f65c5c15513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:18.406325 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa984032-558d-41e2-b23a-6f65c5c15513 admin admin] PATH_INFO: `/v3/projects/d6b71ee250274131b56629ab2afc33ce/users/741fe562c3414cd994224ce708acddb6/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:18.437477 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999714da-571b-46d1-ba7c-53338fd7f0ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:18.440126 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999714da-571b-46d1-ba7c-53338fd7f0ff service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:18.441859 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa984032-558d-41e2-b23a-6f65c5c15513 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6b71ee250274131b56629ab2afc33ce, user_id=741fe562c3414cd994224ce708acddb6, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:18.445655 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa984032-558d-41e2-b23a-6f65c5c15513 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:18.480585 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 818/1627] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:18.484288 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999714da-571b-46d1-ba7c-53338fd7f0ff service nova] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:18.495471 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 810/1628] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:18 2022] PUT /identity/v3/projects/d6b71ee250274131b56629ab2afc33ce/users/741fe562c3414cd994224ce708acddb6/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:18.499307 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa984032-558d-41e2-b23a-6f65c5c15513 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:18.529619 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999714da-571b-46d1-ba7c-53338fd7f0ff service nova] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:18.587627 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:18.777190 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa984032-558d-41e2-b23a-6f65c5c15513 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:18.786408 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774eb467-7c29-46bc-8097-542e9f3a7864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:18.789383 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774eb467-7c29-46bc-8097-542e9f3a7864 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:18.789695 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774eb467-7c29-46bc-8097-542e9f3a7864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:18.790024 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774eb467-7c29-46bc-8097-542e9f3a7864 admin admin] PATH_INFO: `/v3/projects/7f73a34d518844f5a7d2547add1ed1f7/users/e44d7ae8124b4017b39a96e74a104371/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:18.799205 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18766cf3-5890-411d-9600-75b9bb9676ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:18.799852 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18766cf3-5890-411d-9600-75b9bb9676ae admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:18.800134 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18766cf3-5890-411d-9600-75b9bb9676ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:18.800408 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18766cf3-5890-411d-9600-75b9bb9676ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:18.801858 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18766cf3-5890-411d-9600-75b9bb9676ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:18.815503 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18766cf3-5890-411d-9600-75b9bb9676ae admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:18.841836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774eb467-7c29-46bc-8097-542e9f3a7864 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f73a34d518844f5a7d2547add1ed1f7, user_id=e44d7ae8124b4017b39a96e74a104371, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:18.845183 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774eb467-7c29-46bc-8097-542e9f3a7864 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:18.864500 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 811/1629] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 15:59:18.868959 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18766cf3-5890-411d-9600-75b9bb9676ae admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:18.878350 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 819/1630] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:18 2022] PUT /identity/v3/projects/7f73a34d518844f5a7d2547add1ed1f7/users/e44d7ae8124b4017b39a96e74a104371/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:18.884059 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774eb467-7c29-46bc-8097-542e9f3a7864 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:18.895368 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18766cf3-5890-411d-9600-75b9bb9676ae admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:19.037240 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a422007-b671-4c8f-9b17-fe57da209f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:19.038005 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a422007-b671-4c8f-9b17-fe57da209f1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:19.038416 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a422007-b671-4c8f-9b17-fe57da209f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:19.038966 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a422007-b671-4c8f-9b17-fe57da209f1c admin admin] PATH_INFO: `/v3/projects/d6b71ee250274131b56629ab2afc33ce/users/741fe562c3414cd994224ce708acddb6/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:19.042112 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a422007-b671-4c8f-9b17-fe57da209f1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6b71ee250274131b56629ab2afc33ce, user_id=741fe562c3414cd994224ce708acddb6, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:19.045248 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:19.052197 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a422007-b671-4c8f-9b17-fe57da209f1c admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:19.063124 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774eb467-7c29-46bc-8097-542e9f3a7864 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:19.086863 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 812/1631] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:18 2022] PUT /identity/v3/projects/d6b71ee250274131b56629ab2afc33ce/users/741fe562c3414cd994224ce708acddb6/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:59:19.088559 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9a74a-2fb8-4542-b61a-21ce5cbea390 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:19.088891 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9a74a-2fb8-4542-b61a-21ce5cbea390 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:19.089170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9a74a-2fb8-4542-b61a-21ce5cbea390 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:19.090539 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 813/1632] 10.222.0.25 () {54 vars in 912 bytes} [Tue Aug 30 15:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:59:19.091655 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a70f78-6ca7-47da-8b34-ba69982d0963 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:19.092076 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a70f78-6ca7-47da-8b34-ba69982d0963 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:19.092551 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a70f78-6ca7-47da-8b34-ba69982d0963 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:19.093866 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 814/1633] 10.222.0.25 () {54 vars in 912 bytes} [Tue Aug 30 15:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:59:19.097626 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848043b-198b-4b28-b749-f3caae8654f7 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:19.097915 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848043b-198b-4b28-b749-f3caae8654f7 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:19.098190 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848043b-198b-4b28-b749-f3caae8654f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:19.150409 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-b848043b-198b-4b28-b749-f3caae8654f7 None None] MFA Rules not processed for user `741fe562c3414cd994224ce708acddb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:19.152250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-b848043b-198b-4b28-b749-f3caae8654f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:19.184046 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d426a1-7c2d-4b71-b31a-5c33bf163632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:19.185263 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d426a1-7c2d-4b71-b31a-5c33bf163632 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:19.186106 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d426a1-7c2d-4b71-b31a-5c33bf163632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:19.189419 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d426a1-7c2d-4b71-b31a-5c33bf163632 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:19.190276 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d426a1-7c2d-4b71-b31a-5c33bf163632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:19.193292 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d426a1-7c2d-4b71-b31a-5c33bf163632 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:19.214264 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 820/1634] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:19.216766 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdce01d-d6e0-4eff-b433-7279ffeb665c None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:19.217200 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdce01d-d6e0-4eff-b433-7279ffeb665c None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:19.217728 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdce01d-d6e0-4eff-b433-7279ffeb665c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:19.255822 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-5cdce01d-d6e0-4eff-b433-7279ffeb665c None None] MFA Rules not processed for user `ebc80bf891614fb895af33ca1ded6b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:19.257243 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-5cdce01d-d6e0-4eff-b433-7279ffeb665c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:19.278739 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 815/1635] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:19 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:19.283587 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140bcbd8-00df-489c-ba73-37be2389eadb None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:19.283979 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140bcbd8-00df-489c-ba73-37be2389eadb None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:19.284988 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140bcbd8-00df-489c-ba73-37be2389eadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:19.334026 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-140bcbd8-00df-489c-ba73-37be2389eadb None None] MFA Rules not processed for user `ebc80bf891614fb895af33ca1ded6b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:19.338254 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-140bcbd8-00df-489c-ba73-37be2389eadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:19.420176 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:19.453685 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 821/1636] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Aug 30 15:59:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:19.454873 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdce01d-d6e0-4eff-b433-7279ffeb665c None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:19.475401 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdce01d-d6e0-4eff-b433-7279ffeb665c None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:19.491347 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a0ae4-0bd7-4c99-83a5-0bc809cc3b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:19.492600 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a0ae4-0bd7-4c99-83a5-0bc809cc3b58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:19.493166 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a0ae4-0bd7-4c99-83a5-0bc809cc3b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:19.493454 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a0ae4-0bd7-4c99-83a5-0bc809cc3b58 admin admin] PATH_INFO: `/v3/projects/7f73a34d518844f5a7d2547add1ed1f7/users/e44d7ae8124b4017b39a96e74a104371/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:19.495732 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343a0ae4-0bd7-4c99-83a5-0bc809cc3b58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f73a34d518844f5a7d2547add1ed1f7, user_id=e44d7ae8124b4017b39a96e74a104371, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:19.499308 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343a0ae4-0bd7-4c99-83a5-0bc809cc3b58 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:19.510990 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 816/1637] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Aug 30 15:59:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:19.512107 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140bcbd8-00df-489c-ba73-37be2389eadb None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:19.524848 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 822/1638] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:19 2022] PUT /identity/v3/projects/7f73a34d518844f5a7d2547add1ed1f7/users/e44d7ae8124b4017b39a96e74a104371/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:19.524848 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a0ae4-0bd7-4c99-83a5-0bc809cc3b58 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:19.658113 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a0ae4-0bd7-4c99-83a5-0bc809cc3b58 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:19.659978 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140bcbd8-00df-489c-ba73-37be2389eadb None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:19.663655 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f331747-3056-43c5-8cec-9e3aa10cffe2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:19.666818 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f331747-3056-43c5-8cec-9e3aa10cffe2 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:19.667214 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f331747-3056-43c5-8cec-9e3aa10cffe2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:19.667649 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f331747-3056-43c5-8cec-9e3aa10cffe2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:19.674291 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e768fb2-f8dd-4b04-9ab8-f271bc41b2b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:19.674948 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e768fb2-f8dd-4b04-9ab8-f271bc41b2b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:19.675230 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e768fb2-f8dd-4b04-9ab8-f271bc41b2b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:19.675503 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e768fb2-f8dd-4b04-9ab8-f271bc41b2b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:19.705750 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:19.819107 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f331747-3056-43c5-8cec-9e3aa10cffe2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:19.822786 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f331747-3056-43c5-8cec-9e3aa10cffe2 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:19.840952 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e768fb2-f8dd-4b04-9ab8-f271bc41b2b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:19.842645 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e768fb2-f8dd-4b04-9ab8-f271bc41b2b7 service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:19.860070 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 823/1639] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:19.861831 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bdc46-3db8-4256-bc89-3cb5b7208779 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:19.865801 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bdc46-3db8-4256-bc89-3cb5b7208779 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:19.866203 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 817/1640] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:19 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:19.871696 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bdc46-3db8-4256-bc89-3cb5b7208779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:19.948004 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e768fb2-f8dd-4b04-9ab8-f271bc41b2b7 service cinder] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:19.959991 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e768fb2-f8dd-4b04-9ab8-f271bc41b2b7 service cinder] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:19.972845 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f781212-54bc-4805-80bf-f2742249698d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:19.973805 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f781212-54bc-4805-80bf-f2742249698d service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:19.973961 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f781212-54bc-4805-80bf-f2742249698d service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:19.974214 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f781212-54bc-4805-80bf-f2742249698d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:19.980987 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-1b1bdc46-3db8-4256-bc89-3cb5b7208779 None None] MFA Rules not processed for user `e44d7ae8124b4017b39a96e74a104371`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:19.984252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-1b1bdc46-3db8-4256-bc89-3cb5b7208779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:19.998763 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f781212-54bc-4805-80bf-f2742249698d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:20.000373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f781212-54bc-4805-80bf-f2742249698d service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:20.021427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 818/1641] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:20.164254 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 824/1642] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:19 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:20.300252 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f781212-54bc-4805-80bf-f2742249698d service cinder] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:20.316180 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f781212-54bc-4805-80bf-f2742249698d service cinder] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:20.329225 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55afe941-f86e-4c28-a8df-f1b169922f5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:20.330761 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afe941-f86e-4c28-a8df-f1b169922f5f service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:20.330761 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afe941-f86e-4c28-a8df-f1b169922f5f service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:20.330963 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afe941-f86e-4c28-a8df-f1b169922f5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:20.350726 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55afe941-f86e-4c28-a8df-f1b169922f5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:20.364106 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55afe941-f86e-4c28-a8df-f1b169922f5f service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:20.388312 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 819/1643] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:20 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:20.882169 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bdc46-3db8-4256-bc89-3cb5b7208779 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:20.959117 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55afe941-f86e-4c28-a8df-f1b169922f5f service cinder] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:21.002301 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bdc46-3db8-4256-bc89-3cb5b7208779 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:21.022154 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b9895-1cf1-4f55-938b-b5f101a96866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:21.022945 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b9895-1cf1-4f55-938b-b5f101a96866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:21.025732 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b9895-1cf1-4f55-938b-b5f101a96866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:21.026030 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b9895-1cf1-4f55-938b-b5f101a96866 admin admin] PATH_INFO: `/v3/users/2ffc08db0f5b44538b32a781e59bdd10` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:21.035286 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4b9895-1cf1-4f55-938b-b5f101a96866 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ffc08db0f5b44538b32a781e59bdd10)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:21.036362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: WARNING py.warnings [None req-dd4b9895-1cf1-4f55-938b-b5f101a96866 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 15:59:21.036362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: warnings.warn(msg) Aug 30 15:59:21.036362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: Aug 30 15:59:21.037620 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4b9895-1cf1-4f55-938b-b5f101a96866 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:21.142471 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:21.189148 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55afe941-f86e-4c28-a8df-f1b169922f5f service cinder] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:21.223423 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac831dfa-536f-4504-bb33-23a3141a05a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:21.224465 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac831dfa-536f-4504-bb33-23a3141a05a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:21.224988 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac831dfa-536f-4504-bb33-23a3141a05a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:21.225563 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac831dfa-536f-4504-bb33-23a3141a05a9 admin admin] PATH_INFO: `/v3/users/d5e00de41fe34d9fb2aa8d2972700586` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:21.227506 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac831dfa-536f-4504-bb33-23a3141a05a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5e00de41fe34d9fb2aa8d2972700586)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:21.230960 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac831dfa-536f-4504-bb33-23a3141a05a9 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:21.286694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:21.296626 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-dd4b9895-1cf1-4f55-938b-b5f101a96866 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ffc08db0f5b44538b32a781e59bdd10'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:21.298959 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-dd4b9895-1cf1-4f55-938b-b5f101a96866 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ffc08db0f5b44538b32a781e59bdd10'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:21.324108 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-dd4b9895-1cf1-4f55-938b-b5f101a96866 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ffc08db0f5b44538b32a781e59bdd10'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:21.407965 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-dd4b9895-1cf1-4f55-938b-b5f101a96866 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ffc08db0f5b44538b32a781e59bdd10'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:21.410819 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-ac831dfa-536f-4504-bb33-23a3141a05a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5e00de41fe34d9fb2aa8d2972700586'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:21.435868 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-dd4b9895-1cf1-4f55-938b-b5f101a96866 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ffc08db0f5b44538b32a781e59bdd10'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:21.454250 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 825/1644] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 15:59:20 2022] DELETE /identity/v3/users/2ffc08db0f5b44538b32a781e59bdd10 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:21.455533 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-ac831dfa-536f-4504-bb33-23a3141a05a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5e00de41fe34d9fb2aa8d2972700586'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:21.456930 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f5479-5954-406f-876e-0c9d4d7a46e7 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:21.457156 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-ac831dfa-536f-4504-bb33-23a3141a05a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5e00de41fe34d9fb2aa8d2972700586'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:21.457594 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f5479-5954-406f-876e-0c9d4d7a46e7 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:21.457795 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f5479-5954-406f-876e-0c9d4d7a46e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:21.458129 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-ac831dfa-536f-4504-bb33-23a3141a05a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5e00de41fe34d9fb2aa8d2972700586'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:21.490831 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-ac831dfa-536f-4504-bb33-23a3141a05a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5e00de41fe34d9fb2aa8d2972700586'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:21.527846 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 820/1645] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 15:59:20 2022] DELETE /identity/v3/users/d5e00de41fe34d9fb2aa8d2972700586 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:59:21.529413 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e5f50-2d35-4fcf-b384-2c89be221219 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:21.531197 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-343f5479-5954-406f-876e-0c9d4d7a46e7 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:21.532324 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e5f50-2d35-4fcf-b384-2c89be221219 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:21.533779 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-343f5479-5954-406f-876e-0c9d4d7a46e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:21.535689 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e5f50-2d35-4fcf-b384-2c89be221219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:21.614791 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-9d4e5f50-2d35-4fcf-b384-2c89be221219 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:21.618914 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-9d4e5f50-2d35-4fcf-b384-2c89be221219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:21.680339 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 826/1646] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:21.771733 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f5479-5954-406f-876e-0c9d4d7a46e7 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:21.773336 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-343f5479-5954-406f-876e-0c9d4d7a46e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:21.824505 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 821/1647] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:21.943806 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f5479-5954-406f-876e-0c9d4d7a46e7 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:21.947763 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c6165a-8a27-4cf1-abf4-ef8a8ca8341f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:21.948539 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6165a-8a27-4cf1-abf4-ef8a8ca8341f service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:21.948974 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6165a-8a27-4cf1-abf4-ef8a8ca8341f service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:21.949191 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6165a-8a27-4cf1-abf4-ef8a8ca8341f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:21.974170 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c6165a-8a27-4cf1-abf4-ef8a8ca8341f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:21.975651 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c6165a-8a27-4cf1-abf4-ef8a8ca8341f service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:22.001166 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 827/1648] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:22.068153 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e5f50-2d35-4fcf-b384-2c89be221219 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:22.080007 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e5f50-2d35-4fcf-b384-2c89be221219 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:22.095785 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ec3b6-02ce-4518-adfa-8d081cbf55e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:22.100691 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ec3b6-02ce-4518-adfa-8d081cbf55e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:22.102558 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ec3b6-02ce-4518-adfa-8d081cbf55e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:22.102981 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ec3b6-02ce-4518-adfa-8d081cbf55e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:22.130659 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ec3b6-02ce-4518-adfa-8d081cbf55e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:22.144157 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ec3b6-02ce-4518-adfa-8d081cbf55e4 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:22.165699 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 822/1649] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:23.083600 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c6165a-8a27-4cf1-abf4-ef8a8ca8341f service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:23.085485 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-07c6165a-8a27-4cf1-abf4-ef8a8ca8341f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:23.122585 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c6165a-8a27-4cf1-abf4-ef8a8ca8341f service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:23.142246 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0d343-5150-4b56-8e58-703c210428d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:23.146071 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0d343-5150-4b56-8e58-703c210428d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:23.146420 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0d343-5150-4b56-8e58-703c210428d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:23.146749 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0d343-5150-4b56-8e58-703c210428d8 admin admin] PATH_INFO: `/v3/users/db2c0226736f481386c1e764b3eb366b` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:23.149278 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0d343-5150-4b56-8e58-703c210428d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db2c0226736f481386c1e764b3eb366b)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:23.160948 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0d343-5150-4b56-8e58-703c210428d8 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:23.304860 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-cbc0d343-5150-4b56-8e58-703c210428d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db2c0226736f481386c1e764b3eb366b'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:23.306125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-cbc0d343-5150-4b56-8e58-703c210428d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db2c0226736f481386c1e764b3eb366b'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:23.338031 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-cbc0d343-5150-4b56-8e58-703c210428d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db2c0226736f481386c1e764b3eb366b'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:23.345113 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:23.367154 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-cbc0d343-5150-4b56-8e58-703c210428d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db2c0226736f481386c1e764b3eb366b'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:23.384825 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-cbc0d343-5150-4b56-8e58-703c210428d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db2c0226736f481386c1e764b3eb366b'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:23.400554 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 828/1650] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 15:59:23 2022] DELETE /identity/v3/users/db2c0226736f481386c1e764b3eb366b => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:23.404973 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52664e5-8afb-4a4d-a2e9-87e45c3f1a08 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:23.405448 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52664e5-8afb-4a4d-a2e9-87e45c3f1a08 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:23.405672 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52664e5-8afb-4a4d-a2e9-87e45c3f1a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:23.445224 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-c52664e5-8afb-4a4d-a2e9-87e45c3f1a08 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:23.448821 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-c52664e5-8afb-4a4d-a2e9-87e45c3f1a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:23.659713 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:23.683118 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 823/1651] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:23.735742 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0d343-5150-4b56-8e58-703c210428d8 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:23.737477 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-cbc0d343-5150-4b56-8e58-703c210428d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:23.852122 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0d343-5150-4b56-8e58-703c210428d8 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:23.865108 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b6775-b13b-48c0-92b9-cc6e71880bba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:23.866034 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b6775-b13b-48c0-92b9-cc6e71880bba service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:23.866415 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b6775-b13b-48c0-92b9-cc6e71880bba service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:23.866882 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b6775-b13b-48c0-92b9-cc6e71880bba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:23.903022 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b6775-b13b-48c0-92b9-cc6e71880bba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:23.904690 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b6775-b13b-48c0-92b9-cc6e71880bba service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:23.921956 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 829/1652] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:23.983831 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52664e5-8afb-4a4d-a2e9-87e45c3f1a08 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:23.989311 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-c52664e5-8afb-4a4d-a2e9-87e45c3f1a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:24.015631 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52664e5-8afb-4a4d-a2e9-87e45c3f1a08 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:24.034442 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49469361-099e-4600-b189-0ef2b55fa7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:24.036190 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49469361-099e-4600-b189-0ef2b55fa7cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:24.037829 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49469361-099e-4600-b189-0ef2b55fa7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:24.038337 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49469361-099e-4600-b189-0ef2b55fa7cd admin admin] PATH_INFO: `/v3/projects/faee73875d6d48d6a4823f7fe4fe626b` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:24.040775 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49469361-099e-4600-b189-0ef2b55fa7cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=faee73875d6d48d6a4823f7fe4fe626b)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:24.042963 dv-cinder-855058-1-smb devstack@keystone.service[81420]: WARNING py.warnings [None req-49469361-099e-4600-b189-0ef2b55fa7cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 15:59:24.042963 dv-cinder-855058-1-smb devstack@keystone.service[81420]: warnings.warn(msg) Aug 30 15:59:24.042963 dv-cinder-855058-1-smb devstack@keystone.service[81420]: Aug 30 15:59:24.044876 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49469361-099e-4600-b189-0ef2b55fa7cd admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:24.203733 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b6775-b13b-48c0-92b9-cc6e71880bba service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:24.205746 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-f87b6775-b13b-48c0-92b9-cc6e71880bba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:24.233047 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b6775-b13b-48c0-92b9-cc6e71880bba service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:24.251108 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de449867-4ea2-4498-af3b-57cc75b805e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:24.253109 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de449867-4ea2-4498-af3b-57cc75b805e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:24.253276 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de449867-4ea2-4498-af3b-57cc75b805e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:24.253742 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de449867-4ea2-4498-af3b-57cc75b805e7 admin admin] PATH_INFO: `/v3/projects/1a132abc47914b5db6f88f8bb43aa124` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:24.257019 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de449867-4ea2-4498-af3b-57cc75b805e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a132abc47914b5db6f88f8bb43aa124)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:24.262849 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de449867-4ea2-4498-af3b-57cc75b805e7 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:24.332550 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-49469361-099e-4600-b189-0ef2b55fa7cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faee73875d6d48d6a4823f7fe4fe626b', 'request_id': 'req-49469361-099e-4600-b189-0ef2b55fa7cd'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:24.347840 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-49469361-099e-4600-b189-0ef2b55fa7cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faee73875d6d48d6a4823f7fe4fe626b', 'request_id': 'req-49469361-099e-4600-b189-0ef2b55fa7cd'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:24.363822 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-49469361-099e-4600-b189-0ef2b55fa7cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faee73875d6d48d6a4823f7fe4fe626b', 'request_id': 'req-49469361-099e-4600-b189-0ef2b55fa7cd'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:24.409630 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-de449867-4ea2-4498-af3b-57cc75b805e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a132abc47914b5db6f88f8bb43aa124', 'request_id': 'req-de449867-4ea2-4498-af3b-57cc75b805e7'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:24.412459 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-49469361-099e-4600-b189-0ef2b55fa7cd admin admin] The token cache is being invalidate because project faee73875d6d48d6a4823f7fe4fe626b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:59:24.416335 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-49469361-099e-4600-b189-0ef2b55fa7cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:24.429325 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-49469361-099e-4600-b189-0ef2b55fa7cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:24.430123 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-de449867-4ea2-4498-af3b-57cc75b805e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a132abc47914b5db6f88f8bb43aa124', 'request_id': 'req-de449867-4ea2-4498-af3b-57cc75b805e7'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:24.431670 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 824/1653] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 15:59:23 2022] DELETE /identity/v3/projects/faee73875d6d48d6a4823f7fe4fe626b => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:24.435538 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49469361-099e-4600-b189-0ef2b55fa7cd admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:24.440717 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-49469361-099e-4600-b189-0ef2b55fa7cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:24.450381 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-de449867-4ea2-4498-af3b-57cc75b805e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a132abc47914b5db6f88f8bb43aa124', 'request_id': 'req-de449867-4ea2-4498-af3b-57cc75b805e7'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:24.473889 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-de449867-4ea2-4498-af3b-57cc75b805e7 admin admin] The token cache is being invalidate because project 1a132abc47914b5db6f88f8bb43aa124 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:59:24.474192 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-de449867-4ea2-4498-af3b-57cc75b805e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:24.475045 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-de449867-4ea2-4498-af3b-57cc75b805e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:24.480543 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 830/1654] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 15:59:24 2022] DELETE /identity/v3/projects/1a132abc47914b5db6f88f8bb43aa124 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:59:24.482225 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc218d8d-630e-4b65-b485-929717d3b4ad None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:24.482576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc218d8d-630e-4b65-b485-929717d3b4ad None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:24.482961 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc218d8d-630e-4b65-b485-929717d3b4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:24.535469 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-cc218d8d-630e-4b65-b485-929717d3b4ad None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:24.537776 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-cc218d8d-630e-4b65-b485-929717d3b4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:24.628468 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49469361-099e-4600-b189-0ef2b55fa7cd admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:24.698280 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 831/1655] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:24.699876 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7cf5d-5635-4a0c-8318-4dabe00a58b1 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:24.701687 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7cf5d-5635-4a0c-8318-4dabe00a58b1 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:24.703042 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7cf5d-5635-4a0c-8318-4dabe00a58b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:24.717229 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:24.745422 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-deb7cf5d-5635-4a0c-8318-4dabe00a58b1 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:24.752137 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-deb7cf5d-5635-4a0c-8318-4dabe00a58b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:24.788858 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 832/1656] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:24.788858 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7cf5d-5635-4a0c-8318-4dabe00a58b1 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:24.812137 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7cf5d-5635-4a0c-8318-4dabe00a58b1 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:24.838122 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0637c-aa2d-4eb2-a992-9b38a70f8672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:24.838426 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b846bf-ad47-46f3-8858-81e7a68debd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:24.838777 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0637c-aa2d-4eb2-a992-9b38a70f8672 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:24.839061 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0637c-aa2d-4eb2-a992-9b38a70f8672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:24.839337 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0637c-aa2d-4eb2-a992-9b38a70f8672 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:24.839836 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b846bf-ad47-46f3-8858-81e7a68debd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:24.839994 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0637c-aa2d-4eb2-a992-9b38a70f8672 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:59:24.840300 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0637c-aa2d-4eb2-a992-9b38a70f8672 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:24.840628 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b846bf-ad47-46f3-8858-81e7a68debd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:24.841109 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b846bf-ad47-46f3-8858-81e7a68debd9 admin admin] PATH_INFO: `/v3/users/741fe562c3414cd994224ce708acddb6` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:24.841938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0637c-aa2d-4eb2-a992-9b38a70f8672 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:24.845221 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b846bf-ad47-46f3-8858-81e7a68debd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=741fe562c3414cd994224ce708acddb6)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:24.850182 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b846bf-ad47-46f3-8858-81e7a68debd9 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:24.885587 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 833/1657] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 15:59:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:59:24.886499 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0637c-aa2d-4eb2-a992-9b38a70f8672 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:24.926005 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0637c-aa2d-4eb2-a992-9b38a70f8672 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:24.941769 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:24.942034 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f23113-eafa-4dcb-b76a-6255edcc68dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:24.942689 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f23113-eafa-4dcb-b76a-6255edcc68dd admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:24.945169 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f23113-eafa-4dcb-b76a-6255edcc68dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:24.945474 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f23113-eafa-4dcb-b76a-6255edcc68dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:24.946153 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f23113-eafa-4dcb-b76a-6255edcc68dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:24.955699 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f23113-eafa-4dcb-b76a-6255edcc68dd admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:24.970148 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-e1b846bf-ad47-46f3-8858-81e7a68debd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '741fe562c3414cd994224ce708acddb6'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:25.030620 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-e1b846bf-ad47-46f3-8858-81e7a68debd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '741fe562c3414cd994224ce708acddb6'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:25.037686 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-e1b846bf-ad47-46f3-8858-81e7a68debd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '741fe562c3414cd994224ce708acddb6'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:25.039111 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-e1b846bf-ad47-46f3-8858-81e7a68debd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '741fe562c3414cd994224ce708acddb6'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:25.051989 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 834/1658] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 15:59:24 2022] POST /identity/v3/projects => generated 387 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:25.056483 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-e1b846bf-ad47-46f3-8858-81e7a68debd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '741fe562c3414cd994224ce708acddb6'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:25.058112 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f23113-eafa-4dcb-b76a-6255edcc68dd admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:25.064480 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-f7f23113-eafa-4dcb-b76a-6255edcc68dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:25.085492 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 825/1659] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 15:59:24 2022] DELETE /identity/v3/users/741fe562c3414cd994224ce708acddb6 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:25.096666 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b846bf-ad47-46f3-8858-81e7a68debd9 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:25.098337 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-e1b846bf-ad47-46f3-8858-81e7a68debd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:25.260881 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f23113-eafa-4dcb-b76a-6255edcc68dd admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:25.281299 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b846bf-ad47-46f3-8858-81e7a68debd9 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:25.291582 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182466ba-9cc8-4153-a1c3-64e1eb924e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:25.292747 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182466ba-9cc8-4153-a1c3-64e1eb924e05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:25.293340 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182466ba-9cc8-4153-a1c3-64e1eb924e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:25.293775 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182466ba-9cc8-4153-a1c3-64e1eb924e05 admin admin] PATH_INFO: `/v3/projects/9569c92cbd724361ae13bc0e385b17d5` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:25.295393 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182466ba-9cc8-4153-a1c3-64e1eb924e05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9569c92cbd724361ae13bc0e385b17d5)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:25.299175 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182466ba-9cc8-4153-a1c3-64e1eb924e05 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:25.369134 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733720c-1547-43ec-81c1-b93c271b65ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:25.370909 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733720c-1547-43ec-81c1-b93c271b65ba admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:25.371331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733720c-1547-43ec-81c1-b93c271b65ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:25.371738 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733720c-1547-43ec-81c1-b93c271b65ba admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:25.372574 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733720c-1547-43ec-81c1-b93c271b65ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:25.374959 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733720c-1547-43ec-81c1-b93c271b65ba admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:25.392098 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-182466ba-9cc8-4153-a1c3-64e1eb924e05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9569c92cbd724361ae13bc0e385b17d5', 'request_id': 'req-182466ba-9cc8-4153-a1c3-64e1eb924e05'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:25.399582 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-182466ba-9cc8-4153-a1c3-64e1eb924e05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9569c92cbd724361ae13bc0e385b17d5', 'request_id': 'req-182466ba-9cc8-4153-a1c3-64e1eb924e05'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:25.410106 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 835/1660] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:59:25 2022] POST /identity/v3/users => generated 294 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:25.415939 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733720c-1547-43ec-81c1-b93c271b65ba admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:25.417470 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-182466ba-9cc8-4153-a1c3-64e1eb924e05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9569c92cbd724361ae13bc0e385b17d5', 'request_id': 'req-182466ba-9cc8-4153-a1c3-64e1eb924e05'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:25.462928 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733720c-1547-43ec-81c1-b93c271b65ba admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:25.464469 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-182466ba-9cc8-4153-a1c3-64e1eb924e05 admin admin] The token cache is being invalidate because project 9569c92cbd724361ae13bc0e385b17d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:59:25.464766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-182466ba-9cc8-4153-a1c3-64e1eb924e05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:25.465930 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-182466ba-9cc8-4153-a1c3-64e1eb924e05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:25.468015 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 826/1661] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 15:59:25 2022] DELETE /identity/v3/projects/9569c92cbd724361ae13bc0e385b17d5 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:25.474111 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9f557-82c9-47f1-add0-c43f1189d3c0 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:25.474400 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9f557-82c9-47f1-add0-c43f1189d3c0 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:25.474678 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9f557-82c9-47f1-add0-c43f1189d3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:25.547701 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-e4c9f557-82c9-47f1-add0-c43f1189d3c0 None None] MFA Rules not processed for user `07922cc9c51e434db741e966a34f767c`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:25.548847 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-e4c9f557-82c9-47f1-add0-c43f1189d3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:25.594526 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:25.602107 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e399e6-15b7-4dc1-ab5a-0a8eeea6609f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:25.602902 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e399e6-15b7-4dc1-ab5a-0a8eeea6609f admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:25.603620 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e399e6-15b7-4dc1-ab5a-0a8eeea6609f admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:25.608594 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e399e6-15b7-4dc1-ab5a-0a8eeea6609f admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:25.611431 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e399e6-15b7-4dc1-ab5a-0a8eeea6609f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:25.613595 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e399e6-15b7-4dc1-ab5a-0a8eeea6609f admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:25.617624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:25.641635 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 836/1662] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:25 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:25.642587 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e399e6-15b7-4dc1-ab5a-0a8eeea6609f admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:25.644978 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-d6e399e6-15b7-4dc1-ab5a-0a8eeea6609f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:25.661313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e399e6-15b7-4dc1-ab5a-0a8eeea6609f admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:25.682375 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5be01f-2595-4316-9807-836690b2a8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:25.683624 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5be01f-2595-4316-9807-836690b2a8fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:25.684109 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5be01f-2595-4316-9807-836690b2a8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:25.684553 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5be01f-2595-4316-9807-836690b2a8fb admin admin] PATH_INFO: `/v3/users/e44d7ae8124b4017b39a96e74a104371` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:25.685987 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5be01f-2595-4316-9807-836690b2a8fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e44d7ae8124b4017b39a96e74a104371)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:25.689580 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5be01f-2595-4316-9807-836690b2a8fb admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:25.741319 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 827/1663] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:25.749138 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c9f557-82c9-47f1-add0-c43f1189d3c0 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:25.749138 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-e4c9f557-82c9-47f1-add0-c43f1189d3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:25.773822 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-1d5be01f-2595-4316-9807-836690b2a8fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e44d7ae8124b4017b39a96e74a104371'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:25.774527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-1d5be01f-2595-4316-9807-836690b2a8fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e44d7ae8124b4017b39a96e74a104371'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:25.784043 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c9f557-82c9-47f1-add0-c43f1189d3c0 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:25.788027 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-1d5be01f-2595-4316-9807-836690b2a8fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e44d7ae8124b4017b39a96e74a104371'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:25.789437 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18673d43-4a76-4e50-acc3-819325b36e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:25.790161 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18673d43-4a76-4e50-acc3-819325b36e05 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:25.790457 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18673d43-4a76-4e50-acc3-819325b36e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:25.790761 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18673d43-4a76-4e50-acc3-819325b36e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:25.791424 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18673d43-4a76-4e50-acc3-819325b36e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:25.793083 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18673d43-4a76-4e50-acc3-819325b36e05 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:25.806952 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-1d5be01f-2595-4316-9807-836690b2a8fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e44d7ae8124b4017b39a96e74a104371'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:25.817861 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-1d5be01f-2595-4316-9807-836690b2a8fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e44d7ae8124b4017b39a96e74a104371'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:25.818786 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 828/1664] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:25 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:25.823891 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424cba3-69a3-47b7-b9f5-82ffff1e42a9 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:25.824184 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424cba3-69a3-47b7-b9f5-82ffff1e42a9 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:25.824460 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424cba3-69a3-47b7-b9f5-82ffff1e42a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:25.825106 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 837/1665] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 15:59:25 2022] DELETE /identity/v3/users/e44d7ae8124b4017b39a96e74a104371 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:25.825914 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5be01f-2595-4316-9807-836690b2a8fb admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:25.827316 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-1d5be01f-2595-4316-9807-836690b2a8fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:25.869871 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-1424cba3-69a3-47b7-b9f5-82ffff1e42a9 None None] MFA Rules not processed for user `07922cc9c51e434db741e966a34f767c`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:25.871230 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-1424cba3-69a3-47b7-b9f5-82ffff1e42a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:25.979739 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5be01f-2595-4316-9807-836690b2a8fb admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:25.991029 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad8b35-e046-4246-af80-064f273c5104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:25.991721 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad8b35-e046-4246-af80-064f273c5104 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:25.992325 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad8b35-e046-4246-af80-064f273c5104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:25.993784 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad8b35-e046-4246-af80-064f273c5104 admin admin] PATH_INFO: `/v3/projects/124565d89d5245e58f8c4d36ff520eb9/users/32010b30fca04e6eaedd65da7304fe93/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:26.008735 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 829/1666] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:26.023449 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424cba3-69a3-47b7-b9f5-82ffff1e42a9 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:26.026167 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-1424cba3-69a3-47b7-b9f5-82ffff1e42a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:26.031737 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad8b35-e046-4246-af80-064f273c5104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=124565d89d5245e58f8c4d36ff520eb9, user_id=32010b30fca04e6eaedd65da7304fe93, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:26.036270 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad8b35-e046-4246-af80-064f273c5104 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:26.070639 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 838/1667] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:25 2022] PUT /identity/v3/projects/124565d89d5245e58f8c4d36ff520eb9/users/32010b30fca04e6eaedd65da7304fe93/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:26.087678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e35d69-d362-4356-94b6-fc9b391fa1f5 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:26.089338 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e35d69-d362-4356-94b6-fc9b391fa1f5 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:26.089796 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e35d69-d362-4356-94b6-fc9b391fa1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:26.138574 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-38e35d69-d362-4356-94b6-fc9b391fa1f5 None None] MFA Rules not processed for user `32010b30fca04e6eaedd65da7304fe93`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:26.140378 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-38e35d69-d362-4356-94b6-fc9b391fa1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:26.226389 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424cba3-69a3-47b7-b9f5-82ffff1e42a9 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:26.273130 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:26.380649 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:26.404175 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30985b49-6bf5-475d-ac2a-266e80883aa7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:26.405104 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30985b49-6bf5-475d-ac2a-266e80883aa7 service nova] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:26.405325 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30985b49-6bf5-475d-ac2a-266e80883aa7 service nova] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:26.406439 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30985b49-6bf5-475d-ac2a-266e80883aa7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:26.411751 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-30985b49-6bf5-475d-ac2a-266e80883aa7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:26.426905 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 839/1668] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:26.427788 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e35d69-d362-4356-94b6-fc9b391fa1f5 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:26.637189 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e35d69-d362-4356-94b6-fc9b391fa1f5 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:26.653724 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30985b49-6bf5-475d-ac2a-266e80883aa7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:26.656009 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30985b49-6bf5-475d-ac2a-266e80883aa7 service nova] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:26.659458 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b698091-179b-46e1-9533-bc0e6664592b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:26.660189 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b698091-179b-46e1-9533-bc0e6664592b admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:26.660540 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b698091-179b-46e1-9533-bc0e6664592b admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:26.660935 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b698091-179b-46e1-9533-bc0e6664592b admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:26.661816 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b698091-179b-46e1-9533-bc0e6664592b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:26.663825 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b698091-179b-46e1-9533-bc0e6664592b admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:26.681023 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 830/1669] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:26 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 658 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:26.772686 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30985b49-6bf5-475d-ac2a-266e80883aa7 service nova] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:26.772928 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 840/1670] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 15:59:26 2022] POST /identity/v3/projects => generated 385 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:26.787168 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30985b49-6bf5-475d-ac2a-266e80883aa7 service nova] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:26.908395 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1191e67-33a7-40ea-bfac-c39ebef67c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:26.910794 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1191e67-33a7-40ea-bfac-c39ebef67c71 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:26.911290 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1191e67-33a7-40ea-bfac-c39ebef67c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:26.914013 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1191e67-33a7-40ea-bfac-c39ebef67c71 admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:26.930154 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1191e67-33a7-40ea-bfac-c39ebef67c71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:26.936310 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1191e67-33a7-40ea-bfac-c39ebef67c71 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:26.971305 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b698091-179b-46e1-9533-bc0e6664592b admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:26.973652 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-9b698091-179b-46e1-9533-bc0e6664592b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:27.013275 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b698091-179b-46e1-9533-bc0e6664592b admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:27.031369 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 831/1671] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:59:26 2022] POST /identity/v3/users => generated 299 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:27.035719 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1191e67-33a7-40ea-bfac-c39ebef67c71 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:27.058908 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec826e8-237c-4f21-8833-9cc44e34d29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:27.059593 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec826e8-237c-4f21-8833-9cc44e34d29b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:27.059876 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec826e8-237c-4f21-8833-9cc44e34d29b admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:27.060155 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec826e8-237c-4f21-8833-9cc44e34d29b admin admin] PATH_INFO: `/v3/projects/d6b71ee250274131b56629ab2afc33ce` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:27.063523 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec826e8-237c-4f21-8833-9cc44e34d29b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6b71ee250274131b56629ab2afc33ce)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:27.065602 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec826e8-237c-4f21-8833-9cc44e34d29b admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:27.071299 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1191e67-33a7-40ea-bfac-c39ebef67c71 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:27.084763 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ef250-7a75-4bdf-ac91-b78553f5c622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:27.084763 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ef250-7a75-4bdf-ac91-b78553f5c622 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:27.084763 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ef250-7a75-4bdf-ac91-b78553f5c622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:27.084763 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ef250-7a75-4bdf-ac91-b78553f5c622 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:27.086075 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46ef250-7a75-4bdf-ac91-b78553f5c622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:27.093465 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46ef250-7a75-4bdf-ac91-b78553f5c622 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:27.146369 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 832/1672] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:27.149783 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ef250-7a75-4bdf-ac91-b78553f5c622 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:27.155393 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-c46ef250-7a75-4bdf-ac91-b78553f5c622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:27.194555 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ef250-7a75-4bdf-ac91-b78553f5c622 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:27.209881 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aacbaa-e91f-40ee-94d2-ad8790755d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:27.210912 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aacbaa-e91f-40ee-94d2-ad8790755d6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:27.211330 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aacbaa-e91f-40ee-94d2-ad8790755d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:27.211701 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aacbaa-e91f-40ee-94d2-ad8790755d6f admin admin] PATH_INFO: `/v3/users/dfefb218af92485aa807a9669cfb9067` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:27.215615 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aacbaa-e91f-40ee-94d2-ad8790755d6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfefb218af92485aa807a9669cfb9067)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:27.220580 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aacbaa-e91f-40ee-94d2-ad8790755d6f admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:27.246283 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-bec826e8-237c-4f21-8833-9cc44e34d29b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6b71ee250274131b56629ab2afc33ce', 'request_id': 'req-bec826e8-237c-4f21-8833-9cc44e34d29b'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:27.269450 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-bec826e8-237c-4f21-8833-9cc44e34d29b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6b71ee250274131b56629ab2afc33ce', 'request_id': 'req-bec826e8-237c-4f21-8833-9cc44e34d29b'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:27.278034 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-bec826e8-237c-4f21-8833-9cc44e34d29b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6b71ee250274131b56629ab2afc33ce', 'request_id': 'req-bec826e8-237c-4f21-8833-9cc44e34d29b'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:27.295871 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-bec826e8-237c-4f21-8833-9cc44e34d29b admin admin] The token cache is being invalidate because project d6b71ee250274131b56629ab2afc33ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:59:27.296426 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-bec826e8-237c-4f21-8833-9cc44e34d29b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:27.297380 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-bec826e8-237c-4f21-8833-9cc44e34d29b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:27.305731 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 841/1673] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 15:59:26 2022] DELETE /identity/v3/projects/d6b71ee250274131b56629ab2afc33ce => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:27.307084 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec826e8-237c-4f21-8833-9cc44e34d29b admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:27.309516 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-bec826e8-237c-4f21-8833-9cc44e34d29b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:27.346451 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-48aacbaa-e91f-40ee-94d2-ad8790755d6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfefb218af92485aa807a9669cfb9067'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:27.381385 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-48aacbaa-e91f-40ee-94d2-ad8790755d6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfefb218af92485aa807a9669cfb9067'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:27.385368 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-48aacbaa-e91f-40ee-94d2-ad8790755d6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfefb218af92485aa807a9669cfb9067'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:27.386249 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-48aacbaa-e91f-40ee-94d2-ad8790755d6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfefb218af92485aa807a9669cfb9067'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:27.393379 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:27.403225 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-48aacbaa-e91f-40ee-94d2-ad8790755d6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfefb218af92485aa807a9669cfb9067'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:27.428500 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 833/1674] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 15:59:27 2022] DELETE /identity/v3/users/dfefb218af92485aa807a9669cfb9067 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:27.432202 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432561e-f2d0-4664-9e58-ce99837999ce None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:27.432521 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432561e-f2d0-4664-9e58-ce99837999ce None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:27.432818 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432561e-f2d0-4664-9e58-ce99837999ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:27.457929 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:27.483316 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-a432561e-f2d0-4664-9e58-ce99837999ce None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:27.484732 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-a432561e-f2d0-4664-9e58-ce99837999ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:27.493098 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec826e8-237c-4f21-8833-9cc44e34d29b admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:27.652760 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003dae4-2ab2-4922-9761-ba5b7d764c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:27.653475 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003dae4-2ab2-4922-9761-ba5b7d764c84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:27.653760 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003dae4-2ab2-4922-9761-ba5b7d764c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:27.654033 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003dae4-2ab2-4922-9761-ba5b7d764c84 admin admin] PATH_INFO: `/v3/projects/e3d4d31841e14f2b969004346645cd7c/users/3ff7f4bd11904a5ab2cae9cdfb6eeb04/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:27.659136 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 834/1675] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:27.662823 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11975194-5ad9-44a0-8af6-b2bd6bf4caab None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:27.663308 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11975194-5ad9-44a0-8af6-b2bd6bf4caab None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:27.664482 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11975194-5ad9-44a0-8af6-b2bd6bf4caab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:27.695262 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1003dae4-2ab2-4922-9761-ba5b7d764c84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3d4d31841e14f2b969004346645cd7c, user_id=3ff7f4bd11904a5ab2cae9cdfb6eeb04, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:27.701503 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1003dae4-2ab2-4922-9761-ba5b7d764c84 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:27.706673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-11975194-5ad9-44a0-8af6-b2bd6bf4caab None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:27.708853 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-11975194-5ad9-44a0-8af6-b2bd6bf4caab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:27.724564 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 842/1676] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:27 2022] PUT /identity/v3/projects/e3d4d31841e14f2b969004346645cd7c/users/3ff7f4bd11904a5ab2cae9cdfb6eeb04/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:27.730171 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d105051-efb6-4cc1-8445-d0862ccaf425 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:27.730874 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d105051-efb6-4cc1-8445-d0862ccaf425 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:27.732468 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 835/1677] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:27.732943 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d105051-efb6-4cc1-8445-d0862ccaf425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:27.734142 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11975194-5ad9-44a0-8af6-b2bd6bf4caab None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:27.737808 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-11975194-5ad9-44a0-8af6-b2bd6bf4caab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:27.766777 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11975194-5ad9-44a0-8af6-b2bd6bf4caab None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:27.784895 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-3d105051-efb6-4cc1-8445-d0862ccaf425 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:27.786177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-3d105051-efb6-4cc1-8445-d0862ccaf425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:27.919171 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17edef0a-5be2-4285-b347-f0bdeac5f578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:27.919815 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17edef0a-5be2-4285-b347-f0bdeac5f578 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:27.925175 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17edef0a-5be2-4285-b347-f0bdeac5f578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:27.930844 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17edef0a-5be2-4285-b347-f0bdeac5f578 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:27.931971 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17edef0a-5be2-4285-b347-f0bdeac5f578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:27.934487 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17edef0a-5be2-4285-b347-f0bdeac5f578 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:27.940655 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 843/1678] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:27.941783 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d105051-efb6-4cc1-8445-d0862ccaf425 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:27.946445 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-3d105051-efb6-4cc1-8445-d0862ccaf425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:27.966674 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 836/1679] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:27.967968 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17edef0a-5be2-4285-b347-f0bdeac5f578 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:27.973243 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-17edef0a-5be2-4285-b347-f0bdeac5f578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:28.000518 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17edef0a-5be2-4285-b347-f0bdeac5f578 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:28.016609 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3126a-b80a-4095-8467-b945aa24ef91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:28.019077 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3126a-b80a-4095-8467-b945aa24ef91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:28.019077 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3126a-b80a-4095-8467-b945aa24ef91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:28.021850 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3126a-b80a-4095-8467-b945aa24ef91 admin admin] PATH_INFO: `/v3/projects/7f73a34d518844f5a7d2547add1ed1f7` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:28.025731 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b3126a-b80a-4095-8467-b945aa24ef91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f73a34d518844f5a7d2547add1ed1f7)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:28.042729 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b3126a-b80a-4095-8467-b945aa24ef91 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:28.099159 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d105051-efb6-4cc1-8445-d0862ccaf425 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:28.112863 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb4fb2-20e0-4d44-a2d8-42efd46745fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:28.115923 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb4fb2-20e0-4d44-a2d8-42efd46745fb service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:28.116529 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb4fb2-20e0-4d44-a2d8-42efd46745fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:28.117478 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb4fb2-20e0-4d44-a2d8-42efd46745fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:28.146726 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbb4fb2-20e0-4d44-a2d8-42efd46745fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:28.156153 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbb4fb2-20e0-4d44-a2d8-42efd46745fb service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:28.179793 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-98b3126a-b80a-4095-8467-b945aa24ef91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f73a34d518844f5a7d2547add1ed1f7', 'request_id': 'req-98b3126a-b80a-4095-8467-b945aa24ef91'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:28.180952 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 844/1680] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:28.181906 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb4fb2-20e0-4d44-a2d8-42efd46745fb service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:28.198159 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-98b3126a-b80a-4095-8467-b945aa24ef91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f73a34d518844f5a7d2547add1ed1f7', 'request_id': 'req-98b3126a-b80a-4095-8467-b945aa24ef91'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:28.212925 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb4fb2-20e0-4d44-a2d8-42efd46745fb service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:28.214791 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-98b3126a-b80a-4095-8467-b945aa24ef91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f73a34d518844f5a7d2547add1ed1f7', 'request_id': 'req-98b3126a-b80a-4095-8467-b945aa24ef91'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:28.229969 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:28.239613 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-98b3126a-b80a-4095-8467-b945aa24ef91 admin admin] The token cache is being invalidate because project 7f73a34d518844f5a7d2547add1ed1f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:59:28.239981 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-98b3126a-b80a-4095-8467-b945aa24ef91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:28.244208 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-98b3126a-b80a-4095-8467-b945aa24ef91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:28.246381 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:28.251119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 837/1681] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 15:59:27 2022] DELETE /identity/v3/projects/7f73a34d518844f5a7d2547add1ed1f7 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:28.256725 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3126a-b80a-4095-8467-b945aa24ef91 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:28.263363 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-98b3126a-b80a-4095-8467-b945aa24ef91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:28.414502 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7e1b4-de4e-48ef-bf86-27f1bac635b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:28.415346 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7e1b4-de4e-48ef-bf86-27f1bac635b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:28.415781 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7e1b4-de4e-48ef-bf86-27f1bac635b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:28.416315 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7e1b4-de4e-48ef-bf86-27f1bac635b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:28.417278 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b7e1b4-de4e-48ef-bf86-27f1bac635b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:59:28.417786 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b7e1b4-de4e-48ef-bf86-27f1bac635b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:28.419649 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b7e1b4-de4e-48ef-bf86-27f1bac635b5 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:28.424222 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3126a-b80a-4095-8467-b945aa24ef91 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:28.432304 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c5d23-978d-4527-83ab-d6d4a30b2804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:28.433311 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c5d23-978d-4527-83ab-d6d4a30b2804 admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:28.433775 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c5d23-978d-4527-83ab-d6d4a30b2804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:28.434220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c5d23-978d-4527-83ab-d6d4a30b2804 admin admin] PATH_INFO: `/v3/projects/e3d4d31841e14f2b969004346645cd7c/users/3ff7f4bd11904a5ab2cae9cdfb6eeb04/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:28.436705 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c5d23-978d-4527-83ab-d6d4a30b2804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3d4d31841e14f2b969004346645cd7c, user_id=3ff7f4bd11904a5ab2cae9cdfb6eeb04, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:28.442898 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c5d23-978d-4527-83ab-d6d4a30b2804 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:28.465938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 845/1682] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 15:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:59:28.470431 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30e5de-5bbe-4284-b6f7-19e87771b267 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:28.488630 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 838/1683] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:28 2022] PUT /identity/v3/projects/e3d4d31841e14f2b969004346645cd7c/users/3ff7f4bd11904a5ab2cae9cdfb6eeb04/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:28.488630 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2e95d-6254-4740-ad79-a9a353325559 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:28.488630 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2e95d-6254-4740-ad79-a9a353325559 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:28.488630 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2e95d-6254-4740-ad79-a9a353325559 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:28.490759 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 839/1684] 10.222.0.25 () {54 vars in 912 bytes} [Tue Aug 30 15:59:28 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:59:28.491709 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2e95d-6254-4740-ad79-a9a353325559 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:28.493223 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30e5de-5bbe-4284-b6f7-19e87771b267 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:28.493663 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-15b2e95d-6254-4740-ad79-a9a353325559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:28.495403 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30e5de-5bbe-4284-b6f7-19e87771b267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:28.573268 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-4c30e5de-5bbe-4284-b6f7-19e87771b267 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:28.576112 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-4c30e5de-5bbe-4284-b6f7-19e87771b267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:28.762512 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2e95d-6254-4740-ad79-a9a353325559 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:28.774920 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4a77f-71dd-4f1e-b3d7-15c36cdaf878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:28.776494 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4a77f-71dd-4f1e-b3d7-15c36cdaf878 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:28.778061 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4a77f-71dd-4f1e-b3d7-15c36cdaf878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:28.788618 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4a77f-71dd-4f1e-b3d7-15c36cdaf878 admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:28.788618 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a4a77f-71dd-4f1e-b3d7-15c36cdaf878 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:28.791562 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 846/1685] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:28.794061 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053f366-1953-4684-b35e-1c545fbe1950 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:28.794710 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053f366-1953-4684-b35e-1c545fbe1950 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:28.794886 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a4a77f-71dd-4f1e-b3d7-15c36cdaf878 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:28.795349 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053f366-1953-4684-b35e-1c545fbe1950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:28.871535 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-6053f366-1953-4684-b35e-1c545fbe1950 None None] MFA Rules not processed for user `3ff7f4bd11904a5ab2cae9cdfb6eeb04`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:28.876653 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 840/1686] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 15:59:28 2022] POST /identity/v3/projects => generated 405 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:28.877237 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-6053f366-1953-4684-b35e-1c545fbe1950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:28.878444 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf249439-ff1c-4e09-9e43-f4efd151036c None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:28.880590 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf249439-ff1c-4e09-9e43-f4efd151036c None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:28.881060 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf249439-ff1c-4e09-9e43-f4efd151036c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:28.974049 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-cf249439-ff1c-4e09-9e43-f4efd151036c None None] MFA Rules not processed for user `48c49f6751d14526a0954797d9ab6a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:28.975837 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-cf249439-ff1c-4e09-9e43-f4efd151036c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:29.069450 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 847/1687] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:28 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:29.071015 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04118fb3-89c0-46ed-8c59-6ea906af7283 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:29.073578 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04118fb3-89c0-46ed-8c59-6ea906af7283 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:29.073578 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04118fb3-89c0-46ed-8c59-6ea906af7283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:29.131750 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-04118fb3-89c0-46ed-8c59-6ea906af7283 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:29.133055 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-04118fb3-89c0-46ed-8c59-6ea906af7283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:29.146857 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 841/1688] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Aug 30 15:59:28 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:29.148244 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf249439-ff1c-4e09-9e43-f4efd151036c None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:29.199544 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:29.204905 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:29.268341 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 848/1689] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:29.269434 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04118fb3-89c0-46ed-8c59-6ea906af7283 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:29.272428 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-04118fb3-89c0-46ed-8c59-6ea906af7283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:29.320070 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf249439-ff1c-4e09-9e43-f4efd151036c None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:29.338357 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f71f6-fd66-4ee0-b382-15a4aebf9cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:29.345472 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f71f6-fd66-4ee0-b382-15a4aebf9cfd admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:29.346015 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f71f6-fd66-4ee0-b382-15a4aebf9cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:29.346015 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f71f6-fd66-4ee0-b382-15a4aebf9cfd admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:29.346660 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f71f6-fd66-4ee0-b382-15a4aebf9cfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:29.348640 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f71f6-fd66-4ee0-b382-15a4aebf9cfd admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:29.394740 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04118fb3-89c0-46ed-8c59-6ea906af7283 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:29.402419 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd6860-a71b-4740-9fef-56f12d1aabe8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:29.403132 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd6860-a71b-4740-9fef-56f12d1aabe8 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:29.403335 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd6860-a71b-4740-9fef-56f12d1aabe8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:29.403654 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd6860-a71b-4740-9fef-56f12d1aabe8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:29.420283 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 842/1690] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:59:29 2022] POST /identity/v3/users => generated 303 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:29.421221 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f71f6-fd66-4ee0-b382-15a4aebf9cfd admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:29.425647 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd6860-a71b-4740-9fef-56f12d1aabe8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:29.428817 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-8a6f71f6-fd66-4ee0-b382-15a4aebf9cfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:29.430351 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd6860-a71b-4740-9fef-56f12d1aabe8 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:29.457924 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 849/1691] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:29 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:29.459155 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd6860-a71b-4740-9fef-56f12d1aabe8 service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:29.461304 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f71f6-fd66-4ee0-b382-15a4aebf9cfd admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:29.483417 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d7874-cfb4-4b56-af35-05fc04a06c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:29.485871 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d7874-cfb4-4b56-af35-05fc04a06c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:29.486557 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d7874-cfb4-4b56-af35-05fc04a06c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:29.486961 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d7874-cfb4-4b56-af35-05fc04a06c5c admin admin] PATH_INFO: `/v3/projects/de070d75ab054703af6a2efc6be8a773` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:29.489527 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d7874-cfb4-4b56-af35-05fc04a06c5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=de070d75ab054703af6a2efc6be8a773)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:29.491845 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd6860-a71b-4740-9fef-56f12d1aabe8 service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:29.502063 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d7874-cfb4-4b56-af35-05fc04a06c5c admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:29.510840 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70ba7b-f387-4328-8f1f-6e6da2056f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:29.511827 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70ba7b-f387-4328-8f1f-6e6da2056f4c admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:29.511827 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70ba7b-f387-4328-8f1f-6e6da2056f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:29.512089 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70ba7b-f387-4328-8f1f-6e6da2056f4c admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:29.512641 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70ba7b-f387-4328-8f1f-6e6da2056f4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:59:29.512967 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70ba7b-f387-4328-8f1f-6e6da2056f4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:29.534608 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70ba7b-f387-4328-8f1f-6e6da2056f4c admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:29.585114 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 850/1692] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 15:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:59:29.592415 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70ba7b-f387-4328-8f1f-6e6da2056f4c admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:29.599309 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-4e70ba7b-f387-4328-8f1f-6e6da2056f4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:29.626176 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70ba7b-f387-4328-8f1f-6e6da2056f4c admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:29.632696 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-671d7874-cfb4-4b56-af35-05fc04a06c5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de070d75ab054703af6a2efc6be8a773', 'request_id': 'req-671d7874-cfb4-4b56-af35-05fc04a06c5c'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:29.646702 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-671d7874-cfb4-4b56-af35-05fc04a06c5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de070d75ab054703af6a2efc6be8a773', 'request_id': 'req-671d7874-cfb4-4b56-af35-05fc04a06c5c'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:29.672724 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-671d7874-cfb4-4b56-af35-05fc04a06c5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de070d75ab054703af6a2efc6be8a773', 'request_id': 'req-671d7874-cfb4-4b56-af35-05fc04a06c5c'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:29.723080 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-671d7874-cfb4-4b56-af35-05fc04a06c5c admin admin] The token cache is being invalidate because project de070d75ab054703af6a2efc6be8a773 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:59:29.726103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-671d7874-cfb4-4b56-af35-05fc04a06c5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:29.727522 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-671d7874-cfb4-4b56-af35-05fc04a06c5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:29.737351 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 843/1693] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 15:59:29 2022] DELETE /identity/v3/projects/de070d75ab054703af6a2efc6be8a773 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:29.738393 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d7874-cfb4-4b56-af35-05fc04a06c5c admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:29.740814 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-671d7874-cfb4-4b56-af35-05fc04a06c5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:29.814381 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d99041-baae-4f58-a4a3-45990cfea667 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:29.815027 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d99041-baae-4f58-a4a3-45990cfea667 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:29.815314 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d99041-baae-4f58-a4a3-45990cfea667 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:29.815590 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d99041-baae-4f58-a4a3-45990cfea667 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:29.819334 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-58d99041-baae-4f58-a4a3-45990cfea667 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:29.854954 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d99041-baae-4f58-a4a3-45990cfea667 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:29.855551 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d99041-baae-4f58-a4a3-45990cfea667 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:29.884939 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 851/1694] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:29.885967 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d99041-baae-4f58-a4a3-45990cfea667 service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:29.890063 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-58d99041-baae-4f58-a4a3-45990cfea667 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:29.897293 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d7874-cfb4-4b56-af35-05fc04a06c5c admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:29.909817 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47834d94-9aeb-4051-b3f0-7dbe1d1abcc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:29.910443 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47834d94-9aeb-4051-b3f0-7dbe1d1abcc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:29.910724 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47834d94-9aeb-4051-b3f0-7dbe1d1abcc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:29.910997 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47834d94-9aeb-4051-b3f0-7dbe1d1abcc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:29.911642 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47834d94-9aeb-4051-b3f0-7dbe1d1abcc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:29.916013 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47834d94-9aeb-4051-b3f0-7dbe1d1abcc4 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:29.923173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d99041-baae-4f58-a4a3-45990cfea667 service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:29.936001 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed4088-f312-450c-8815-e9dcb1e4f4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:29.936842 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed4088-f312-450c-8815-e9dcb1e4f4a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:29.937233 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed4088-f312-450c-8815-e9dcb1e4f4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:29.937823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed4088-f312-450c-8815-e9dcb1e4f4a3 admin admin] PATH_INFO: `/v3/users/32010b30fca04e6eaedd65da7304fe93` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:29.939713 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed4088-f312-450c-8815-e9dcb1e4f4a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32010b30fca04e6eaedd65da7304fe93)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:29.944237 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 844/1695] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:29.944237 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47834d94-9aeb-4051-b3f0-7dbe1d1abcc4 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:29.944748 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed4088-f312-450c-8815-e9dcb1e4f4a3 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:29.956720 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-47834d94-9aeb-4051-b3f0-7dbe1d1abcc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:29.994758 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47834d94-9aeb-4051-b3f0-7dbe1d1abcc4 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:30.014717 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7e5e0-2bba-4a15-ad91-b526d8f361d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:30.015851 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7e5e0-2bba-4a15-ad91-b526d8f361d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:30.015851 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7e5e0-2bba-4a15-ad91-b526d8f361d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:30.016256 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7e5e0-2bba-4a15-ad91-b526d8f361d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:30.017195 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7e5e0-2bba-4a15-ad91-b526d8f361d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:30.035631 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7e5e0-2bba-4a15-ad91-b526d8f361d3 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:30.050175 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-16ed4088-f312-450c-8815-e9dcb1e4f4a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32010b30fca04e6eaedd65da7304fe93'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:30.051022 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-16ed4088-f312-450c-8815-e9dcb1e4f4a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32010b30fca04e6eaedd65da7304fe93'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:30.069096 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-16ed4088-f312-450c-8815-e9dcb1e4f4a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32010b30fca04e6eaedd65da7304fe93'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:30.095509 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:30.097664 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-16ed4088-f312-450c-8815-e9dcb1e4f4a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32010b30fca04e6eaedd65da7304fe93'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:30.109061 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 845/1696] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 15:59:29 2022] POST /identity/v3/projects => generated 365 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:30.111072 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119b2bd-6ddf-4c67-aced-73643a99cce8 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:30.111377 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119b2bd-6ddf-4c67-aced-73643a99cce8 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:30.111641 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119b2bd-6ddf-4c67-aced-73643a99cce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:30.122803 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-16ed4088-f312-450c-8815-e9dcb1e4f4a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32010b30fca04e6eaedd65da7304fe93'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:30.142990 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:30.149508 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 852/1697] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 15:59:29 2022] DELETE /identity/v3/users/32010b30fca04e6eaedd65da7304fe93 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:30.150630 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed4088-f312-450c-8815-e9dcb1e4f4a3 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:30.152363 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-16ed4088-f312-450c-8815-e9dcb1e4f4a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:30.168655 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-9119b2bd-6ddf-4c67-aced-73643a99cce8 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:30.171180 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-9119b2bd-6ddf-4c67-aced-73643a99cce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:30.307475 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed4088-f312-450c-8815-e9dcb1e4f4a3 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:30.317625 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97777922-df2c-44a9-bc99-63dccb7d4632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:30.318236 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97777922-df2c-44a9-bc99-63dccb7d4632 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:30.318514 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97777922-df2c-44a9-bc99-63dccb7d4632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:30.320075 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97777922-df2c-44a9-bc99-63dccb7d4632 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:30.320558 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97777922-df2c-44a9-bc99-63dccb7d4632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:30.324657 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97777922-df2c-44a9-bc99-63dccb7d4632 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:30.329632 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 846/1698] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:30.336951 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119b2bd-6ddf-4c67-aced-73643a99cce8 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:30.341372 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-9119b2bd-6ddf-4c67-aced-73643a99cce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:30.359555 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 853/1699] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:30.361035 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef000d56-6b9c-48c5-a7fa-b0673c54ce18 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:30.361320 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef000d56-6b9c-48c5-a7fa-b0673c54ce18 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:30.361590 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef000d56-6b9c-48c5-a7fa-b0673c54ce18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:30.368396 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119b2bd-6ddf-4c67-aced-73643a99cce8 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:30.410729 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794c0ac-adb3-426e-8642-a192650dfcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:30.411554 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794c0ac-adb3-426e-8642-a192650dfcbe admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:30.411839 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794c0ac-adb3-426e-8642-a192650dfcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:30.412111 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794c0ac-adb3-426e-8642-a192650dfcbe admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:30.413856 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794c0ac-adb3-426e-8642-a192650dfcbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:30.417593 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794c0ac-adb3-426e-8642-a192650dfcbe admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:30.447776 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-ef000d56-6b9c-48c5-a7fa-b0673c54ce18 None None] MFA Rules not processed for user `a5b950f64746494fb2f024e0c7147f93`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:30.448284 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-ef000d56-6b9c-48c5-a7fa-b0673c54ce18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:30.466641 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 847/1700] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:59:30 2022] POST /identity/v3/users => generated 283 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:30.468047 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b77133-d8c8-4c3e-8cca-4d2996e94baf None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:30.469442 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b77133-d8c8-4c3e-8cca-4d2996e94baf None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:30.469442 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b77133-d8c8-4c3e-8cca-4d2996e94baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:30.521819 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-96b77133-d8c8-4c3e-8cca-4d2996e94baf None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:30.523760 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-96b77133-d8c8-4c3e-8cca-4d2996e94baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:30.567423 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 848/1701] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:30.570114 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041c233-2084-439d-84d5-8b7a65357a42 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:30.583360 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041c233-2084-439d-84d5-8b7a65357a42 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:30.584031 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041c233-2084-439d-84d5-8b7a65357a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:30.619341 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 854/1702] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:30.620316 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef000d56-6b9c-48c5-a7fa-b0673c54ce18 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:30.649375 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef000d56-6b9c-48c5-a7fa-b0673c54ce18 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:30.658245 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278a37e-9a28-484c-b7e7-7adde3c347f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:30.658940 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278a37e-9a28-484c-b7e7-7adde3c347f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:30.659220 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278a37e-9a28-484c-b7e7-7adde3c347f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:30.659490 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278a37e-9a28-484c-b7e7-7adde3c347f7 admin admin] PATH_INFO: `/v3/projects/5b199e0f1ea2490b90941d15ef71ed65/users/9b552424b3884082be8b095409aa23ea/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:30.663886 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-8041c233-2084-439d-84d5-8b7a65357a42 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:30.665146 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-8041c233-2084-439d-84d5-8b7a65357a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:30.682273 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 849/1703] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:30.683278 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041c233-2084-439d-84d5-8b7a65357a42 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:30.701366 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278a37e-9a28-484c-b7e7-7adde3c347f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b199e0f1ea2490b90941d15ef71ed65, user_id=9b552424b3884082be8b095409aa23ea, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:30.715580 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041c233-2084-439d-84d5-8b7a65357a42 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:30.723527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278a37e-9a28-484c-b7e7-7adde3c347f7 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:30.733087 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2cb1fe-b851-4a27-9186-753b4696c8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:30.733989 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2cb1fe-b851-4a27-9186-753b4696c8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:30.734139 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2cb1fe-b851-4a27-9186-753b4696c8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:30.734612 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2cb1fe-b851-4a27-9186-753b4696c8c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:30.735432 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2cb1fe-b851-4a27-9186-753b4696c8c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:30.739309 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2cb1fe-b851-4a27-9186-753b4696c8c8 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:30.762522 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 855/1704] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:30 2022] PUT /identity/v3/projects/5b199e0f1ea2490b90941d15ef71ed65/users/9b552424b3884082be8b095409aa23ea/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:30.767865 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278a37e-9a28-484c-b7e7-7adde3c347f7 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:30.772602 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-b278a37e-9a28-484c-b7e7-7adde3c347f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:30.792038 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 850/1705] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:30.803088 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2cb1fe-b851-4a27-9186-753b4696c8c8 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:30.816314 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-6d2cb1fe-b851-4a27-9186-753b4696c8c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:30.962977 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:30.976097 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278a37e-9a28-484c-b7e7-7adde3c347f7 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:30.986217 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530d0bd-2c5f-4c78-93a0-0e7c87db4a28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:30.987108 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530d0bd-2c5f-4c78-93a0-0e7c87db4a28 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:30.987809 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530d0bd-2c5f-4c78-93a0-0e7c87db4a28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:30.988274 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530d0bd-2c5f-4c78-93a0-0e7c87db4a28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:31.001043 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2cb1fe-b851-4a27-9186-753b4696c8c8 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:31.139538 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:31.158177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530d0bd-2c5f-4c78-93a0-0e7c87db4a28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:31.160125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530d0bd-2c5f-4c78-93a0-0e7c87db4a28 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:31.174958 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2d1b7-74ed-4c71-93b8-82c07eb1cacf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:31.175599 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2d1b7-74ed-4c71-93b8-82c07eb1cacf service nova] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:31.175881 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2d1b7-74ed-4c71-93b8-82c07eb1cacf service nova] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:31.176153 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2d1b7-74ed-4c71-93b8-82c07eb1cacf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:31.183314 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 856/1706] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:31.186027 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530d0bd-2c5f-4c78-93a0-0e7c87db4a28 service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:31.209516 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530d0bd-2c5f-4c78-93a0-0e7c87db4a28 service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:31.215891 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41dffd-df44-4934-869a-3f9797384cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:31.217238 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41dffd-df44-4934-869a-3f9797384cac admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:31.217238 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41dffd-df44-4934-869a-3f9797384cac admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:31.218004 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41dffd-df44-4934-869a-3f9797384cac admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:31.219287 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c41dffd-df44-4934-869a-3f9797384cac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:59:31.219619 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c41dffd-df44-4934-869a-3f9797384cac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:31.222140 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c41dffd-df44-4934-869a-3f9797384cac admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:31.242648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 857/1707] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 15:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:59:31.244874 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7112d33-da5a-4e65-aea5-4fa520a5bb15 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:31.245608 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7112d33-da5a-4e65-aea5-4fa520a5bb15 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:31.245931 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7112d33-da5a-4e65-aea5-4fa520a5bb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:31.287188 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-c7112d33-da5a-4e65-aea5-4fa520a5bb15 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:31.289482 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c7112d33-da5a-4e65-aea5-4fa520a5bb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:31.316440 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 858/1708] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:31.317797 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7112d33-da5a-4e65-aea5-4fa520a5bb15 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:31.341170 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7112d33-da5a-4e65-aea5-4fa520a5bb15 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:31.348439 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf2d1b7-74ed-4c71-93b8-82c07eb1cacf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:31.355339 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39462f6-aa8d-496e-9b17-2676d380ba4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:31.356686 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf2d1b7-74ed-4c71-93b8-82c07eb1cacf service nova] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:31.357663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39462f6-aa8d-496e-9b17-2676d380ba4f admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:31.358106 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39462f6-aa8d-496e-9b17-2676d380ba4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:31.358535 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39462f6-aa8d-496e-9b17-2676d380ba4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:31.360640 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39462f6-aa8d-496e-9b17-2676d380ba4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:31.364651 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39462f6-aa8d-496e-9b17-2676d380ba4f admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:31.383490 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 851/1709] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:31.386350 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2d1b7-74ed-4c71-93b8-82c07eb1cacf service nova] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:31.390757 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-6bf2d1b7-74ed-4c71-93b8-82c07eb1cacf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:31.393813 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 859/1710] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:31.396415 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39462f6-aa8d-496e-9b17-2676d380ba4f admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:31.401634 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-a39462f6-aa8d-496e-9b17-2676d380ba4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:31.433516 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39462f6-aa8d-496e-9b17-2676d380ba4f admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:31.448947 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55f7f2-cc63-4e69-8223-d9cadc83aab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:31.449676 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55f7f2-cc63-4e69-8223-d9cadc83aab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:31.449942 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55f7f2-cc63-4e69-8223-d9cadc83aab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:31.452734 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55f7f2-cc63-4e69-8223-d9cadc83aab7 admin admin] PATH_INFO: `/v3/users/839cf55ba062488f9dfd2e54475466a1` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:31.455557 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be55f7f2-cc63-4e69-8223-d9cadc83aab7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=839cf55ba062488f9dfd2e54475466a1)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:31.460233 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be55f7f2-cc63-4e69-8223-d9cadc83aab7 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:31.553670 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2d1b7-74ed-4c71-93b8-82c07eb1cacf service nova] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:31.575036 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eca225-2a73-4ec7-953c-8f674294e7cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bba851e1a0d4601b5d4841662f645dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:31.579468 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eca225-2a73-4ec7-953c-8f674294e7cb service placement] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:31.580001 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eca225-2a73-4ec7-953c-8f674294e7cb service placement] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:31.580645 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eca225-2a73-4ec7-953c-8f674294e7cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:31.588144 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-b4eca225-2a73-4ec7-953c-8f674294e7cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:31.595350 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-be55f7f2-cc63-4e69-8223-d9cadc83aab7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '839cf55ba062488f9dfd2e54475466a1'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:31.596299 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-be55f7f2-cc63-4e69-8223-d9cadc83aab7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '839cf55ba062488f9dfd2e54475466a1'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:31.629388 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-be55f7f2-cc63-4e69-8223-d9cadc83aab7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '839cf55ba062488f9dfd2e54475466a1'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:31.630496 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eca225-2a73-4ec7-953c-8f674294e7cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:31.636491 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eca225-2a73-4ec7-953c-8f674294e7cb service placement] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:31.659292 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-be55f7f2-cc63-4e69-8223-d9cadc83aab7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '839cf55ba062488f9dfd2e54475466a1'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:31.681202 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-be55f7f2-cc63-4e69-8223-d9cadc83aab7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '839cf55ba062488f9dfd2e54475466a1'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:31.696345 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 860/1712] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 15:59:31 2022] DELETE /identity/v3/users/839cf55ba062488f9dfd2e54475466a1 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:31.697248 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55f7f2-cc63-4e69-8223-d9cadc83aab7 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:31.700257 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 852/1712] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:31.704265 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-be55f7f2-cc63-4e69-8223-d9cadc83aab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:31.706478 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eca225-2a73-4ec7-953c-8f674294e7cb service placement] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:31.733828 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eca225-2a73-4ec7-953c-8f674294e7cb service placement] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:31.841281 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:31.875935 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1c9c6-8d19-4ab0-9905-3e4308606890 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:31.876740 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1c9c6-8d19-4ab0-9905-3e4308606890 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:31.878066 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1c9c6-8d19-4ab0-9905-3e4308606890 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:31.878476 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1c9c6-8d19-4ab0-9905-3e4308606890 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:31.885498 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-0aa1c9c6-8d19-4ab0-9905-3e4308606890 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:31.896172 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55f7f2-cc63-4e69-8223-d9cadc83aab7 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:31.909930 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eca449-dac9-4458-8e93-6d1edd5267ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:31.910489 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eca449-dac9-4458-8e93-6d1edd5267ca admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:31.911089 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eca449-dac9-4458-8e93-6d1edd5267ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:31.911089 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eca449-dac9-4458-8e93-6d1edd5267ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:31.918526 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eca449-dac9-4458-8e93-6d1edd5267ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:31.920708 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eca449-dac9-4458-8e93-6d1edd5267ca admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:31.920945 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa1c9c6-8d19-4ab0-9905-3e4308606890 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:31.924196 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa1c9c6-8d19-4ab0-9905-3e4308606890 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:31.954782 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 853/1713] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:31.958615 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1c9c6-8d19-4ab0-9905-3e4308606890 service neutron] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:31.961360 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-0aa1c9c6-8d19-4ab0-9905-3e4308606890 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:32.014002 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1c9c6-8d19-4ab0-9905-3e4308606890 service neutron] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:32.033020 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 861/1714] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 15:59:31 2022] POST /identity/v3/projects => generated 381 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:32.033870 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2596b-afe5-4624-87f4-66bdd4d1274f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:32.035251 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c384d76-05b7-4fdc-89bf-4f197578630e None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:32.039278 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2596b-afe5-4624-87f4-66bdd4d1274f admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:32.039681 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2596b-afe5-4624-87f4-66bdd4d1274f admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:32.039789 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c384d76-05b7-4fdc-89bf-4f197578630e None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:32.040640 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2596b-afe5-4624-87f4-66bdd4d1274f admin admin] PATH_INFO: `/v3/projects/ea18bc77f1e74cc6be98d8a1395500e3/users/18288f7fea65491397b7672ddf065a7c/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:32.040927 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c384d76-05b7-4fdc-89bf-4f197578630e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:32.105213 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2596b-afe5-4624-87f4-66bdd4d1274f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea18bc77f1e74cc6be98d8a1395500e3, user_id=18288f7fea65491397b7672ddf065a7c, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:32.111589 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-0c384d76-05b7-4fdc-89bf-4f197578630e None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:32.113165 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-0c384d76-05b7-4fdc-89bf-4f197578630e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:32.115494 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2596b-afe5-4624-87f4-66bdd4d1274f admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:32.149920 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 854/1715] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:31 2022] PUT /identity/v3/projects/ea18bc77f1e74cc6be98d8a1395500e3/users/18288f7fea65491397b7672ddf065a7c/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:32.152038 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2596b-afe5-4624-87f4-66bdd4d1274f admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:32.174546 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:32.302917 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 862/1716] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:32.303894 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c384d76-05b7-4fdc-89bf-4f197578630e None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:32.307995 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-0c384d76-05b7-4fdc-89bf-4f197578630e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:32.338362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c384d76-05b7-4fdc-89bf-4f197578630e None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:32.418703 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2596b-afe5-4624-87f4-66bdd4d1274f admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:32.438745 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60924619-1f19-49ce-8748-0457523585e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:32.443649 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60924619-1f19-49ce-8748-0457523585e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:32.444067 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60924619-1f19-49ce-8748-0457523585e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:32.444725 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60924619-1f19-49ce-8748-0457523585e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:32.446372 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60924619-1f19-49ce-8748-0457523585e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:32.453980 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60924619-1f19-49ce-8748-0457523585e2 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:32.471346 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cabda6f-8ff5-4bae-8049-205764af305f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:32.472003 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cabda6f-8ff5-4bae-8049-205764af305f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:32.472288 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cabda6f-8ff5-4bae-8049-205764af305f admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:32.472571 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cabda6f-8ff5-4bae-8049-205764af305f admin admin] PATH_INFO: `/v3/projects/124565d89d5245e58f8c4d36ff520eb9` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:32.473807 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cabda6f-8ff5-4bae-8049-205764af305f admin admin] RBAC: Authorizing `identity:delete_project(project_id=124565d89d5245e58f8c4d36ff520eb9)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:32.475772 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cabda6f-8ff5-4bae-8049-205764af305f admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:32.532369 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 855/1717] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:59:32 2022] POST /identity/v3/users => generated 291 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:32.537932 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd2113-3644-4736-b77a-d30af268ceaf None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:32.540201 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd2113-3644-4736-b77a-d30af268ceaf None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:32.540593 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd2113-3644-4736-b77a-d30af268ceaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:32.563102 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-4cabda6f-8ff5-4bae-8049-205764af305f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '124565d89d5245e58f8c4d36ff520eb9', 'request_id': 'req-4cabda6f-8ff5-4bae-8049-205764af305f'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:32.577422 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-4cabda6f-8ff5-4bae-8049-205764af305f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '124565d89d5245e58f8c4d36ff520eb9', 'request_id': 'req-4cabda6f-8ff5-4bae-8049-205764af305f'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:32.593023 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-4cabda6f-8ff5-4bae-8049-205764af305f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '124565d89d5245e58f8c4d36ff520eb9', 'request_id': 'req-4cabda6f-8ff5-4bae-8049-205764af305f'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:32.603001 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:32.624000 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-4cabda6f-8ff5-4bae-8049-205764af305f admin admin] The token cache is being invalidate because project 124565d89d5245e58f8c4d36ff520eb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:59:32.624301 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-4cabda6f-8ff5-4bae-8049-205764af305f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:32.625623 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-4cabda6f-8ff5-4bae-8049-205764af305f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:32.632477 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 863/1718] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 15:59:32 2022] DELETE /identity/v3/projects/124565d89d5245e58f8c4d36ff520eb9 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:32.632477 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cabda6f-8ff5-4bae-8049-205764af305f admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:32.635894 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-4cabda6f-8ff5-4bae-8049-205764af305f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:32.652872 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-3bdd2113-3644-4736-b77a-d30af268ceaf None None] MFA Rules not processed for user `18288f7fea65491397b7672ddf065a7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:32.654581 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-3bdd2113-3644-4736-b77a-d30af268ceaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:32.803806 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 856/1719] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:32.807648 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd2113-3644-4736-b77a-d30af268ceaf None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:32.809600 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-3bdd2113-3644-4736-b77a-d30af268ceaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:32.832690 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cabda6f-8ff5-4bae-8049-205764af305f admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:32.843407 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9394a1-3c5b-4176-888a-62c946c60763 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:32.844301 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9394a1-3c5b-4176-888a-62c946c60763 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:32.845230 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9394a1-3c5b-4176-888a-62c946c60763 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:32.847533 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9394a1-3c5b-4176-888a-62c946c60763 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:32.852994 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-fb9394a1-3c5b-4176-888a-62c946c60763 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:32.996398 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd2113-3644-4736-b77a-d30af268ceaf None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:33.009900 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed2bfc8-bb89-44ed-92e4-83c5b0af9630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:33.012649 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2bfc8-bb89-44ed-92e4-83c5b0af9630 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:33.013821 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2bfc8-bb89-44ed-92e4-83c5b0af9630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:33.015879 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2bfc8-bb89-44ed-92e4-83c5b0af9630 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:33.019910 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed2bfc8-bb89-44ed-92e4-83c5b0af9630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:33.030125 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed2bfc8-bb89-44ed-92e4-83c5b0af9630 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:33.060013 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9394a1-3c5b-4176-888a-62c946c60763 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:33.060252 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 857/1720] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:33.063524 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed2bfc8-bb89-44ed-92e4-83c5b0af9630 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:33.065935 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9394a1-3c5b-4176-888a-62c946c60763 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:33.068244 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-aed2bfc8-bb89-44ed-92e4-83c5b0af9630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:33.091807 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 864/1721] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:33.093274 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9394a1-3c5b-4176-888a-62c946c60763 service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:33.096391 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-fb9394a1-3c5b-4176-888a-62c946c60763 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:33.114896 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed2bfc8-bb89-44ed-92e4-83c5b0af9630 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:33.126630 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9394a1-3c5b-4176-888a-62c946c60763 service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:33.131067 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268a359-5c8c-49b9-adb4-926278d8f9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:33.133305 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268a359-5c8c-49b9-adb4-926278d8f9db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:33.134022 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268a359-5c8c-49b9-adb4-926278d8f9db admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:33.135646 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268a359-5c8c-49b9-adb4-926278d8f9db admin admin] PATH_INFO: `/v3/users/3ff7f4bd11904a5ab2cae9cdfb6eeb04` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:33.139745 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4268a359-5c8c-49b9-adb4-926278d8f9db admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ff7f4bd11904a5ab2cae9cdfb6eeb04)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:33.141385 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46577fc7-79b5-4c2a-b120-416ac16de1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:33.142057 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46577fc7-79b5-4c2a-b120-416ac16de1ef admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:33.142419 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46577fc7-79b5-4c2a-b120-416ac16de1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:33.142828 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46577fc7-79b5-4c2a-b120-416ac16de1ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:33.143554 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46577fc7-79b5-4c2a-b120-416ac16de1ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:33.146142 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4268a359-5c8c-49b9-adb4-926278d8f9db admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:33.147412 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46577fc7-79b5-4c2a-b120-416ac16de1ef admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:33.184711 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:33.217768 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 865/1722] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 15:59:33 2022] POST /identity/v3/projects => generated 363 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:33.222723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46577fc7-79b5-4c2a-b120-416ac16de1ef admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:33.303911 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4268a359-5c8c-49b9-adb4-926278d8f9db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ff7f4bd11904a5ab2cae9cdfb6eeb04'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:33.361191 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4268a359-5c8c-49b9-adb4-926278d8f9db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ff7f4bd11904a5ab2cae9cdfb6eeb04'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:33.364921 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4268a359-5c8c-49b9-adb4-926278d8f9db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ff7f4bd11904a5ab2cae9cdfb6eeb04'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:33.366413 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4268a359-5c8c-49b9-adb4-926278d8f9db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ff7f4bd11904a5ab2cae9cdfb6eeb04'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:33.368674 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46577fc7-79b5-4c2a-b120-416ac16de1ef admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:33.383915 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7b7a3-f4bd-4b6f-9053-3ca354b257d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:33.384952 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7b7a3-f4bd-4b6f-9053-3ca354b257d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:33.385402 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7b7a3-f4bd-4b6f-9053-3ca354b257d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:33.385880 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7b7a3-f4bd-4b6f-9053-3ca354b257d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:33.387748 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b7b7a3-f4bd-4b6f-9053-3ca354b257d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:33.394542 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b7b7a3-f4bd-4b6f-9053-3ca354b257d6 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:33.398052 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4268a359-5c8c-49b9-adb4-926278d8f9db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ff7f4bd11904a5ab2cae9cdfb6eeb04'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:33.423827 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 866/1723] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:33.423827 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7b7a3-f4bd-4b6f-9053-3ca354b257d6 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:33.428426 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-99b7b7a3-f4bd-4b6f-9053-3ca354b257d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:33.435147 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 858/1724] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 15:59:33 2022] DELETE /identity/v3/users/3ff7f4bd11904a5ab2cae9cdfb6eeb04 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:33.437274 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268a359-5c8c-49b9-adb4-926278d8f9db admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:33.439561 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-4268a359-5c8c-49b9-adb4-926278d8f9db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:33.455598 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7b7a3-f4bd-4b6f-9053-3ca354b257d6 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:33.494142 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:33.635735 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a9d12-756b-4520-9f88-c166f4c949a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:33.636536 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a9d12-756b-4520-9f88-c166f4c949a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:33.637002 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a9d12-756b-4520-9f88-c166f4c949a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:33.637409 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a9d12-756b-4520-9f88-c166f4c949a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:33.640131 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a9d12-756b-4520-9f88-c166f4c949a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:33.646288 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a9d12-756b-4520-9f88-c166f4c949a6 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:33.648855 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268a359-5c8c-49b9-adb4-926278d8f9db admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:33.669541 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34a06a-d144-4d49-a02e-6229021257ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:33.672466 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34a06a-d144-4d49-a02e-6229021257ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:33.672758 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34a06a-d144-4d49-a02e-6229021257ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:33.675085 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34a06a-d144-4d49-a02e-6229021257ed admin admin] PATH_INFO: `/v3/projects/21332fe07751461f9b97442b9e23be7b/users/19de81bebf364f2989e139c9f424d623/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:33.720931 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 867/1725] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:59:33 2022] POST /identity/v3/users => generated 288 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:33.722022 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34a06a-d144-4d49-a02e-6229021257ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=21332fe07751461f9b97442b9e23be7b, user_id=19de81bebf364f2989e139c9f424d623, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:33.723883 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b5b3c-28a1-42e7-9475-e7715668e822 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:33.723883 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b5b3c-28a1-42e7-9475-e7715668e822 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:33.724061 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b5b3c-28a1-42e7-9475-e7715668e822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:33.727860 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34a06a-d144-4d49-a02e-6229021257ed admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:33.760725 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 859/1726] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:33 2022] PUT /identity/v3/projects/21332fe07751461f9b97442b9e23be7b/users/19de81bebf364f2989e139c9f424d623/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:33.761937 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34a06a-d144-4d49-a02e-6229021257ed admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:33.825449 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-748b5b3c-28a1-42e7-9475-e7715668e822 None None] MFA Rules not processed for user `041323d39916493aa4318309904f4ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:33.826754 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-748b5b3c-28a1-42e7-9475-e7715668e822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:33.924888 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34a06a-d144-4d49-a02e-6229021257ed admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:33.938491 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6dd79-335c-4ea7-b4d1-6efc4481ec8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:33.939448 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6dd79-335c-4ea7-b4d1-6efc4481ec8c admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:33.939727 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6dd79-335c-4ea7-b4d1-6efc4481ec8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:33.939996 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6dd79-335c-4ea7-b4d1-6efc4481ec8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:33.940658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6dd79-335c-4ea7-b4d1-6efc4481ec8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:33.946516 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6dd79-335c-4ea7-b4d1-6efc4481ec8c admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:33.984475 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 868/1727] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:33.985958 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f57f84-5c7d-4132-911d-8f347d7dc413 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:33.986311 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f57f84-5c7d-4132-911d-8f347d7dc413 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:33.987279 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f57f84-5c7d-4132-911d-8f347d7dc413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:33.989953 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 860/1728] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:33.991440 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8562bb-0a63-4698-8f78-71aaf96101d0 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:33.991767 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8562bb-0a63-4698-8f78-71aaf96101d0 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:33.992045 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8562bb-0a63-4698-8f78-71aaf96101d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:34.018929 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-9f8562bb-0a63-4698-8f78-71aaf96101d0 None None] MFA Rules not processed for user `041323d39916493aa4318309904f4ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:34.020802 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-9f8562bb-0a63-4698-8f78-71aaf96101d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:34.032734 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-18f57f84-5c7d-4132-911d-8f347d7dc413 None None] MFA Rules not processed for user `19de81bebf364f2989e139c9f424d623`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:34.034430 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-18f57f84-5c7d-4132-911d-8f347d7dc413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:34.038518 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 861/1729] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:34.039360 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8562bb-0a63-4698-8f78-71aaf96101d0 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:34.057312 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:34.070698 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8562bb-0a63-4698-8f78-71aaf96101d0 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:34.084522 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33404448-7ade-4983-800b-89e2f2a87a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:34.086440 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33404448-7ade-4983-800b-89e2f2a87a3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:34.088755 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33404448-7ade-4983-800b-89e2f2a87a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:34.089221 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33404448-7ade-4983-800b-89e2f2a87a3d admin admin] PATH_INFO: `/v3/projects/94b04c4d5abd4958905a2455cd8998a9/users/75ace991682743d0ae2adaf18d95a3c4/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:34.129673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33404448-7ade-4983-800b-89e2f2a87a3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=94b04c4d5abd4958905a2455cd8998a9, user_id=75ace991682743d0ae2adaf18d95a3c4, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:34.137481 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33404448-7ade-4983-800b-89e2f2a87a3d admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:34.171580 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 862/1730] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:34 2022] PUT /identity/v3/projects/94b04c4d5abd4958905a2455cd8998a9/users/75ace991682743d0ae2adaf18d95a3c4/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:34.172951 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33404448-7ade-4983-800b-89e2f2a87a3d admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:34.179201 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-33404448-7ade-4983-800b-89e2f2a87a3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:34.242328 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 869/1731] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:34.243323 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f57f84-5c7d-4132-911d-8f347d7dc413 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:34.262984 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f57f84-5c7d-4132-911d-8f347d7dc413 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:34.304453 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:34.356142 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97033fe7-17f9-425e-a8ff-a2f28906a148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:34.357328 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97033fe7-17f9-425e-a8ff-a2f28906a148 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:34.357822 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97033fe7-17f9-425e-a8ff-a2f28906a148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:34.358093 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97033fe7-17f9-425e-a8ff-a2f28906a148 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:34.358788 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97033fe7-17f9-425e-a8ff-a2f28906a148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:34.361083 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97033fe7-17f9-425e-a8ff-a2f28906a148 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:34.388170 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 870/1732] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:34.389069 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97033fe7-17f9-425e-a8ff-a2f28906a148 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:34.429619 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33404448-7ade-4983-800b-89e2f2a87a3d admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:34.430776 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97033fe7-17f9-425e-a8ff-a2f28906a148 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:34.446764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d1c15-f4eb-4e1c-9511-0675909f30d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:34.448512 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d1c15-f4eb-4e1c-9511-0675909f30d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:34.449396 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d1c15-f4eb-4e1c-9511-0675909f30d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:34.449666 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d1c15-f4eb-4e1c-9511-0675909f30d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:34.454709 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d1c15-f4eb-4e1c-9511-0675909f30d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:34.460223 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d1c15-f4eb-4e1c-9511-0675909f30d9 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:34.460491 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebe1eb-badc-4678-9f32-25c5a24fc29d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:34.462032 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebe1eb-badc-4678-9f32-25c5a24fc29d service nova] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:34.462621 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebe1eb-badc-4678-9f32-25c5a24fc29d service nova] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:34.462621 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebe1eb-badc-4678-9f32-25c5a24fc29d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:34.544900 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 871/1733] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 15:59:34 2022] POST /identity/v3/projects => generated 379 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:34.544900 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d1c15-f4eb-4e1c-9511-0675909f30d9 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:34.659918 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ebe1eb-badc-4678-9f32-25c5a24fc29d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:34.673594 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ebe1eb-badc-4678-9f32-25c5a24fc29d service nova] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:34.730865 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 863/1734] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:34 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:34.731011 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebe1eb-badc-4678-9f32-25c5a24fc29d service nova] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:34.783701 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebe1eb-badc-4678-9f32-25c5a24fc29d service nova] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:34.863393 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d1c15-f4eb-4e1c-9511-0675909f30d9 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:34.878487 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ac9d9-51dc-4f62-8f1b-23f669b09f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:34.879188 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ac9d9-51dc-4f62-8f1b-23f669b09f68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:34.879462 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ac9d9-51dc-4f62-8f1b-23f669b09f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:34.879732 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ac9d9-51dc-4f62-8f1b-23f669b09f68 admin admin] PATH_INFO: `/v3/projects/94b04c4d5abd4958905a2455cd8998a9/users/75ace991682743d0ae2adaf18d95a3c4/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:34.884035 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ac9d9-51dc-4f62-8f1b-23f669b09f68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94b04c4d5abd4958905a2455cd8998a9, user_id=75ace991682743d0ae2adaf18d95a3c4, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:34.887261 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ac9d9-51dc-4f62-8f1b-23f669b09f68 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:34.941547 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 872/1735] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:34 2022] PUT /identity/v3/projects/94b04c4d5abd4958905a2455cd8998a9/users/75ace991682743d0ae2adaf18d95a3c4/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:34.941547 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ac9d9-51dc-4f62-8f1b-23f669b09f68 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:34.941547 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-cd0ac9d9-51dc-4f62-8f1b-23f669b09f68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:35.030715 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dfb505-ac9f-4637-9bc9-01f752b7fa91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:35.031278 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfb505-ac9f-4637-9bc9-01f752b7fa91 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:35.031512 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfb505-ac9f-4637-9bc9-01f752b7fa91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:35.031715 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfb505-ac9f-4637-9bc9-01f752b7fa91 admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:35.032485 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dfb505-ac9f-4637-9bc9-01f752b7fa91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:35.036861 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dfb505-ac9f-4637-9bc9-01f752b7fa91 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:35.087096 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 864/1736] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:59:34 2022] POST /identity/v3/users => generated 296 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:35.087096 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dfb505-ac9f-4637-9bc9-01f752b7fa91 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:35.092626 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-65dfb505-ac9f-4637-9bc9-01f752b7fa91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:35.114483 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dfb505-ac9f-4637-9bc9-01f752b7fa91 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:35.119384 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:35.174692 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ac9d9-51dc-4f62-8f1b-23f669b09f68 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:35.189452 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0f6aa-1f56-44c1-8a5f-f47dfe8603e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:35.190390 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0f6aa-1f56-44c1-8a5f-f47dfe8603e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:35.191367 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0f6aa-1f56-44c1-8a5f-f47dfe8603e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:35.191786 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0f6aa-1f56-44c1-8a5f-f47dfe8603e2 admin admin] PATH_INFO: `/v3/projects/e3d4d31841e14f2b969004346645cd7c` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:35.193484 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0f6aa-1f56-44c1-8a5f-f47dfe8603e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3d4d31841e14f2b969004346645cd7c)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:35.195719 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0f6aa-1f56-44c1-8a5f-f47dfe8603e2 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:35.282551 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:35.290615 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7a436-30b3-405a-b31d-9fc1860704b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:35.291433 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7a436-30b3-405a-b31d-9fc1860704b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:35.291844 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7a436-30b3-405a-b31d-9fc1860704b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:35.292279 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7a436-30b3-405a-b31d-9fc1860704b0 admin admin] PATH_INFO: `/v3/projects/41ca7af458254a8ead703a54de503390` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:35.297855 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d7a436-30b3-405a-b31d-9fc1860704b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41ca7af458254a8ead703a54de503390)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:35.300305 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d7a436-30b3-405a-b31d-9fc1860704b0 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:35.308161 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a8b0f6aa-1f56-44c1-8a5f-f47dfe8603e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3d4d31841e14f2b969004346645cd7c', 'request_id': 'req-a8b0f6aa-1f56-44c1-8a5f-f47dfe8603e2'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:35.331028 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a8b0f6aa-1f56-44c1-8a5f-f47dfe8603e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3d4d31841e14f2b969004346645cd7c', 'request_id': 'req-a8b0f6aa-1f56-44c1-8a5f-f47dfe8603e2'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:35.344176 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a8b0f6aa-1f56-44c1-8a5f-f47dfe8603e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3d4d31841e14f2b969004346645cd7c', 'request_id': 'req-a8b0f6aa-1f56-44c1-8a5f-f47dfe8603e2'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:35.366482 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a8b0f6aa-1f56-44c1-8a5f-f47dfe8603e2 admin admin] The token cache is being invalidate because project e3d4d31841e14f2b969004346645cd7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:59:35.366784 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a8b0f6aa-1f56-44c1-8a5f-f47dfe8603e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:35.367887 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a8b0f6aa-1f56-44c1-8a5f-f47dfe8603e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:35.370058 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 873/1737] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 15:59:34 2022] DELETE /identity/v3/projects/e3d4d31841e14f2b969004346645cd7c => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:35.371323 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0417cc-6b16-469c-a848-4ec5ca6f4d6c None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:35.371646 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0417cc-6b16-469c-a848-4ec5ca6f4d6c None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:35.372221 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0417cc-6b16-469c-a848-4ec5ca6f4d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:35.379316 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-53d7a436-30b3-405a-b31d-9fc1860704b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41ca7af458254a8ead703a54de503390', 'request_id': 'req-53d7a436-30b3-405a-b31d-9fc1860704b0'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:35.392598 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-53d7a436-30b3-405a-b31d-9fc1860704b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41ca7af458254a8ead703a54de503390', 'request_id': 'req-53d7a436-30b3-405a-b31d-9fc1860704b0'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:35.409096 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-ec0417cc-6b16-469c-a848-4ec5ca6f4d6c None None] MFA Rules not processed for user `75ace991682743d0ae2adaf18d95a3c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:35.410486 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-ec0417cc-6b16-469c-a848-4ec5ca6f4d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:35.434994 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-53d7a436-30b3-405a-b31d-9fc1860704b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41ca7af458254a8ead703a54de503390', 'request_id': 'req-53d7a436-30b3-405a-b31d-9fc1860704b0'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:35.472047 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-53d7a436-30b3-405a-b31d-9fc1860704b0 admin admin] The token cache is being invalidate because project 41ca7af458254a8ead703a54de503390 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:59:35.472493 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-53d7a436-30b3-405a-b31d-9fc1860704b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:35.475000 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-53d7a436-30b3-405a-b31d-9fc1860704b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:35.481751 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 865/1738] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 15:59:35 2022] DELETE /identity/v3/projects/41ca7af458254a8ead703a54de503390 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:35.489924 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7a436-30b3-405a-b31d-9fc1860704b0 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:35.491952 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-53d7a436-30b3-405a-b31d-9fc1860704b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:35.552424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 874/1739] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:35 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:35.552424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd561b04-e337-49d4-b423-873648710f30 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:35.552424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd561b04-e337-49d4-b423-873648710f30 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:35.553162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd561b04-e337-49d4-b423-873648710f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:35.593244 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-cd561b04-e337-49d4-b423-873648710f30 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:35.595020 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-cd561b04-e337-49d4-b423-873648710f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:35.642363 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7a436-30b3-405a-b31d-9fc1860704b0 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:35.651308 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70f7c0-ffcf-4094-b55b-3afda0190c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:35.652049 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70f7c0-ffcf-4094-b55b-3afda0190c51 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:35.652401 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70f7c0-ffcf-4094-b55b-3afda0190c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:35.652685 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70f7c0-ffcf-4094-b55b-3afda0190c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:35.655095 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f70f7c0-ffcf-4094-b55b-3afda0190c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:35.658724 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f70f7c0-ffcf-4094-b55b-3afda0190c51 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:35.691774 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 866/1740] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:35.691774 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3bac1-1800-4f16-b794-5edeb85e5c07 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:35.691774 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3bac1-1800-4f16-b794-5edeb85e5c07 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:35.691774 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3bac1-1800-4f16-b794-5edeb85e5c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:35.723176 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 875/1741] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:35.723176 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd561b04-e337-49d4-b423-873648710f30 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:35.725297 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-cd561b04-e337-49d4-b423-873648710f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:35.740149 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-a5a3bac1-1800-4f16-b794-5edeb85e5c07 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:35.741711 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-a5a3bac1-1800-4f16-b794-5edeb85e5c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:35.759903 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 867/1742] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:35.772686 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4a673-ea62-43dc-a7b2-72196e400112 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:35.773110 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4a673-ea62-43dc-a7b2-72196e400112 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:35.773945 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4a673-ea62-43dc-a7b2-72196e400112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:35.851622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd561b04-e337-49d4-b423-873648710f30 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:35.857065 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eae488-3a6b-401b-8d63-b81a8fb38e32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:35.857705 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eae488-3a6b-401b-8d63-b81a8fb38e32 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:35.857981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eae488-3a6b-401b-8d63-b81a8fb38e32 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:35.858217 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eae488-3a6b-401b-8d63-b81a8fb38e32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:35.867719 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:35.880062 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:35.886954 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eae488-3a6b-401b-8d63-b81a8fb38e32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:35.888735 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eae488-3a6b-401b-8d63-b81a8fb38e32 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:35.897971 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-5cb4a673-ea62-43dc-a7b2-72196e400112 None None] MFA Rules not processed for user `d7958b395d5e4f5da37927536b1856ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:35.900676 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-5cb4a673-ea62-43dc-a7b2-72196e400112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:35.905646 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 876/1743] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:35 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:35.907465 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eae488-3a6b-401b-8d63-b81a8fb38e32 service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:35.919096 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eae488-3a6b-401b-8d63-b81a8fb38e32 service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:35.925696 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856a3ee-6e25-48cb-a441-328fe266f80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:35.926547 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856a3ee-6e25-48cb-a441-328fe266f80c admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:35.926833 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856a3ee-6e25-48cb-a441-328fe266f80c admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:35.927106 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856a3ee-6e25-48cb-a441-328fe266f80c admin admin] PATH_INFO: `/v3/projects/01177dbab7d74ea2b8ae61d2527710da/users/e7c1a68c6459457f8a45be0694c8b60f/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:35.947859 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b856a3ee-6e25-48cb-a441-328fe266f80c admin admin] RBAC: Authorizing `identity:create_grant(project_id=01177dbab7d74ea2b8ae61d2527710da, user_id=e7c1a68c6459457f8a45be0694c8b60f, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:35.951148 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b856a3ee-6e25-48cb-a441-328fe266f80c admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:35.972296 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 877/1744] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:35 2022] PUT /identity/v3/projects/01177dbab7d74ea2b8ae61d2527710da/users/e7c1a68c6459457f8a45be0694c8b60f/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:35.973962 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32859b42-0cf3-4b2a-bc9d-a69bff5f0874 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:35.974355 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32859b42-0cf3-4b2a-bc9d-a69bff5f0874 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:35.974851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32859b42-0cf3-4b2a-bc9d-a69bff5f0874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:36.046187 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-32859b42-0cf3-4b2a-bc9d-a69bff5f0874 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:36.049581 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-32859b42-0cf3-4b2a-bc9d-a69bff5f0874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:36.088179 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 868/1745] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Aug 30 15:59:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:36.091433 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215d644-b519-4099-9f7a-4779c727f5c9 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:36.091864 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215d644-b519-4099-9f7a-4779c727f5c9 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:36.092273 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215d644-b519-4099-9f7a-4779c727f5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:36.148392 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-1215d644-b519-4099-9f7a-4779c727f5c9 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:36.150132 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-1215d644-b519-4099-9f7a-4779c727f5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:36.215838 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 878/1746] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:36.217180 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c47f0-c6c0-44fc-8e26-a0a8c45fa440 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:36.217464 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c47f0-c6c0-44fc-8e26-a0a8c45fa440 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:36.217734 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c47f0-c6c0-44fc-8e26-a0a8c45fa440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:36.275064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 869/1747] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:36.276096 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1215d644-b519-4099-9f7a-4779c727f5c9 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:36.289843 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1215d644-b519-4099-9f7a-4779c727f5c9 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:36.316670 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d93662-3b9a-437f-8f73-5fc062ae2753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:36.326297 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d93662-3b9a-437f-8f73-5fc062ae2753 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:36.326588 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d93662-3b9a-437f-8f73-5fc062ae2753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:36.326865 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d93662-3b9a-437f-8f73-5fc062ae2753 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:36.327533 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d93662-3b9a-437f-8f73-5fc062ae2753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:36.329746 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d93662-3b9a-437f-8f73-5fc062ae2753 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:36.352256 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 870/1748] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:36.353371 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d93662-3b9a-437f-8f73-5fc062ae2753 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:36.356396 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-7e4c47f0-c6c0-44fc-8e26-a0a8c45fa440 None None] MFA Rules not processed for user `9b552424b3884082be8b095409aa23ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:36.363922 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7e4c47f0-c6c0-44fc-8e26-a0a8c45fa440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:36.514784 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d93662-3b9a-437f-8f73-5fc062ae2753 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:36.524427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32750b3-41d5-4c06-9fd8-fa6bdf83fc5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:36.525092 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32750b3-41d5-4c06-9fd8-fa6bdf83fc5a service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:36.525373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32750b3-41d5-4c06-9fd8-fa6bdf83fc5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:36.527916 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32750b3-41d5-4c06-9fd8-fa6bdf83fc5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:36.532540 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-d32750b3-41d5-4c06-9fd8-fa6bdf83fc5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:36.555331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 879/1749] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:36 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:36.555331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c47f0-c6c0-44fc-8e26-a0a8c45fa440 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:36.583056 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c47f0-c6c0-44fc-8e26-a0a8c45fa440 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:36.594873 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da91400-17d0-4688-8954-2a567747d419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:36.595505 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da91400-17d0-4688-8954-2a567747d419 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:36.595783 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da91400-17d0-4688-8954-2a567747d419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:36.596064 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da91400-17d0-4688-8954-2a567747d419 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:36.598045 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da91400-17d0-4688-8954-2a567747d419 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:59:36.598349 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da91400-17d0-4688-8954-2a567747d419 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:36.601944 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da91400-17d0-4688-8954-2a567747d419 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:36.675325 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:36.686875 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 880/1750] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 15:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:59:36.686875 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da91400-17d0-4688-8954-2a567747d419 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:36.702666 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da91400-17d0-4688-8954-2a567747d419 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:36.709739 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32750b3-41d5-4c06-9fd8-fa6bdf83fc5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:36.711145 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4cddf1-eb06-46ae-9a61-a55aa4c84e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:36.711628 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32750b3-41d5-4c06-9fd8-fa6bdf83fc5a service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:36.711772 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4cddf1-eb06-46ae-9a61-a55aa4c84e8b admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:36.712110 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4cddf1-eb06-46ae-9a61-a55aa4c84e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:36.712394 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4cddf1-eb06-46ae-9a61-a55aa4c84e8b admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:36.713112 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4cddf1-eb06-46ae-9a61-a55aa4c84e8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:59:36.713427 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4cddf1-eb06-46ae-9a61-a55aa4c84e8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:36.716040 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4cddf1-eb06-46ae-9a61-a55aa4c84e8b admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:36.745273 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 871/1751] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:36.746316 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32750b3-41d5-4c06-9fd8-fa6bdf83fc5a service cinder] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:36.748017 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-d32750b3-41d5-4c06-9fd8-fa6bdf83fc5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:36.792563 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 881/1752] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 15:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:59:36.794662 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4cddf1-eb06-46ae-9a61-a55aa4c84e8b admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:36.818303 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4cddf1-eb06-46ae-9a61-a55aa4c84e8b admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:36.827664 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff94d0-4036-4275-9816-f95ae76a0766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:36.830474 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff94d0-4036-4275-9816-f95ae76a0766 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:36.830916 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff94d0-4036-4275-9816-f95ae76a0766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:36.831338 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff94d0-4036-4275-9816-f95ae76a0766 admin admin] PATH_INFO: `/v3/projects/01177dbab7d74ea2b8ae61d2527710da/users/e7c1a68c6459457f8a45be0694c8b60f/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:36.833814 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff94d0-4036-4275-9816-f95ae76a0766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01177dbab7d74ea2b8ae61d2527710da, user_id=e7c1a68c6459457f8a45be0694c8b60f, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:36.837632 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff94d0-4036-4275-9816-f95ae76a0766 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:36.862891 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 882/1753] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:36 2022] PUT /identity/v3/projects/01177dbab7d74ea2b8ae61d2527710da/users/e7c1a68c6459457f8a45be0694c8b60f/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:36.864756 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff94d0-4036-4275-9816-f95ae76a0766 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:36.880002 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-0bff94d0-4036-4275-9816-f95ae76a0766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:36.953812 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:37.021971 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32750b3-41d5-4c06-9fd8-fa6bdf83fc5a service cinder] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:37.060036 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff94d0-4036-4275-9816-f95ae76a0766 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:37.068147 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044bba7f-4b25-41bc-8c8a-0f86ac940a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:37.068821 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bba7f-4b25-41bc-8c8a-0f86ac940a3d admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:37.069136 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bba7f-4b25-41bc-8c8a-0f86ac940a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:37.069418 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bba7f-4b25-41bc-8c8a-0f86ac940a3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:37.070208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044bba7f-4b25-41bc-8c8a-0f86ac940a3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:37.072919 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044bba7f-4b25-41bc-8c8a-0f86ac940a3d admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:37.137340 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 883/1754] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 15:59:36 2022] POST /identity/v3/projects => generated 405 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:37.140445 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044bba7f-4b25-41bc-8c8a-0f86ac940a3d admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:37.228468 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44013659-fdb1-4bd5-9f53-11723750ca5c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94765f224c734beabe83b4dc0c5e511f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:37.229289 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44013659-fdb1-4bd5-9f53-11723750ca5c service swift] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:37.230672 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44013659-fdb1-4bd5-9f53-11723750ca5c service swift] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:37.230958 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44013659-fdb1-4bd5-9f53-11723750ca5c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:37.304567 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044bba7f-4b25-41bc-8c8a-0f86ac940a3d admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:37.312714 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab5f9dc-de61-4a0f-9e6c-9a1e83bdb053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:37.314844 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5f9dc-de61-4a0f-9e6c-9a1e83bdb053 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:37.315141 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5f9dc-de61-4a0f-9e6c-9a1e83bdb053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:37.315476 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5f9dc-de61-4a0f-9e6c-9a1e83bdb053 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:37.317133 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab5f9dc-de61-4a0f-9e6c-9a1e83bdb053 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:37.319309 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab5f9dc-de61-4a0f-9e6c-9a1e83bdb053 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:37.366406 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 884/1755] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 15:59:37 2022] POST /identity/v3/projects => generated 377 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:37.366406 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab5f9dc-de61-4a0f-9e6c-9a1e83bdb053 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:37.419254 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44013659-fdb1-4bd5-9f53-11723750ca5c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:37.425122 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44013659-fdb1-4bd5-9f53-11723750ca5c service swift] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:37.442187 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 872/1756] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Aug 30 15:59:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 696 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 15:59:37.443448 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34527300-813d-4918-a525-acd6b6bfc33b None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:37.443448 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34527300-813d-4918-a525-acd6b6bfc33b None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:37.443448 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34527300-813d-4918-a525-acd6b6bfc33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:37.470651 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:37.516952 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-34527300-813d-4918-a525-acd6b6bfc33b None None] MFA Rules not processed for user `e7c1a68c6459457f8a45be0694c8b60f`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:37.518087 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-34527300-813d-4918-a525-acd6b6bfc33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:37.538586 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab5f9dc-de61-4a0f-9e6c-9a1e83bdb053 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:37.554870 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f63300-81e9-452c-a3d9-c5bc1004f2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:37.555510 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f63300-81e9-452c-a3d9-c5bc1004f2d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:37.556228 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f63300-81e9-452c-a3d9-c5bc1004f2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:37.556228 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f63300-81e9-452c-a3d9-c5bc1004f2d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:37.556721 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f63300-81e9-452c-a3d9-c5bc1004f2d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:37.560678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f63300-81e9-452c-a3d9-c5bc1004f2d8 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:37.644398 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 885/1757] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 15:59:37 2022] POST /identity/v3/projects => generated 373 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:37.650165 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe734a3-bc4d-4751-8d1b-c4b9e0a96033 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:37.651376 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe734a3-bc4d-4751-8d1b-c4b9e0a96033 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:37.651656 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe734a3-bc4d-4751-8d1b-c4b9e0a96033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:37.690964 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-dbe734a3-bc4d-4751-8d1b-c4b9e0a96033 None None] MFA Rules not processed for user `041323d39916493aa4318309904f4ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:37.692304 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-dbe734a3-bc4d-4751-8d1b-c4b9e0a96033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:37.714853 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:37.802079 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 873/1758] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:37 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:37.807919 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34527300-813d-4918-a525-acd6b6bfc33b None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:37.878421 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34527300-813d-4918-a525-acd6b6bfc33b None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:37.922600 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 886/1759] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:37.925733 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe734a3-bc4d-4751-8d1b-c4b9e0a96033 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:38.168442 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe734a3-bc4d-4751-8d1b-c4b9e0a96033 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:38.178423 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d5146-595f-4bef-af16-a466ecf0ca58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:38.179715 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d5146-595f-4bef-af16-a466ecf0ca58 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:38.182251 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d5146-595f-4bef-af16-a466ecf0ca58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:38.182555 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d5146-595f-4bef-af16-a466ecf0ca58 admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:38.183231 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795d5146-595f-4bef-af16-a466ecf0ca58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:38.185230 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795d5146-595f-4bef-af16-a466ecf0ca58 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:38.191619 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409b2c3-e3bb-456e-b69a-0e5cf30c06c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:38.192361 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409b2c3-e3bb-456e-b69a-0e5cf30c06c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:38.192670 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409b2c3-e3bb-456e-b69a-0e5cf30c06c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:38.193315 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409b2c3-e3bb-456e-b69a-0e5cf30c06c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:38.194023 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409b2c3-e3bb-456e-b69a-0e5cf30c06c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:38.199399 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409b2c3-e3bb-456e-b69a-0e5cf30c06c1 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:38.247738 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 874/1760] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:59:37 2022] POST /identity/v3/users => generated 309 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:38.250489 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124a68a-be40-4d1d-a71e-26ff7f31d2ee None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:38.250845 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124a68a-be40-4d1d-a71e-26ff7f31d2ee None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:38.251120 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124a68a-be40-4d1d-a71e-26ff7f31d2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:38.297704 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 887/1761] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:59:37 2022] POST /identity/v3/users => generated 289 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:38.304204 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409b2c3-e3bb-456e-b69a-0e5cf30c06c1 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:38.329270 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409b2c3-e3bb-456e-b69a-0e5cf30c06c1 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:38.330443 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-e124a68a-be40-4d1d-a71e-26ff7f31d2ee None None] MFA Rules not processed for user `a5b950f64746494fb2f024e0c7147f93`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:38.335886 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-e124a68a-be40-4d1d-a71e-26ff7f31d2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:38.351750 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5942945-dbd3-4b6a-8fdd-dfb4661be58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:38.352701 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5942945-dbd3-4b6a-8fdd-dfb4661be58f admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:38.356502 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5942945-dbd3-4b6a-8fdd-dfb4661be58f admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:38.356852 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5942945-dbd3-4b6a-8fdd-dfb4661be58f admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:38.357678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5942945-dbd3-4b6a-8fdd-dfb4661be58f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:38.365143 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5942945-dbd3-4b6a-8fdd-dfb4661be58f admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:38.440618 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 888/1762] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:59:38 2022] POST /identity/v3/users => generated 287 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:38.445108 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fe340-9864-457d-85f7-ab50b281fb05 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:38.445873 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fe340-9864-457d-85f7-ab50b281fb05 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:38.446828 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fe340-9864-457d-85f7-ab50b281fb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:38.490601 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-049fe340-9864-457d-85f7-ab50b281fb05 None None] MFA Rules not processed for user `48c49f6751d14526a0954797d9ab6a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:38.492148 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-049fe340-9864-457d-85f7-ab50b281fb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:38.544739 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 875/1763] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:38.549897 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124a68a-be40-4d1d-a71e-26ff7f31d2ee None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:38.633439 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 889/1764] 10.222.0.44 () {58 vars in 1015 bytes} [Tue Aug 30 15:59:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:38.634721 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049fe340-9864-457d-85f7-ab50b281fb05 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:38.643744 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:38.683125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049fe340-9864-457d-85f7-ab50b281fb05 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:38.700720 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124a68a-be40-4d1d-a71e-26ff7f31d2ee None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:38.705641 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88dc6a-a772-4e39-8b7a-210ba86d1d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:38.706491 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bcd540-bbd5-400a-bab5-97da4f673757 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:38.706844 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88dc6a-a772-4e39-8b7a-210ba86d1d8e admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:38.707115 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcd540-bbd5-400a-bab5-97da4f673757 service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:38.707395 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcd540-bbd5-400a-bab5-97da4f673757 service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:38.707669 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcd540-bbd5-400a-bab5-97da4f673757 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:38.707960 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88dc6a-a772-4e39-8b7a-210ba86d1d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:38.708424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88dc6a-a772-4e39-8b7a-210ba86d1d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:38.709255 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d88dc6a-a772-4e39-8b7a-210ba86d1d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:38.712227 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d88dc6a-a772-4e39-8b7a-210ba86d1d8e admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:38.745048 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 890/1765] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:38.746317 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88dc6a-a772-4e39-8b7a-210ba86d1d8e admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:38.790681 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88dc6a-a772-4e39-8b7a-210ba86d1d8e admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:38.819241 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10bc52-8830-4638-99b0-b7f3343c119b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:38.819879 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10bc52-8830-4638-99b0-b7f3343c119b admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:38.820175 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10bc52-8830-4638-99b0-b7f3343c119b admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:38.820424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10bc52-8830-4638-99b0-b7f3343c119b admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:38.821138 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10bc52-8830-4638-99b0-b7f3343c119b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:38.822772 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10bc52-8830-4638-99b0-b7f3343c119b admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:38.865147 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 891/1766] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:38.883006 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10bc52-8830-4638-99b0-b7f3343c119b admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:38.922140 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10bc52-8830-4638-99b0-b7f3343c119b admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:38.933923 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28109535-2dfa-46ce-8eb5-c86b5e2f64fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:38.935077 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28109535-2dfa-46ce-8eb5-c86b5e2f64fa admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:38.935697 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28109535-2dfa-46ce-8eb5-c86b5e2f64fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:38.936247 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28109535-2dfa-46ce-8eb5-c86b5e2f64fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:38.937529 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28109535-2dfa-46ce-8eb5-c86b5e2f64fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:38.940306 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28109535-2dfa-46ce-8eb5-c86b5e2f64fa admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:38.949871 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bcd540-bbd5-400a-bab5-97da4f673757 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:38.953273 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bcd540-bbd5-400a-bab5-97da4f673757 service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:38.966668 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 876/1767] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:38 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:38.967696 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bcd540-bbd5-400a-bab5-97da4f673757 service cinder] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:38.970071 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-70bcd540-bbd5-400a-bab5-97da4f673757 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:38.997535 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bcd540-bbd5-400a-bab5-97da4f673757 service cinder] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:39.000464 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 892/1768] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:39.003242 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28109535-2dfa-46ce-8eb5-c86b5e2f64fa admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:39.005561 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247cd162-7fd8-44b7-8b98-2a9836b20168 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:39.006404 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cd162-7fd8-44b7-8b98-2a9836b20168 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:39.006631 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cd162-7fd8-44b7-8b98-2a9836b20168 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:39.007617 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cd162-7fd8-44b7-8b98-2a9836b20168 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:39.022104 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247cd162-7fd8-44b7-8b98-2a9836b20168 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:39.035129 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28109535-2dfa-46ce-8eb5-c86b5e2f64fa admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:39.036073 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247cd162-7fd8-44b7-8b98-2a9836b20168 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:39.051863 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d7ddf-f966-4b0b-9567-5128e40f188e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:39.051863 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d7ddf-f966-4b0b-9567-5128e40f188e admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:39.051863 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d7ddf-f966-4b0b-9567-5128e40f188e admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:39.069047 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d7ddf-f966-4b0b-9567-5128e40f188e admin admin] PATH_INFO: `/v3/projects/26cf794b463c4804af97646dff33fb6e/users/f37871115df84d508aa19d9d3cc3ab1e/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:39.076598 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:39.082810 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 877/1769] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:39.086061 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247cd162-7fd8-44b7-8b98-2a9836b20168 service neutron] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:39.114382 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d7ddf-f966-4b0b-9567-5128e40f188e admin admin] RBAC: Authorizing `identity:create_grant(project_id=26cf794b463c4804af97646dff33fb6e, user_id=f37871115df84d508aa19d9d3cc3ab1e, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:39.122419 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d7ddf-f966-4b0b-9567-5128e40f188e admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:39.152427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247cd162-7fd8-44b7-8b98-2a9836b20168 service neutron] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:39.172869 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 893/1770] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:39 2022] PUT /identity/v3/projects/26cf794b463c4804af97646dff33fb6e/users/f37871115df84d508aa19d9d3cc3ab1e/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:39.177106 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d7ddf-f966-4b0b-9567-5128e40f188e admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:39.316016 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf86ed6-3a1b-4342-87a4-6b7f206e96aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:39.316955 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf86ed6-3a1b-4342-87a4-6b7f206e96aa admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:39.317522 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf86ed6-3a1b-4342-87a4-6b7f206e96aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:39.317931 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf86ed6-3a1b-4342-87a4-6b7f206e96aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:39.318825 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf86ed6-3a1b-4342-87a4-6b7f206e96aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:39.320583 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf86ed6-3a1b-4342-87a4-6b7f206e96aa admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:39.373912 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 878/1771] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:39.377868 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf86ed6-3a1b-4342-87a4-6b7f206e96aa admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:39.417200 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d7ddf-f966-4b0b-9567-5128e40f188e admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:39.429580 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc6828-992f-4037-a357-68172e55e58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:39.430548 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc6828-992f-4037-a357-68172e55e58a admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:39.430999 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc6828-992f-4037-a357-68172e55e58a admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:39.431277 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc6828-992f-4037-a357-68172e55e58a admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:39.431934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc6828-992f-4037-a357-68172e55e58a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:39.439701 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc6828-992f-4037-a357-68172e55e58a admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:39.453627 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf86ed6-3a1b-4342-87a4-6b7f206e96aa admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:39.485794 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 894/1772] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:39.485981 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa00637-c592-4cee-95bb-68c0e62bd5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:39.486093 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc6828-992f-4037-a357-68172e55e58a admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:39.486419 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa00637-c592-4cee-95bb-68c0e62bd5c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:39.486709 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa00637-c592-4cee-95bb-68c0e62bd5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:39.486988 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa00637-c592-4cee-95bb-68c0e62bd5c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:39.487671 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa00637-c592-4cee-95bb-68c0e62bd5c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:39.505161 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa00637-c592-4cee-95bb-68c0e62bd5c6 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:39.565486 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 879/1773] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:39.571739 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa00637-c592-4cee-95bb-68c0e62bd5c6 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:39.619934 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa00637-c592-4cee-95bb-68c0e62bd5c6 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:39.628242 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc6828-992f-4037-a357-68172e55e58a admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:39.632133 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d5ace-f364-47c5-87e7-b793da1779c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:39.632762 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d5ace-f364-47c5-87e7-b793da1779c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:39.633066 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d5ace-f364-47c5-87e7-b793da1779c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:39.633524 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d5ace-f364-47c5-87e7-b793da1779c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:39.642858 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e0031-d8cd-44be-bda8-2c6440475478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:39.644088 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-1e9d5ace-f364-47c5-87e7-b793da1779c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:39.644691 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e0031-d8cd-44be-bda8-2c6440475478 admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:39.644999 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e0031-d8cd-44be-bda8-2c6440475478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:39.645280 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e0031-d8cd-44be-bda8-2c6440475478 admin admin] PATH_INFO: `/v3/projects/ab6244076bc348fc8c7c998b8437c50e/users/527f76e1f2f247919b671fc6da3724c5/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:39.692011 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e0031-d8cd-44be-bda8-2c6440475478 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab6244076bc348fc8c7c998b8437c50e, user_id=527f76e1f2f247919b671fc6da3724c5, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:39.699111 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e0031-d8cd-44be-bda8-2c6440475478 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:39.741032 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 880/1774] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:39 2022] PUT /identity/v3/projects/ab6244076bc348fc8c7c998b8437c50e/users/527f76e1f2f247919b671fc6da3724c5/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:39.744570 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e0031-d8cd-44be-bda8-2c6440475478 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:39.774836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d5ace-f364-47c5-87e7-b793da1779c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:39.776534 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d5ace-f364-47c5-87e7-b793da1779c1 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:39.799227 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 895/1775] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:39.800388 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d5ace-f364-47c5-87e7-b793da1779c1 service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:39.838965 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:39.846615 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d5ace-f364-47c5-87e7-b793da1779c1 service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:39.951659 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:39.982438 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e0031-d8cd-44be-bda8-2c6440475478 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:40.005507 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb36c4-ac87-4f8f-8e0d-ed15722f7a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:40.006548 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb36c4-ac87-4f8f-8e0d-ed15722f7a9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:40.041269 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb36c4-ac87-4f8f-8e0d-ed15722f7a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:40.044634 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb36c4-ac87-4f8f-8e0d-ed15722f7a9e admin admin] PATH_INFO: `/v3/projects/097bca80282747ce95e61b2ca0950608/users/6a5a671d6fb24029942f4fd3cbabe1a5/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:40.086075 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e2425-69e8-452e-a5ce-edd3f37d4d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:40.088055 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e2425-69e8-452e-a5ce-edd3f37d4d85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:40.091096 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e2425-69e8-452e-a5ce-edd3f37d4d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:40.094150 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e2425-69e8-452e-a5ce-edd3f37d4d85 admin admin] PATH_INFO: `/v3/projects/26cf794b463c4804af97646dff33fb6e/users/f37871115df84d508aa19d9d3cc3ab1e/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:40.101077 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e2425-69e8-452e-a5ce-edd3f37d4d85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26cf794b463c4804af97646dff33fb6e, user_id=f37871115df84d508aa19d9d3cc3ab1e, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:40.111244 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb36c4-ac87-4f8f-8e0d-ed15722f7a9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=097bca80282747ce95e61b2ca0950608, user_id=6a5a671d6fb24029942f4fd3cbabe1a5, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:40.112037 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e2425-69e8-452e-a5ce-edd3f37d4d85 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:40.119403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb36c4-ac87-4f8f-8e0d-ed15722f7a9e admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:40.150887 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 896/1776] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:39 2022] PUT /identity/v3/projects/26cf794b463c4804af97646dff33fb6e/users/f37871115df84d508aa19d9d3cc3ab1e/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:40.152484 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083227fb-fdc4-4b82-8b13-0477244cd02e None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:40.155188 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083227fb-fdc4-4b82-8b13-0477244cd02e None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:40.156457 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083227fb-fdc4-4b82-8b13-0477244cd02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:40.176900 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 881/1777] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:39 2022] PUT /identity/v3/projects/097bca80282747ce95e61b2ca0950608/users/6a5a671d6fb24029942f4fd3cbabe1a5/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:40.178868 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b2059-253d-4af5-b23a-247802004067 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:40.179384 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b2059-253d-4af5-b23a-247802004067 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:40.180028 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b2059-253d-4af5-b23a-247802004067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:40.230741 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-2e8b2059-253d-4af5-b23a-247802004067 None None] MFA Rules not processed for user `6a5a671d6fb24029942f4fd3cbabe1a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:40.235676 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-2e8b2059-253d-4af5-b23a-247802004067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:40.266154 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-083227fb-fdc4-4b82-8b13-0477244cd02e None None] MFA Rules not processed for user `527f76e1f2f247919b671fc6da3724c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:40.270301 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-083227fb-fdc4-4b82-8b13-0477244cd02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:40.434779 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 882/1778] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:40.435243 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222a431-09c5-42f8-a56e-f439a89d91ca None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:40.435243 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222a431-09c5-42f8-a56e-f439a89d91ca None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:40.435525 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222a431-09c5-42f8-a56e-f439a89d91ca None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:40.445225 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 883/1779] 10.222.0.25 () {54 vars in 912 bytes} [Tue Aug 30 15:59:40 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:59:40.455121 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222a431-09c5-42f8-a56e-f439a89d91ca None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:40.529939 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 897/1780] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:40.531995 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453041f-b1ad-4d25-b02a-0e5c0f28504e None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:40.532812 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453041f-b1ad-4d25-b02a-0e5c0f28504e None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:40.532812 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453041f-b1ad-4d25-b02a-0e5c0f28504e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:40.589489 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-1453041f-b1ad-4d25-b02a-0e5c0f28504e None None] MFA Rules not processed for user `48c49f6751d14526a0954797d9ab6a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:40.590723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-1453041f-b1ad-4d25-b02a-0e5c0f28504e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:40.678469 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222a431-09c5-42f8-a56e-f439a89d91ca None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:40.694656 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45edfb-0a09-4d4b-9896-4d5465845a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:40.695349 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45edfb-0a09-4d4b-9896-4d5465845a86 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:40.695616 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45edfb-0a09-4d4b-9896-4d5465845a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:40.695894 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45edfb-0a09-4d4b-9896-4d5465845a86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:40.696546 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45edfb-0a09-4d4b-9896-4d5465845a86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:40.698519 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45edfb-0a09-4d4b-9896-4d5465845a86 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:40.756092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 898/1781] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Aug 30 15:59:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:40.758495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453041f-b1ad-4d25-b02a-0e5c0f28504e None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:40.816307 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 884/1782] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 15:59:40 2022] POST /identity/v3/projects => generated 373 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:40.816528 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45edfb-0a09-4d4b-9896-4d5465845a86 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:40.847434 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453041f-b1ad-4d25-b02a-0e5c0f28504e None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:40.911168 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:40.999491 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45edfb-0a09-4d4b-9896-4d5465845a86 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:41.015765 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65e4d7-ed91-415d-8f18-0ed095845c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:41.016559 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65e4d7-ed91-415d-8f18-0ed095845c1c admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:41.016975 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65e4d7-ed91-415d-8f18-0ed095845c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:41.017470 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65e4d7-ed91-415d-8f18-0ed095845c1c admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:41.018227 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65e4d7-ed91-415d-8f18-0ed095845c1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:41.020630 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65e4d7-ed91-415d-8f18-0ed095845c1c admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:41.066872 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 885/1783] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:59:40 2022] POST /identity/v3/users => generated 293 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:41.071212 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65e4d7-ed91-415d-8f18-0ed095845c1c admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:41.091418 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65e4d7-ed91-415d-8f18-0ed095845c1c admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:41.109123 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8cd9b4-0461-4a72-b3fe-a173947a457e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:41.110170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8cd9b4-0461-4a72-b3fe-a173947a457e admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:41.111178 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8cd9b4-0461-4a72-b3fe-a173947a457e admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:41.112027 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1fd8e-98ce-4ca0-98c4-657c17213bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:41.112433 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8cd9b4-0461-4a72-b3fe-a173947a457e admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:41.113214 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8cd9b4-0461-4a72-b3fe-a173947a457e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:41.114374 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1fd8e-98ce-4ca0-98c4-657c17213bd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:41.116118 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1fd8e-98ce-4ca0-98c4-657c17213bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:41.116398 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1fd8e-98ce-4ca0-98c4-657c17213bd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:41.117779 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a1fd8e-98ce-4ca0-98c4-657c17213bd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:41.118743 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8cd9b4-0461-4a72-b3fe-a173947a457e admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:41.121945 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a1fd8e-98ce-4ca0-98c4-657c17213bd4 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:41.142842 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 886/1784] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:41.142842 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8cd9b4-0461-4a72-b3fe-a173947a457e admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:41.158488 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-ce8cd9b4-0461-4a72-b3fe-a173947a457e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:41.187436 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:41.190452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8cd9b4-0461-4a72-b3fe-a173947a457e admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:41.206881 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e8ac5-a00b-4988-8890-65a3307ff158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:41.207856 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e8ac5-a00b-4988-8890-65a3307ff158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:41.208345 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e8ac5-a00b-4988-8890-65a3307ff158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:41.208873 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e8ac5-a00b-4988-8890-65a3307ff158 admin admin] PATH_INFO: `/v3/users/18288f7fea65491397b7672ddf065a7c` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:41.210612 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e8ac5-a00b-4988-8890-65a3307ff158 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18288f7fea65491397b7672ddf065a7c)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:41.214433 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e8ac5-a00b-4988-8890-65a3307ff158 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:41.230637 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 899/1785] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 15:59:40 2022] POST /identity/v3/projects => generated 381 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:41.235358 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1fd8e-98ce-4ca0-98c4-657c17213bd4 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:41.376055 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4f1e8ac5-a00b-4988-8890-65a3307ff158 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18288f7fea65491397b7672ddf065a7c'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:41.408537 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4f1e8ac5-a00b-4988-8890-65a3307ff158 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18288f7fea65491397b7672ddf065a7c'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:41.409321 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4f1e8ac5-a00b-4988-8890-65a3307ff158 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18288f7fea65491397b7672ddf065a7c'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:41.410306 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4f1e8ac5-a00b-4988-8890-65a3307ff158 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18288f7fea65491397b7672ddf065a7c'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:41.433444 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1fd8e-98ce-4ca0-98c4-657c17213bd4 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:41.434976 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4f1e8ac5-a00b-4988-8890-65a3307ff158 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18288f7fea65491397b7672ddf065a7c'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:41.454055 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b8663-5212-4168-9dc1-1f193f727ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:41.455213 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b8663-5212-4168-9dc1-1f193f727ac6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:41.455473 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b8663-5212-4168-9dc1-1f193f727ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:41.455739 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b8663-5212-4168-9dc1-1f193f727ac6 admin admin] PATH_INFO: `/v3/projects/62cc6e39134f4de0aeed0df61565b633/users/f865a81dccc2492eaf8279de40a82712/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:41.471464 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 887/1786] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 15:59:41 2022] DELETE /identity/v3/users/18288f7fea65491397b7672ddf065a7c => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:41.472334 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e8ac5-a00b-4988-8890-65a3307ff158 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:41.473707 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-4f1e8ac5-a00b-4988-8890-65a3307ff158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:41.492924 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5b8663-5212-4168-9dc1-1f193f727ac6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62cc6e39134f4de0aeed0df61565b633, user_id=f865a81dccc2492eaf8279de40a82712, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:41.500320 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5b8663-5212-4168-9dc1-1f193f727ac6 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:41.533812 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 900/1787] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:41 2022] PUT /identity/v3/projects/62cc6e39134f4de0aeed0df61565b633/users/f865a81dccc2492eaf8279de40a82712/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:41.534858 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b8663-5212-4168-9dc1-1f193f727ac6 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:41.540579 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7c5b8663-5212-4168-9dc1-1f193f727ac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:41.615232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e8ac5-a00b-4988-8890-65a3307ff158 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:41.641240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b8663-5212-4168-9dc1-1f193f727ac6 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:41.657105 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453e237-22de-4521-ba1c-f2ab3456a856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:41.657739 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453e237-22de-4521-ba1c-f2ab3456a856 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:41.658004 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453e237-22de-4521-ba1c-f2ab3456a856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:41.658272 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453e237-22de-4521-ba1c-f2ab3456a856 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:41.659085 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1453e237-22de-4521-ba1c-f2ab3456a856 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:41.663306 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1453e237-22de-4521-ba1c-f2ab3456a856 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:41.742221 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:41.752072 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 901/1788] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:59:41 2022] POST /identity/v3/users => generated 297 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:41.752072 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d984c9c-5db5-4dbf-b1e7-36528cc4cefe None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:41.752072 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d984c9c-5db5-4dbf-b1e7-36528cc4cefe None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:41.752072 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d984c9c-5db5-4dbf-b1e7-36528cc4cefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:41.791665 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb013fa-5859-42e5-beaa-6e161719b66f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:41.792439 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb013fa-5859-42e5-beaa-6e161719b66f service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:41.792843 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb013fa-5859-42e5-beaa-6e161719b66f service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:41.793299 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb013fa-5859-42e5-beaa-6e161719b66f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:41.816202 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-ebb013fa-5859-42e5-beaa-6e161719b66f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:41.829995 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-2d984c9c-5db5-4dbf-b1e7-36528cc4cefe None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:41.837184 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-2d984c9c-5db5-4dbf-b1e7-36528cc4cefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:41.851204 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb013fa-5859-42e5-beaa-6e161719b66f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:41.859316 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb013fa-5859-42e5-beaa-6e161719b66f service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:41.882548 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 902/1789] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:41.882548 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d984c9c-5db5-4dbf-b1e7-36528cc4cefe None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:41.882825 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 888/1790] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:41.883132 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17bb93-8037-4812-9163-49f74433f04b None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:41.883510 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17bb93-8037-4812-9163-49f74433f04b None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:41.883874 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17bb93-8037-4812-9163-49f74433f04b None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:41.885680 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-2d984c9c-5db5-4dbf-b1e7-36528cc4cefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:41.889396 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 889/1791] 10.222.0.25 () {54 vars in 921 bytes} [Tue Aug 30 15:59:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:59:41.891628 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17bb93-8037-4812-9163-49f74433f04b None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:41.922445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17bb93-8037-4812-9163-49f74433f04b None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:41.925816 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d984c9c-5db5-4dbf-b1e7-36528cc4cefe None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:41.935951 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98fb294-8613-463f-9338-c96345d231a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:41.938817 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fb294-8613-463f-9338-c96345d231a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:41.939331 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fb294-8613-463f-9338-c96345d231a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:41.939829 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fb294-8613-463f-9338-c96345d231a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:41.940900 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98fb294-8613-463f-9338-c96345d231a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:41.943256 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98fb294-8613-463f-9338-c96345d231a6 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:41.951341 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f58202-75f4-41b6-927b-2820913d0ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:41.951986 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f58202-75f4-41b6-927b-2820913d0ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:41.954611 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f58202-75f4-41b6-927b-2820913d0ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:41.957370 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f58202-75f4-41b6-927b-2820913d0ee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:41.958106 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f58202-75f4-41b6-927b-2820913d0ee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:41.959736 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f58202-75f4-41b6-927b-2820913d0ee2 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:41.962684 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 890/1792] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:41.964718 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98fb294-8613-463f-9338-c96345d231a6 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:41.968640 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-b98fb294-8613-463f-9338-c96345d231a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:41.985403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98fb294-8613-463f-9338-c96345d231a6 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:41.991241 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677bc8f-1f3d-45d2-b58f-a2d296831a00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:41.992126 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677bc8f-1f3d-45d2-b58f-a2d296831a00 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:41.992502 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677bc8f-1f3d-45d2-b58f-a2d296831a00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:41.996970 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677bc8f-1f3d-45d2-b58f-a2d296831a00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:42.022527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 903/1793] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:42.023878 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3f2d3-a814-46f7-93e3-5235febdd1cd None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:42.026996 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8677bc8f-1f3d-45d2-b58f-a2d296831a00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:42.028483 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8677bc8f-1f3d-45d2-b58f-a2d296831a00 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:42.041276 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3f2d3-a814-46f7-93e3-5235febdd1cd None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:42.041582 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3f2d3-a814-46f7-93e3-5235febdd1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:42.080324 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 891/1794] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:42.082488 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677bc8f-1f3d-45d2-b58f-a2d296831a00 service neutron] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:42.093988 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-44d3f2d3-a814-46f7-93e3-5235febdd1cd None None] MFA Rules not processed for user `ebc80bf891614fb895af33ca1ded6b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:42.095669 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-44d3f2d3-a814-46f7-93e3-5235febdd1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:42.133240 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677bc8f-1f3d-45d2-b58f-a2d296831a00 service neutron] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:42.162022 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab84ab-6a5c-4a69-ae4d-0f1925ccf601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:42.164921 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab84ab-6a5c-4a69-ae4d-0f1925ccf601 admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:42.166618 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab84ab-6a5c-4a69-ae4d-0f1925ccf601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:42.167091 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab84ab-6a5c-4a69-ae4d-0f1925ccf601 admin admin] PATH_INFO: `/v3/projects/ac0403aaf82849598b3ed62e4446426c/users/d1175bf6d64f4587825650298a6ed927/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:42.245806 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:42.312432 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 904/1795] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Aug 30 15:59:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:42.313983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d3f2d3-a814-46f7-93e3-5235febdd1cd None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:42.324494 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab84ab-6a5c-4a69-ae4d-0f1925ccf601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac0403aaf82849598b3ed62e4446426c, user_id=d1175bf6d64f4587825650298a6ed927, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:42.329127 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab84ab-6a5c-4a69-ae4d-0f1925ccf601 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:42.360213 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 892/1796] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:42 2022] PUT /identity/v3/projects/ac0403aaf82849598b3ed62e4446426c/users/d1175bf6d64f4587825650298a6ed927/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:42.363269 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab84ab-6a5c-4a69-ae4d-0f1925ccf601 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:42.430579 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d3f2d3-a814-46f7-93e3-5235febdd1cd None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:42.673879 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab84ab-6a5c-4a69-ae4d-0f1925ccf601 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:42.683921 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b0cb2-562f-4f2c-995d-a3be803b419b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:42.685600 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b0cb2-562f-4f2c-995d-a3be803b419b admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:42.686173 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b0cb2-562f-4f2c-995d-a3be803b419b admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:42.686950 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b0cb2-562f-4f2c-995d-a3be803b419b admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:42.689158 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b0cb2-562f-4f2c-995d-a3be803b419b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:42.690989 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b0cb2-562f-4f2c-995d-a3be803b419b admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:42.706400 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 893/1797] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:42.708320 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42681911-7610-469a-bdb7-091b9c0f94b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:42.709374 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42681911-7610-469a-bdb7-091b9c0f94b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:42.709947 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42681911-7610-469a-bdb7-091b9c0f94b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:42.710494 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42681911-7610-469a-bdb7-091b9c0f94b4 admin admin] PATH_INFO: `/v3/projects/62cc6e39134f4de0aeed0df61565b633/users/f865a81dccc2492eaf8279de40a82712/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:42.714106 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b0cb2-562f-4f2c-995d-a3be803b419b admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:42.716987 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42681911-7610-469a-bdb7-091b9c0f94b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62cc6e39134f4de0aeed0df61565b633, user_id=f865a81dccc2492eaf8279de40a82712, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:42.721209 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42681911-7610-469a-bdb7-091b9c0f94b4 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:42.726589 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b0cb2-562f-4f2c-995d-a3be803b419b admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:42.732064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a000f-2032-46aa-969b-f3a9df50c22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:42.732674 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a000f-2032-46aa-969b-f3a9df50c22d admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:42.733072 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a000f-2032-46aa-969b-f3a9df50c22d admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:42.733414 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a000f-2032-46aa-969b-f3a9df50c22d admin admin] PATH_INFO: `/v3/projects/ac0403aaf82849598b3ed62e4446426c/users/d1175bf6d64f4587825650298a6ed927/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:42.735936 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a000f-2032-46aa-969b-f3a9df50c22d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac0403aaf82849598b3ed62e4446426c, user_id=d1175bf6d64f4587825650298a6ed927, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:42.737036 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 905/1798] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:42 2022] PUT /identity/v3/projects/62cc6e39134f4de0aeed0df61565b633/users/f865a81dccc2492eaf8279de40a82712/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:42.748049 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3630f-1c68-4344-b497-c29651017b36 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:42.750436 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a000f-2032-46aa-969b-f3a9df50c22d admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:42.750929 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3630f-1c68-4344-b497-c29651017b36 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:42.751352 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3630f-1c68-4344-b497-c29651017b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:42.772747 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 894/1799] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:42 2022] PUT /identity/v3/projects/ac0403aaf82849598b3ed62e4446426c/users/d1175bf6d64f4587825650298a6ed927/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:42.783192 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725686da-f1a1-49bc-b513-62ba853941f3 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:42.784306 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725686da-f1a1-49bc-b513-62ba853941f3 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:42.784306 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725686da-f1a1-49bc-b513-62ba853941f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:42.816702 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-06b3630f-1c68-4344-b497-c29651017b36 None None] MFA Rules not processed for user `f865a81dccc2492eaf8279de40a82712`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:42.818677 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-06b3630f-1c68-4344-b497-c29651017b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:42.825451 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-725686da-f1a1-49bc-b513-62ba853941f3 None None] MFA Rules not processed for user `d1175bf6d64f4587825650298a6ed927`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:42.827161 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-725686da-f1a1-49bc-b513-62ba853941f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:42.909443 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:42.933927 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 895/1800] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:42 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:42.937632 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 906/1801] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:42 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:42.967552 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725686da-f1a1-49bc-b513-62ba853941f3 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:42.974283 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-725686da-f1a1-49bc-b513-62ba853941f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:42.976601 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b3630f-1c68-4344-b497-c29651017b36 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:42.980956 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-06b3630f-1c68-4344-b497-c29651017b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:43.132305 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b3630f-1c68-4344-b497-c29651017b36 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:43.144215 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc7da1-9832-407c-8e45-93e8f6eb297a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:43.145029 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc7da1-9832-407c-8e45-93e8f6eb297a service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:43.145404 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc7da1-9832-407c-8e45-93e8f6eb297a service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:43.145789 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc7da1-9832-407c-8e45-93e8f6eb297a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:43.160261 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725686da-f1a1-49bc-b513-62ba853941f3 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:43.167154 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc7da1-9832-407c-8e45-93e8f6eb297a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:43.169684 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc7da1-9832-407c-8e45-93e8f6eb297a service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:43.184329 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a100a-bc3b-4098-baf7-3ca1950cbd3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:43.185467 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a100a-bc3b-4098-baf7-3ca1950cbd3a service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:43.190374 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a100a-bc3b-4098-baf7-3ca1950cbd3a service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:43.191240 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a100a-bc3b-4098-baf7-3ca1950cbd3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:43.195553 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 907/1802] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:43.261241 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a100a-bc3b-4098-baf7-3ca1950cbd3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:43.269657 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a100a-bc3b-4098-baf7-3ca1950cbd3a service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:43.308975 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 896/1803] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:42 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:43.630015 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc7da1-9832-407c-8e45-93e8f6eb297a service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:43.631953 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-98cc7da1-9832-407c-8e45-93e8f6eb297a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:43.637844 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:43.885801 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc7da1-9832-407c-8e45-93e8f6eb297a service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:43.929799 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58cb600-4c32-4a10-8bf2-a029c38cdec0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:43.935766 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cb600-4c32-4a10-8bf2-a029c38cdec0 service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:43.936093 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cb600-4c32-4a10-8bf2-a029c38cdec0 service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:43.936433 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cb600-4c32-4a10-8bf2-a029c38cdec0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:43.963219 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58cb600-4c32-4a10-8bf2-a029c38cdec0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:43.973044 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58cb600-4c32-4a10-8bf2-a029c38cdec0 service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:44.073989 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 908/1804] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:44.418924 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a100a-bc3b-4098-baf7-3ca1950cbd3a service cinder] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:44.421908 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-734a100a-bc3b-4098-baf7-3ca1950cbd3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:44.591251 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b0653-0538-4a22-aa7a-1eca0f5f904d None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:44.591537 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b0653-0538-4a22-aa7a-1eca0f5f904d None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:44.591819 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b0653-0538-4a22-aa7a-1eca0f5f904d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:44.709121 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-156b0653-0538-4a22-aa7a-1eca0f5f904d None None] MFA Rules not processed for user `f37871115df84d508aa19d9d3cc3ab1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:44.710553 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-156b0653-0538-4a22-aa7a-1eca0f5f904d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:44.816908 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a100a-bc3b-4098-baf7-3ca1950cbd3a service cinder] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:44.829194 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b5150-b490-45b4-b666-b7032f9033af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:44.832126 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b5150-b490-45b4-b666-b7032f9033af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:44.832428 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b5150-b490-45b4-b666-b7032f9033af admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:44.832923 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b5150-b490-45b4-b666-b7032f9033af admin admin] PATH_INFO: `/v3/projects/ea18bc77f1e74cc6be98d8a1395500e3` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:44.850064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b5150-b490-45b4-b666-b7032f9033af admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea18bc77f1e74cc6be98d8a1395500e3)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:44.852335 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b5150-b490-45b4-b666-b7032f9033af admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:45.041570 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-454b5150-b490-45b4-b666-b7032f9033af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea18bc77f1e74cc6be98d8a1395500e3', 'request_id': 'req-454b5150-b490-45b4-b666-b7032f9033af'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:45.045336 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 909/1805] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:44 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:45.046815 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b0653-0538-4a22-aa7a-1eca0f5f904d None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:45.067558 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-454b5150-b490-45b4-b666-b7032f9033af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea18bc77f1e74cc6be98d8a1395500e3', 'request_id': 'req-454b5150-b490-45b4-b666-b7032f9033af'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:45.072338 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b0653-0538-4a22-aa7a-1eca0f5f904d None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:45.101305 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-454b5150-b490-45b4-b666-b7032f9033af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea18bc77f1e74cc6be98d8a1395500e3', 'request_id': 'req-454b5150-b490-45b4-b666-b7032f9033af'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:45.142302 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-454b5150-b490-45b4-b666-b7032f9033af admin admin] The token cache is being invalidate because project ea18bc77f1e74cc6be98d8a1395500e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:59:45.143407 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-454b5150-b490-45b4-b666-b7032f9033af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:45.149316 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-454b5150-b490-45b4-b666-b7032f9033af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:45.154415 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 897/1806] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 15:59:44 2022] DELETE /identity/v3/projects/ea18bc77f1e74cc6be98d8a1395500e3 => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:45.155653 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b5150-b490-45b4-b666-b7032f9033af admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:45.161666 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-454b5150-b490-45b4-b666-b7032f9033af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:45.236832 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae63e0-2688-4693-960e-710f622445a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:45.237536 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae63e0-2688-4693-960e-710f622445a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:45.237824 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae63e0-2688-4693-960e-710f622445a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:45.238162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae63e0-2688-4693-960e-710f622445a3 admin admin] PATH_INFO: `/v3/users/6a5a671d6fb24029942f4fd3cbabe1a5` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:45.240081 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae63e0-2688-4693-960e-710f622445a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a5a671d6fb24029942f4fd3cbabe1a5)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:45.243938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae63e0-2688-4693-960e-710f622445a3 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:45.248505 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:45.289315 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:45.395811 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-25ae63e0-2688-4693-960e-710f622445a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a5a671d6fb24029942f4fd3cbabe1a5'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:45.397480 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-25ae63e0-2688-4693-960e-710f622445a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a5a671d6fb24029942f4fd3cbabe1a5'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:45.413533 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b5150-b490-45b4-b666-b7032f9033af admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:45.414431 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-25ae63e0-2688-4693-960e-710f622445a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a5a671d6fb24029942f4fd3cbabe1a5'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:45.442683 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33ad6e-3ecb-485f-a12d-4902d47e80a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:45.443346 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33ad6e-3ecb-485f-a12d-4902d47e80a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:45.443626 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33ad6e-3ecb-485f-a12d-4902d47e80a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:45.443896 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33ad6e-3ecb-485f-a12d-4902d47e80a7 admin admin] PATH_INFO: `/v3/users/527f76e1f2f247919b671fc6da3724c5` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:45.446321 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de33ad6e-3ecb-485f-a12d-4902d47e80a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=527f76e1f2f247919b671fc6da3724c5)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:45.448279 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de33ad6e-3ecb-485f-a12d-4902d47e80a7 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:45.454778 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-25ae63e0-2688-4693-960e-710f622445a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a5a671d6fb24029942f4fd3cbabe1a5'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:45.470969 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-25ae63e0-2688-4693-960e-710f622445a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a5a671d6fb24029942f4fd3cbabe1a5'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:45.494470 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 910/1807] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 15:59:45 2022] DELETE /identity/v3/users/6a5a671d6fb24029942f4fd3cbabe1a5 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:45.494470 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae63e0-2688-4693-960e-710f622445a3 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:45.495097 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-25ae63e0-2688-4693-960e-710f622445a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:45.611900 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-de33ad6e-3ecb-485f-a12d-4902d47e80a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '527f76e1f2f247919b671fc6da3724c5'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:45.650900 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-de33ad6e-3ecb-485f-a12d-4902d47e80a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '527f76e1f2f247919b671fc6da3724c5'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:45.652695 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-de33ad6e-3ecb-485f-a12d-4902d47e80a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '527f76e1f2f247919b671fc6da3724c5'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:45.665329 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-de33ad6e-3ecb-485f-a12d-4902d47e80a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '527f76e1f2f247919b671fc6da3724c5'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:45.688674 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-de33ad6e-3ecb-485f-a12d-4902d47e80a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '527f76e1f2f247919b671fc6da3724c5'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:45.740665 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 898/1808] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 15:59:45 2022] DELETE /identity/v3/users/527f76e1f2f247919b671fc6da3724c5 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:45.745810 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2906a-60c2-402e-b948-ac5ca781dcbc None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:45.746126 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2906a-60c2-402e-b948-ac5ca781dcbc None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:45.746594 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2906a-60c2-402e-b948-ac5ca781dcbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:45.757480 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae63e0-2688-4693-960e-710f622445a3 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:45.806356 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-ffa2906a-60c2-402e-b948-ac5ca781dcbc None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:45.808155 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-ffa2906a-60c2-402e-b948-ac5ca781dcbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:45.957750 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9b094-6b84-4008-87bd-2873fa986ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:45.958655 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9b094-6b84-4008-87bd-2873fa986ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:45.959147 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9b094-6b84-4008-87bd-2873fa986ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:45.959612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9b094-6b84-4008-87bd-2873fa986ca5 admin admin] PATH_INFO: `/v3/users/75ace991682743d0ae2adaf18d95a3c4` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:45.966785 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb9b094-6b84-4008-87bd-2873fa986ca5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75ace991682743d0ae2adaf18d95a3c4)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:45.981299 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb9b094-6b84-4008-87bd-2873fa986ca5 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:46.135353 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:46.144488 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 899/1809] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:46.154675 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759cde8-fe6e-4431-b684-cdced91fab36 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:46.155029 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759cde8-fe6e-4431-b684-cdced91fab36 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:46.155834 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759cde8-fe6e-4431-b684-cdced91fab36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:46.173939 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6bb9b094-6b84-4008-87bd-2873fa986ca5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75ace991682743d0ae2adaf18d95a3c4'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:46.174977 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6bb9b094-6b84-4008-87bd-2873fa986ca5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75ace991682743d0ae2adaf18d95a3c4'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:46.196189 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6bb9b094-6b84-4008-87bd-2873fa986ca5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75ace991682743d0ae2adaf18d95a3c4'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:46.235384 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6bb9b094-6b84-4008-87bd-2873fa986ca5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75ace991682743d0ae2adaf18d95a3c4'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:46.245888 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-9759cde8-fe6e-4431-b684-cdced91fab36 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:46.252271 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-9759cde8-fe6e-4431-b684-cdced91fab36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:46.252808 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6bb9b094-6b84-4008-87bd-2873fa986ca5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75ace991682743d0ae2adaf18d95a3c4'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:46.270416 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 900/1810] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:46.271315 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759cde8-fe6e-4431-b684-cdced91fab36 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:46.271992 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 911/1811] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 15:59:45 2022] DELETE /identity/v3/users/75ace991682743d0ae2adaf18d95a3c4 => generated 0 bytes in 780 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:46.278443 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-9759cde8-fe6e-4431-b684-cdced91fab36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:46.334714 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9b094-6b84-4008-87bd-2873fa986ca5 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:46.336511 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-6bb9b094-6b84-4008-87bd-2873fa986ca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:46.390463 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:46.437531 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759cde8-fe6e-4431-b684-cdced91fab36 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:46.498675 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9b094-6b84-4008-87bd-2873fa986ca5 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:46.525658 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a07c7-4639-4708-ac2b-955b14534b1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:46.526468 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a07c7-4639-4708-ac2b-955b14534b1a service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:46.526864 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a07c7-4639-4708-ac2b-955b14534b1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:46.527226 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a07c7-4639-4708-ac2b-955b14534b1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:46.549133 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b4594-bf21-430c-b688-c94eb69f2d22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:46.549925 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b4594-bf21-430c-b688-c94eb69f2d22 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:46.550303 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b4594-bf21-430c-b688-c94eb69f2d22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:46.550667 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b4594-bf21-430c-b688-c94eb69f2d22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:46.552931 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-674b4594-bf21-430c-b688-c94eb69f2d22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:46.747346 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a07c7-4639-4708-ac2b-955b14534b1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:46.755947 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a07c7-4639-4708-ac2b-955b14534b1a service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:46.771810 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b4594-bf21-430c-b688-c94eb69f2d22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:46.775438 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b4594-bf21-430c-b688-c94eb69f2d22 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:46.794523 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 912/1812] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:59:46.810468 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 901/1813] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:48.029981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a07c7-4639-4708-ac2b-955b14534b1a service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:48.032293 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-4e9a07c7-4639-4708-ac2b-955b14534b1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:48.056853 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a07c7-4639-4708-ac2b-955b14534b1a service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:48.064137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b4594-bf21-430c-b688-c94eb69f2d22 service neutron] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:48.065694 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-674b4594-bf21-430c-b688-c94eb69f2d22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:48.088601 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a42b48-a0ca-4518-b26d-712bfbe1d433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:48.090890 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a42b48-a0ca-4518-b26d-712bfbe1d433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:48.091325 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a42b48-a0ca-4518-b26d-712bfbe1d433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:48.091747 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a42b48-a0ca-4518-b26d-712bfbe1d433 admin admin] PATH_INFO: `/v3/projects/ab6244076bc348fc8c7c998b8437c50e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:48.097260 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a42b48-a0ca-4518-b26d-712bfbe1d433 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab6244076bc348fc8c7c998b8437c50e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:48.097827 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b4594-bf21-430c-b688-c94eb69f2d22 service neutron] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:48.105978 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a42b48-a0ca-4518-b26d-712bfbe1d433 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:48.112918 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771837f5-9908-44c4-b438-1123a4524ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:48.113821 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771837f5-9908-44c4-b438-1123a4524ac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:48.114138 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771837f5-9908-44c4-b438-1123a4524ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:48.114402 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771837f5-9908-44c4-b438-1123a4524ac4 admin admin] PATH_INFO: `/v3/projects/94b04c4d5abd4958905a2455cd8998a9` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:48.121667 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771837f5-9908-44c4-b438-1123a4524ac4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94b04c4d5abd4958905a2455cd8998a9)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:48.123638 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771837f5-9908-44c4-b438-1123a4524ac4 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:48.282742 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-771837f5-9908-44c4-b438-1123a4524ac4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94b04c4d5abd4958905a2455cd8998a9', 'request_id': 'req-771837f5-9908-44c4-b438-1123a4524ac4'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:48.304536 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-771837f5-9908-44c4-b438-1123a4524ac4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94b04c4d5abd4958905a2455cd8998a9', 'request_id': 'req-771837f5-9908-44c4-b438-1123a4524ac4'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:48.308190 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-60a42b48-a0ca-4518-b26d-712bfbe1d433 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab6244076bc348fc8c7c998b8437c50e', 'request_id': 'req-60a42b48-a0ca-4518-b26d-712bfbe1d433'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:48.322856 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-771837f5-9908-44c4-b438-1123a4524ac4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94b04c4d5abd4958905a2455cd8998a9', 'request_id': 'req-771837f5-9908-44c4-b438-1123a4524ac4'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:48.332057 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-60a42b48-a0ca-4518-b26d-712bfbe1d433 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab6244076bc348fc8c7c998b8437c50e', 'request_id': 'req-60a42b48-a0ca-4518-b26d-712bfbe1d433'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:48.351810 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-60a42b48-a0ca-4518-b26d-712bfbe1d433 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab6244076bc348fc8c7c998b8437c50e', 'request_id': 'req-60a42b48-a0ca-4518-b26d-712bfbe1d433'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:48.359383 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:48.362405 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-771837f5-9908-44c4-b438-1123a4524ac4 admin admin] The token cache is being invalidate because project 94b04c4d5abd4958905a2455cd8998a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:59:48.364691 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-771837f5-9908-44c4-b438-1123a4524ac4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:48.367028 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-771837f5-9908-44c4-b438-1123a4524ac4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:48.376672 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 902/1814] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 15:59:48 2022] DELETE /identity/v3/projects/94b04c4d5abd4958905a2455cd8998a9 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:48.382547 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b6745-f7ed-4af2-b83a-d573d8dcdf62 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:48.383293 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b6745-f7ed-4af2-b83a-d573d8dcdf62 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:48.383848 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b6745-f7ed-4af2-b83a-d573d8dcdf62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:48.394853 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-60a42b48-a0ca-4518-b26d-712bfbe1d433 admin admin] The token cache is being invalidate because project ab6244076bc348fc8c7c998b8437c50e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:59:48.395856 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-60a42b48-a0ca-4518-b26d-712bfbe1d433 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:48.397090 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-60a42b48-a0ca-4518-b26d-712bfbe1d433 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:48.403216 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 913/1815] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 15:59:48 2022] DELETE /identity/v3/projects/ab6244076bc348fc8c7c998b8437c50e => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:48.415125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a42b48-a0ca-4518-b26d-712bfbe1d433 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:48.415125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-60a42b48-a0ca-4518-b26d-712bfbe1d433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:48.455146 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-ba2b6745-f7ed-4af2-b83a-d573d8dcdf62 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:48.462230 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-ba2b6745-f7ed-4af2-b83a-d573d8dcdf62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:48.556348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:48.669968 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a42b48-a0ca-4518-b26d-712bfbe1d433 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:48.684690 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e34298-4bed-436d-a9fd-1cdab983e731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:48.687262 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e34298-4bed-436d-a9fd-1cdab983e731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:48.687674 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e34298-4bed-436d-a9fd-1cdab983e731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:48.689695 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e34298-4bed-436d-a9fd-1cdab983e731 admin admin] PATH_INFO: `/v3/users/d1175bf6d64f4587825650298a6ed927` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:48.701587 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e34298-4bed-436d-a9fd-1cdab983e731 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1175bf6d64f4587825650298a6ed927)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:48.704579 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e34298-4bed-436d-a9fd-1cdab983e731 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:48.709199 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 903/1816] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:48.720133 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597687f7-7809-435a-8032-0a35a31081e8 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:48.720977 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597687f7-7809-435a-8032-0a35a31081e8 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:48.722124 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597687f7-7809-435a-8032-0a35a31081e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:48.786347 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-597687f7-7809-435a-8032-0a35a31081e8 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:48.793036 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-597687f7-7809-435a-8032-0a35a31081e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:48.831045 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 904/1817] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:48.842209 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597687f7-7809-435a-8032-0a35a31081e8 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:48.847517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-597687f7-7809-435a-8032-0a35a31081e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:48.866706 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-83e34298-4bed-436d-a9fd-1cdab983e731 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1175bf6d64f4587825650298a6ed927'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:48.868146 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-83e34298-4bed-436d-a9fd-1cdab983e731 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1175bf6d64f4587825650298a6ed927'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:48.910749 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597687f7-7809-435a-8032-0a35a31081e8 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:48.913820 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-83e34298-4bed-436d-a9fd-1cdab983e731 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1175bf6d64f4587825650298a6ed927'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:48.932707 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1142379-986e-48f2-a499-621fdef39a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:48.933407 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1142379-986e-48f2-a499-621fdef39a06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:48.933693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1142379-986e-48f2-a499-621fdef39a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:48.939047 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1142379-986e-48f2-a499-621fdef39a06 admin admin] PATH_INFO: `/v3/projects/097bca80282747ce95e61b2ca0950608` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:48.948055 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1142379-986e-48f2-a499-621fdef39a06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=097bca80282747ce95e61b2ca0950608)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:48.950349 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1142379-986e-48f2-a499-621fdef39a06 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:48.962616 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-83e34298-4bed-436d-a9fd-1cdab983e731 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1175bf6d64f4587825650298a6ed927'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:48.984524 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-83e34298-4bed-436d-a9fd-1cdab983e731 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1175bf6d64f4587825650298a6ed927'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:49.001976 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 914/1818] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 15:59:48 2022] DELETE /identity/v3/users/d1175bf6d64f4587825650298a6ed927 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:49.005366 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e34298-4bed-436d-a9fd-1cdab983e731 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:49.008432 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-83e34298-4bed-436d-a9fd-1cdab983e731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:49.154777 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-e1142379-986e-48f2-a499-621fdef39a06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '097bca80282747ce95e61b2ca0950608', 'request_id': 'req-e1142379-986e-48f2-a499-621fdef39a06'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:49.178368 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-e1142379-986e-48f2-a499-621fdef39a06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '097bca80282747ce95e61b2ca0950608', 'request_id': 'req-e1142379-986e-48f2-a499-621fdef39a06'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:49.196942 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-e1142379-986e-48f2-a499-621fdef39a06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '097bca80282747ce95e61b2ca0950608', 'request_id': 'req-e1142379-986e-48f2-a499-621fdef39a06'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:49.231760 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-e1142379-986e-48f2-a499-621fdef39a06 admin admin] The token cache is being invalidate because project 097bca80282747ce95e61b2ca0950608 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:59:49.232207 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-e1142379-986e-48f2-a499-621fdef39a06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:49.233159 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-e1142379-986e-48f2-a499-621fdef39a06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:49.235951 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 905/1819] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 15:59:48 2022] DELETE /identity/v3/projects/097bca80282747ce95e61b2ca0950608 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:49.236876 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1142379-986e-48f2-a499-621fdef39a06 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:49.240162 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-e1142379-986e-48f2-a499-621fdef39a06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:49.257812 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e34298-4bed-436d-a9fd-1cdab983e731 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:49.303774 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:49.414161 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1142379-986e-48f2-a499-621fdef39a06 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:49.434947 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13757d-6062-40b1-855b-852464a58469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:49.435854 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13757d-6062-40b1-855b-852464a58469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:49.436267 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13757d-6062-40b1-855b-852464a58469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:49.436682 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13757d-6062-40b1-855b-852464a58469 admin admin] PATH_INFO: `/v3/users/19de81bebf364f2989e139c9f424d623` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:49.438859 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb13757d-6062-40b1-855b-852464a58469 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19de81bebf364f2989e139c9f424d623)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:49.441017 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb13757d-6062-40b1-855b-852464a58469 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:49.442787 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f0170-19fc-4f5b-8251-988b5574b5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:49.443816 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f0170-19fc-4f5b-8251-988b5574b5aa admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:49.444096 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f0170-19fc-4f5b-8251-988b5574b5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:49.444362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f0170-19fc-4f5b-8251-988b5574b5aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:49.445076 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973f0170-19fc-4f5b-8251-988b5574b5aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:59:49.445372 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973f0170-19fc-4f5b-8251-988b5574b5aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:49.447678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973f0170-19fc-4f5b-8251-988b5574b5aa admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:49.476002 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 915/1820] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 15:59:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 470 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:59:49.476002 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f0170-19fc-4f5b-8251-988b5574b5aa admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:49.484477 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-973f0170-19fc-4f5b-8251-988b5574b5aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:49.517556 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f0170-19fc-4f5b-8251-988b5574b5aa admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:49.531071 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbd062-3c90-43aa-a191-6879cc5afa6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:49.531672 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbd062-3c90-43aa-a191-6879cc5afa6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:49.531936 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbd062-3c90-43aa-a191-6879cc5afa6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:49.532202 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbd062-3c90-43aa-a191-6879cc5afa6e admin admin] PATH_INFO: `/v3/users/f865a81dccc2492eaf8279de40a82712` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:49.534123 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adbd062-3c90-43aa-a191-6879cc5afa6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f865a81dccc2492eaf8279de40a82712)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:49.540815 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adbd062-3c90-43aa-a191-6879cc5afa6e admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:49.600384 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:49.605452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-cb13757d-6062-40b1-855b-852464a58469 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19de81bebf364f2989e139c9f424d623'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:49.645096 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-cb13757d-6062-40b1-855b-852464a58469 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19de81bebf364f2989e139c9f424d623'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:49.646501 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-cb13757d-6062-40b1-855b-852464a58469 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19de81bebf364f2989e139c9f424d623'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:49.651053 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-cb13757d-6062-40b1-855b-852464a58469 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19de81bebf364f2989e139c9f424d623'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:49.668189 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-cb13757d-6062-40b1-855b-852464a58469 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19de81bebf364f2989e139c9f424d623'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:49.670011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2adbd062-3c90-43aa-a191-6879cc5afa6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f865a81dccc2492eaf8279de40a82712'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:49.672969 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2adbd062-3c90-43aa-a191-6879cc5afa6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f865a81dccc2492eaf8279de40a82712'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:49.684701 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2adbd062-3c90-43aa-a191-6879cc5afa6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f865a81dccc2492eaf8279de40a82712'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:49.703968 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2adbd062-3c90-43aa-a191-6879cc5afa6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f865a81dccc2492eaf8279de40a82712'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:49.709593 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 906/1821] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 15:59:49 2022] DELETE /identity/v3/users/19de81bebf364f2989e139c9f424d623 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:49.712601 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13757d-6062-40b1-855b-852464a58469 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:49.719365 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-cb13757d-6062-40b1-855b-852464a58469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:49.723176 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2adbd062-3c90-43aa-a191-6879cc5afa6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f865a81dccc2492eaf8279de40a82712'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:49.741387 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 916/1822] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 15:59:49 2022] DELETE /identity/v3/users/f865a81dccc2492eaf8279de40a82712 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:49.745071 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bfef02-9fc8-4d97-92ae-2d9e263b1851 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:49.745424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bfef02-9fc8-4d97-92ae-2d9e263b1851 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:49.745707 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bfef02-9fc8-4d97-92ae-2d9e263b1851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:49.800737 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-34bfef02-9fc8-4d97-92ae-2d9e263b1851 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:49.805372 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-34bfef02-9fc8-4d97-92ae-2d9e263b1851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:49.846822 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13757d-6062-40b1-855b-852464a58469 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:50.011836 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a1751-0d9c-4bb9-bb83-5e00a0e0d885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:50.012353 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a1751-0d9c-4bb9-bb83-5e00a0e0d885 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:50.012635 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a1751-0d9c-4bb9-bb83-5e00a0e0d885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:50.012941 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a1751-0d9c-4bb9-bb83-5e00a0e0d885 admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:50.013591 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a1751-0d9c-4bb9-bb83-5e00a0e0d885 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:50.015945 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a1751-0d9c-4bb9-bb83-5e00a0e0d885 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:50.023315 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 917/1823] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:50.066328 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 907/1824] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 15:59:49 2022] POST /identity/v3/projects => generated 385 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:50.070951 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bfef02-9fc8-4d97-92ae-2d9e263b1851 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:50.072502 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-34bfef02-9fc8-4d97-92ae-2d9e263b1851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:50.089474 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a1751-0d9c-4bb9-bb83-5e00a0e0d885 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:50.096033 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-206a1751-0d9c-4bb9-bb83-5e00a0e0d885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:50.113961 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bfef02-9fc8-4d97-92ae-2d9e263b1851 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:50.170051 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:50.261205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a5afb-1377-4b68-aa0f-4d9eccbe7c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:50.265209 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a5afb-1377-4b68-aa0f-4d9eccbe7c75 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:50.265715 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a5afb-1377-4b68-aa0f-4d9eccbe7c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:50.266271 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a5afb-1377-4b68-aa0f-4d9eccbe7c75 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:50.269375 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a5afb-1377-4b68-aa0f-4d9eccbe7c75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:50.274022 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a5afb-1377-4b68-aa0f-4d9eccbe7c75 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:50.294170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a1751-0d9c-4bb9-bb83-5e00a0e0d885 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:50.301826 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b30009-4180-4196-aece-f58ca9ef2e03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:50.304173 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b30009-4180-4196-aece-f58ca9ef2e03 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:50.304173 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b30009-4180-4196-aece-f58ca9ef2e03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:50.304372 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b30009-4180-4196-aece-f58ca9ef2e03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:50.320422 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 918/1825] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:59:50 2022] POST /identity/v3/users => generated 293 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:59:50.324248 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a5afb-1377-4b68-aa0f-4d9eccbe7c75 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:50.354423 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b30009-4180-4196-aece-f58ca9ef2e03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:50.355970 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b30009-4180-4196-aece-f58ca9ef2e03 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:50.357544 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a5afb-1377-4b68-aa0f-4d9eccbe7c75 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:50.368104 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:50.369810 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11838446-fb4b-4a46-8cad-93052c74539d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:50.371315 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11838446-fb4b-4a46-8cad-93052c74539d admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:50.372314 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11838446-fb4b-4a46-8cad-93052c74539d admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:50.372662 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11838446-fb4b-4a46-8cad-93052c74539d admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:50.375086 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11838446-fb4b-4a46-8cad-93052c74539d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:50.381051 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11838446-fb4b-4a46-8cad-93052c74539d admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:50.397470 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 908/1826] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:59:50.426893 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 919/1827] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 15:59:50.430733 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b30009-4180-4196-aece-f58ca9ef2e03 service neutron] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:50.449009 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b30009-4180-4196-aece-f58ca9ef2e03 service neutron] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:50.503901 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10c27b-a263-4056-ad36-9d1dbca73326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:50.505673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10c27b-a263-4056-ad36-9d1dbca73326 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:50.506234 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10c27b-a263-4056-ad36-9d1dbca73326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:50.506511 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10c27b-a263-4056-ad36-9d1dbca73326 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:50.507176 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10c27b-a263-4056-ad36-9d1dbca73326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:50.515404 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10c27b-a263-4056-ad36-9d1dbca73326 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:50.559628 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 909/1828] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:50.565763 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11838446-fb4b-4a46-8cad-93052c74539d admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:50.590063 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11838446-fb4b-4a46-8cad-93052c74539d admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:50.599312 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10d4b9-588c-4a5b-b2c4-fce6eee36a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:50.600519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10d4b9-588c-4a5b-b2c4-fce6eee36a12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:50.601212 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10d4b9-588c-4a5b-b2c4-fce6eee36a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:50.601764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10d4b9-588c-4a5b-b2c4-fce6eee36a12 admin admin] PATH_INFO: `/v3/projects/e8c8dc0ff36d4e17b80f28b99fbdfe8d/users/90b23254a5ce4368ab00c9aee806bb30/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:50.641287 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10d4b9-588c-4a5b-b2c4-fce6eee36a12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8c8dc0ff36d4e17b80f28b99fbdfe8d, user_id=90b23254a5ce4368ab00c9aee806bb30, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:50.647000 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10d4b9-588c-4a5b-b2c4-fce6eee36a12 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:50.689304 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 920/1829] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:50 2022] PUT /identity/v3/projects/e8c8dc0ff36d4e17b80f28b99fbdfe8d/users/90b23254a5ce4368ab00c9aee806bb30/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:50.692864 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9330817-bc87-484e-b1db-3b6f43d031bb None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:50.693152 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9330817-bc87-484e-b1db-3b6f43d031bb None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:50.693426 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9330817-bc87-484e-b1db-3b6f43d031bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:50.763636 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-f9330817-bc87-484e-b1db-3b6f43d031bb None None] MFA Rules not processed for user `90b23254a5ce4368ab00c9aee806bb30`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:50.766236 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-f9330817-bc87-484e-b1db-3b6f43d031bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:50.924584 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10d4b9-588c-4a5b-b2c4-fce6eee36a12 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:50.927100 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-aa10d4b9-588c-4a5b-b2c4-fce6eee36a12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:51.020911 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 910/1830] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:51.023094 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9330817-bc87-484e-b1db-3b6f43d031bb None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:51.079167 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10d4b9-588c-4a5b-b2c4-fce6eee36a12 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:51.085230 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a996df-226d-41e9-a1c5-b46a41ae66e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:51.085914 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a996df-226d-41e9-a1c5-b46a41ae66e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:51.086526 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a996df-226d-41e9-a1c5-b46a41ae66e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:51.086526 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a996df-226d-41e9-a1c5-b46a41ae66e3 admin admin] PATH_INFO: `/v3/projects/62cc6e39134f4de0aeed0df61565b633` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:51.088057 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a996df-226d-41e9-a1c5-b46a41ae66e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62cc6e39134f4de0aeed0df61565b633)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:51.090156 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a996df-226d-41e9-a1c5-b46a41ae66e3 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:51.174746 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9330817-bc87-484e-b1db-3b6f43d031bb None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:51.186915 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-34a996df-226d-41e9-a1c5-b46a41ae66e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62cc6e39134f4de0aeed0df61565b633', 'request_id': 'req-34a996df-226d-41e9-a1c5-b46a41ae66e3'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:51.197816 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-34a996df-226d-41e9-a1c5-b46a41ae66e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62cc6e39134f4de0aeed0df61565b633', 'request_id': 'req-34a996df-226d-41e9-a1c5-b46a41ae66e3'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:51.210646 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-34a996df-226d-41e9-a1c5-b46a41ae66e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62cc6e39134f4de0aeed0df61565b633', 'request_id': 'req-34a996df-226d-41e9-a1c5-b46a41ae66e3'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:51.245494 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-34a996df-226d-41e9-a1c5-b46a41ae66e3 admin admin] The token cache is being invalidate because project 62cc6e39134f4de0aeed0df61565b633 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:59:51.245788 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-34a996df-226d-41e9-a1c5-b46a41ae66e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:51.247314 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-34a996df-226d-41e9-a1c5-b46a41ae66e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:51.250136 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 921/1831] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 15:59:50 2022] DELETE /identity/v3/projects/62cc6e39134f4de0aeed0df61565b633 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:51.255694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a996df-226d-41e9-a1c5-b46a41ae66e3 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:51.257876 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-34a996df-226d-41e9-a1c5-b46a41ae66e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:51.273094 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427b1ba-4d99-441b-a8cf-67e7e367711a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:51.273691 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427b1ba-4d99-441b-a8cf-67e7e367711a admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:51.274332 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427b1ba-4d99-441b-a8cf-67e7e367711a admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:51.274610 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427b1ba-4d99-441b-a8cf-67e7e367711a admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:51.275257 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a427b1ba-4d99-441b-a8cf-67e7e367711a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:51.277894 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a427b1ba-4d99-441b-a8cf-67e7e367711a admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:51.283828 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:51.324248 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 911/1832] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 15:59:51 2022] POST /identity/v3/projects => generated 385 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:51.325871 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39499108-e6cd-4cd2-a8a4-a54e6a868d1c None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:51.326169 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39499108-e6cd-4cd2-a8a4-a54e6a868d1c None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:51.326451 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39499108-e6cd-4cd2-a8a4-a54e6a868d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:51.365600 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a996df-226d-41e9-a1c5-b46a41ae66e3 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:51.372468 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-39499108-e6cd-4cd2-a8a4-a54e6a868d1c None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:51.376074 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-39499108-e6cd-4cd2-a8a4-a54e6a868d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:51.384377 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:51.442464 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0bf72-86da-44c1-a1f4-20ead02e4497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:51.443111 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0bf72-86da-44c1-a1f4-20ead02e4497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:51.443586 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0bf72-86da-44c1-a1f4-20ead02e4497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:51.443863 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0bf72-86da-44c1-a1f4-20ead02e4497 admin admin] PATH_INFO: `/v3/projects/21332fe07751461f9b97442b9e23be7b` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:51.445079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d0bf72-86da-44c1-a1f4-20ead02e4497 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21332fe07751461f9b97442b9e23be7b)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:51.447435 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d0bf72-86da-44c1-a1f4-20ead02e4497 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:51.488968 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 912/1833] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:51.496379 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39499108-e6cd-4cd2-a8a4-a54e6a868d1c None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:51.497906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-39499108-e6cd-4cd2-a8a4-a54e6a868d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:51.521201 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39499108-e6cd-4cd2-a8a4-a54e6a868d1c None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:51.529670 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-42d0bf72-86da-44c1-a1f4-20ead02e4497 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21332fe07751461f9b97442b9e23be7b', 'request_id': 'req-42d0bf72-86da-44c1-a1f4-20ead02e4497'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:51.541473 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-42d0bf72-86da-44c1-a1f4-20ead02e4497 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21332fe07751461f9b97442b9e23be7b', 'request_id': 'req-42d0bf72-86da-44c1-a1f4-20ead02e4497'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:51.551457 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-42d0bf72-86da-44c1-a1f4-20ead02e4497 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21332fe07751461f9b97442b9e23be7b', 'request_id': 'req-42d0bf72-86da-44c1-a1f4-20ead02e4497'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:51.570226 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-42d0bf72-86da-44c1-a1f4-20ead02e4497 admin admin] The token cache is being invalidate because project 21332fe07751461f9b97442b9e23be7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:59:51.571900 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-42d0bf72-86da-44c1-a1f4-20ead02e4497 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:51.573016 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-42d0bf72-86da-44c1-a1f4-20ead02e4497 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:51.575062 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 922/1834] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 15:59:51 2022] DELETE /identity/v3/projects/21332fe07751461f9b97442b9e23be7b => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:51.576668 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d41e87-3a23-4cdf-ba4a-b901ce0d59bd None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:51.577736 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d41e87-3a23-4cdf-ba4a-b901ce0d59bd None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:51.579563 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d41e87-3a23-4cdf-ba4a-b901ce0d59bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:51.605900 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abfa44-fc77-4bac-a586-e1e2dbc4e05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:51.606210 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abfa44-fc77-4bac-a586-e1e2dbc4e05a admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:51.606594 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abfa44-fc77-4bac-a586-e1e2dbc4e05a admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:51.606752 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abfa44-fc77-4bac-a586-e1e2dbc4e05a admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:51.607401 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1abfa44-fc77-4bac-a586-e1e2dbc4e05a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:51.610319 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1abfa44-fc77-4bac-a586-e1e2dbc4e05a admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:51.616359 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-b6d41e87-3a23-4cdf-ba4a-b901ce0d59bd None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:51.617864 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-b6d41e87-3a23-4cdf-ba4a-b901ce0d59bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:51.636041 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 923/1835] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:51.637072 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d41e87-3a23-4cdf-ba4a-b901ce0d59bd None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:51.644031 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-b6d41e87-3a23-4cdf-ba4a-b901ce0d59bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:51.653907 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 913/1836] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:59:51 2022] POST /identity/v3/users => generated 299 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:51.655228 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abfa44-fc77-4bac-a586-e1e2dbc4e05a admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:51.669274 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abfa44-fc77-4bac-a586-e1e2dbc4e05a admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:51.671827 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d41e87-3a23-4cdf-ba4a-b901ce0d59bd None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:51.675247 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2075d6-7ce2-45b6-8d60-f11552725897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:51.676000 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2075d6-7ce2-45b6-8d60-f11552725897 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:51.676498 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2075d6-7ce2-45b6-8d60-f11552725897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:51.677502 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2075d6-7ce2-45b6-8d60-f11552725897 admin admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:51.678305 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2075d6-7ce2-45b6-8d60-f11552725897 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:59:51.678989 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59ebbb-8b1b-4d64-b995-08b07f67da0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:51.679305 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2075d6-7ce2-45b6-8d60-f11552725897 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:51.680809 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59ebbb-8b1b-4d64-b995-08b07f67da0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:51.681357 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59ebbb-8b1b-4d64-b995-08b07f67da0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:51.682462 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2075d6-7ce2-45b6-8d60-f11552725897 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:51.682708 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59ebbb-8b1b-4d64-b995-08b07f67da0b admin admin] PATH_INFO: `/v3/users/e7c1a68c6459457f8a45be0694c8b60f` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:51.684771 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59ebbb-8b1b-4d64-b995-08b07f67da0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7c1a68c6459457f8a45be0694c8b60f)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:51.687716 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59ebbb-8b1b-4d64-b995-08b07f67da0b admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:51.704003 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 914/1837] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 15:59:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:59:51.704003 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2075d6-7ce2-45b6-8d60-f11552725897 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:51.705337 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-7a2075d6-7ce2-45b6-8d60-f11552725897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:51.722734 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2075d6-7ce2-45b6-8d60-f11552725897 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:51.730100 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777cde2a-bb9d-4e86-ac67-67b8e2fb9a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:51.730917 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cde2a-bb9d-4e86-ac67-67b8e2fb9a53 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:51.730917 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cde2a-bb9d-4e86-ac67-67b8e2fb9a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:51.731284 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cde2a-bb9d-4e86-ac67-67b8e2fb9a53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:51.732123 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777cde2a-bb9d-4e86-ac67-67b8e2fb9a53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:51.735749 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777cde2a-bb9d-4e86-ac67-67b8e2fb9a53 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:51.751441 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 915/1838] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:51.753027 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777cde2a-bb9d-4e86-ac67-67b8e2fb9a53 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:51.770589 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777cde2a-bb9d-4e86-ac67-67b8e2fb9a53 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:51.774958 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:51.778098 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97b48e-abcf-4735-b509-1810b19bb6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:51.779030 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97b48e-abcf-4735-b509-1810b19bb6db admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:51.779536 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97b48e-abcf-4735-b509-1810b19bb6db admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:51.780811 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97b48e-abcf-4735-b509-1810b19bb6db admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:51.782633 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97b48e-abcf-4735-b509-1810b19bb6db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:51.785564 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97b48e-abcf-4735-b509-1810b19bb6db admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:51.813911 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-4a59ebbb-8b1b-4d64-b995-08b07f67da0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7c1a68c6459457f8a45be0694c8b60f'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:51.814680 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-4a59ebbb-8b1b-4d64-b995-08b07f67da0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7c1a68c6459457f8a45be0694c8b60f'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:51.825937 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-4a59ebbb-8b1b-4d64-b995-08b07f67da0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7c1a68c6459457f8a45be0694c8b60f'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:51.827168 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 916/1839] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 15:59:51 2022] POST /identity/v3/projects => generated 357 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:51.831624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97b48e-abcf-4735-b509-1810b19bb6db admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:51.833494 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-dc97b48e-abcf-4735-b509-1810b19bb6db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:51.843110 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-4a59ebbb-8b1b-4d64-b995-08b07f67da0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7c1a68c6459457f8a45be0694c8b60f'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:51.853095 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-4a59ebbb-8b1b-4d64-b995-08b07f67da0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7c1a68c6459457f8a45be0694c8b60f'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:51.860360 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 924/1840] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 15:59:51 2022] DELETE /identity/v3/users/e7c1a68c6459457f8a45be0694c8b60f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:51.864046 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd0154-9bde-4a02-ab00-b2ca1d49ffa3 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:51.864046 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd0154-9bde-4a02-ab00-b2ca1d49ffa3 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:51.864046 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd0154-9bde-4a02-ab00-b2ca1d49ffa3 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:51.877408 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 925/1841] 10.222.0.25 () {54 vars in 921 bytes} [Tue Aug 30 15:59:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:59:51.877408 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd0154-9bde-4a02-ab00-b2ca1d49ffa3 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:51.877408 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-21bd0154-9bde-4a02-ab00-b2ca1d49ffa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:51.928514 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:51.960710 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97b48e-abcf-4735-b509-1810b19bb6db admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:52.017332 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd0154-9bde-4a02-ab00-b2ca1d49ffa3 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:52.024112 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05646b1-4903-40e0-ab46-6611e86fc112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:52.025107 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05646b1-4903-40e0-ab46-6611e86fc112 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:52.025500 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05646b1-4903-40e0-ab46-6611e86fc112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:52.025887 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05646b1-4903-40e0-ab46-6611e86fc112 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:52.026654 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05646b1-4903-40e0-ab46-6611e86fc112 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:52.028702 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05646b1-4903-40e0-ab46-6611e86fc112 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:52.071373 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 926/1842] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:59:51 2022] POST /identity/v3/users => generated 279 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:52.071373 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ceeaf-acb2-4d1f-9037-6a604bbe7086 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:52.072020 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ceeaf-acb2-4d1f-9037-6a604bbe7086 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:52.072398 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ceeaf-acb2-4d1f-9037-6a604bbe7086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:52.102617 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7454a-0c24-49f5-81b2-130ba857740e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:52.103975 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7454a-0c24-49f5-81b2-130ba857740e admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:52.104268 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7454a-0c24-49f5-81b2-130ba857740e admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:52.104537 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7454a-0c24-49f5-81b2-130ba857740e admin admin] PATH_INFO: `/v3/projects/5b8c777da67447c5af7ca47d1fb4e21d/users/c1d37b892581438ebce5169d6a0636bd/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:52.152314 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-078ceeaf-acb2-4d1f-9037-6a604bbe7086 None None] MFA Rules not processed for user `2bba851e1a0d4601b5d4841662f645dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:52.153737 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea7454a-0c24-49f5-81b2-130ba857740e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b8c777da67447c5af7ca47d1fb4e21d, user_id=c1d37b892581438ebce5169d6a0636bd, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:52.156100 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-078ceeaf-acb2-4d1f-9037-6a604bbe7086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:52.167053 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea7454a-0c24-49f5-81b2-130ba857740e admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:52.195046 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 917/1843] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:51 2022] PUT /identity/v3/projects/5b8c777da67447c5af7ca47d1fb4e21d/users/c1d37b892581438ebce5169d6a0636bd/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:52.195998 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7454a-0c24-49f5-81b2-130ba857740e admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:52.271047 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 927/1844] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Aug 30 15:59:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:52.272022 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ceeaf-acb2-4d1f-9037-6a604bbe7086 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:52.280537 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7454a-0c24-49f5-81b2-130ba857740e admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:52.282823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ceeaf-acb2-4d1f-9037-6a604bbe7086 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:52.285284 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6fe4bb-85db-4045-a6ce-af1d6f9aee0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:52.285901 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6fe4bb-85db-4045-a6ce-af1d6f9aee0f admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:52.286687 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6fe4bb-85db-4045-a6ce-af1d6f9aee0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:52.286687 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6fe4bb-85db-4045-a6ce-af1d6f9aee0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:52.287234 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6fe4bb-85db-4045-a6ce-af1d6f9aee0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:52.288904 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6fe4bb-85db-4045-a6ce-af1d6f9aee0f admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:52.289590 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec890e8-2f87-4fd9-a1ca-1dea6ad2f1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:52.290326 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec890e8-2f87-4fd9-a1ca-1dea6ad2f1be admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:52.290713 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec890e8-2f87-4fd9-a1ca-1dea6ad2f1be admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:52.291291 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec890e8-2f87-4fd9-a1ca-1dea6ad2f1be admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:52.292569 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec890e8-2f87-4fd9-a1ca-1dea6ad2f1be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:52.295033 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec890e8-2f87-4fd9-a1ca-1dea6ad2f1be admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:52.303186 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 918/1845] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:52 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:52.303186 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6fe4bb-85db-4045-a6ce-af1d6f9aee0f admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:52.305158 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-df6fe4bb-85db-4045-a6ce-af1d6f9aee0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:52.310292 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 928/1846] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:52.311865 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec890e8-2f87-4fd9-a1ca-1dea6ad2f1be admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:52.323958 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec890e8-2f87-4fd9-a1ca-1dea6ad2f1be admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:52.324226 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6fe4bb-85db-4045-a6ce-af1d6f9aee0f admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:52.329932 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6cdd84-a4fe-4881-805e-c50f9003fa56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:52.330517 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd167b31-4eac-4471-8b26-5bd68a4d2c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:52.330745 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6cdd84-a4fe-4881-805e-c50f9003fa56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:52.330857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd167b31-4eac-4471-8b26-5bd68a4d2c65 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:52.331453 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd167b31-4eac-4471-8b26-5bd68a4d2c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:52.331581 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6cdd84-a4fe-4881-805e-c50f9003fa56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:52.331668 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd167b31-4eac-4471-8b26-5bd68a4d2c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:52.331760 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6cdd84-a4fe-4881-805e-c50f9003fa56 admin admin] PATH_INFO: `/v3/projects/ac0403aaf82849598b3ed62e4446426c` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:52.331974 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd167b31-4eac-4471-8b26-5bd68a4d2c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:52.333373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6cdd84-a4fe-4881-805e-c50f9003fa56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac0403aaf82849598b3ed62e4446426c)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:52.333737 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd167b31-4eac-4471-8b26-5bd68a4d2c65 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:52.335710 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6cdd84-a4fe-4881-805e-c50f9003fa56 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:52.350674 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 929/1847] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:52.350674 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd167b31-4eac-4471-8b26-5bd68a4d2c65 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:52.379023 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd167b31-4eac-4471-8b26-5bd68a4d2c65 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:52.389207 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6344d9-b47c-4186-b765-b8479947e8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:52.390375 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6344d9-b47c-4186-b765-b8479947e8a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:52.391014 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6344d9-b47c-4186-b765-b8479947e8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:52.393772 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6344d9-b47c-4186-b765-b8479947e8a5 admin admin] PATH_INFO: `/v3/projects/5b8c777da67447c5af7ca47d1fb4e21d/users/c1d37b892581438ebce5169d6a0636bd/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:52.397426 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6344d9-b47c-4186-b765-b8479947e8a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b8c777da67447c5af7ca47d1fb4e21d, user_id=c1d37b892581438ebce5169d6a0636bd, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:52.400186 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6344d9-b47c-4186-b765-b8479947e8a5 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:52.402390 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4c6cdd84-a4fe-4881-805e-c50f9003fa56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac0403aaf82849598b3ed62e4446426c', 'request_id': 'req-4c6cdd84-a4fe-4881-805e-c50f9003fa56'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:52.408928 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4c6cdd84-a4fe-4881-805e-c50f9003fa56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac0403aaf82849598b3ed62e4446426c', 'request_id': 'req-4c6cdd84-a4fe-4881-805e-c50f9003fa56'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:52.413379 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 930/1848] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:52 2022] PUT /identity/v3/projects/5b8c777da67447c5af7ca47d1fb4e21d/users/c1d37b892581438ebce5169d6a0636bd/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:52.418195 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6344d9-b47c-4186-b765-b8479947e8a5 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:52.425023 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-db6344d9-b47c-4186-b765-b8479947e8a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:52.425766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4c6cdd84-a4fe-4881-805e-c50f9003fa56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac0403aaf82849598b3ed62e4446426c', 'request_id': 'req-4c6cdd84-a4fe-4881-805e-c50f9003fa56'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:52.431464 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:52.441108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4c6cdd84-a4fe-4881-805e-c50f9003fa56 admin admin] The token cache is being invalidate because project ac0403aaf82849598b3ed62e4446426c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:59:52.441862 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4c6cdd84-a4fe-4881-805e-c50f9003fa56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:52.442645 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4c6cdd84-a4fe-4881-805e-c50f9003fa56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:52.444743 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 919/1849] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 15:59:52 2022] DELETE /identity/v3/projects/ac0403aaf82849598b3ed62e4446426c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:52.448945 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6cdd84-a4fe-4881-805e-c50f9003fa56 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:52.450395 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-4c6cdd84-a4fe-4881-805e-c50f9003fa56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:52.455620 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:52.527203 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6344d9-b47c-4186-b765-b8479947e8a5 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:52.533513 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1286e649-4c10-4ba0-aa4a-52798c3b46f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bba851e1a0d4601b5d4841662f645dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:52.534139 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286e649-4c10-4ba0-aa4a-52798c3b46f3 service placement] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:52.534576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286e649-4c10-4ba0-aa4a-52798c3b46f3 service placement] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:52.534852 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286e649-4c10-4ba0-aa4a-52798c3b46f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:52.536848 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-1286e649-4c10-4ba0-aa4a-52798c3b46f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:52.547680 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6cdd84-a4fe-4881-805e-c50f9003fa56 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:52.551043 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1286e649-4c10-4ba0-aa4a-52798c3b46f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:52.552645 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1286e649-4c10-4ba0-aa4a-52798c3b46f3 service placement] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:52.563429 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 931/1850] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:52.564902 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02caec9-de3c-4b8d-95a1-a65581ec8211 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:52.565190 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02caec9-de3c-4b8d-95a1-a65581ec8211 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:52.565458 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02caec9-de3c-4b8d-95a1-a65581ec8211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:52.595943 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-c02caec9-de3c-4b8d-95a1-a65581ec8211 None None] MFA Rules not processed for user `c1d37b892581438ebce5169d6a0636bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:52.597030 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c02caec9-de3c-4b8d-95a1-a65581ec8211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:52.625535 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe3766-b52e-447b-a4d9-11391dbe0a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:52.626555 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe3766-b52e-447b-a4d9-11391dbe0a30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:52.627200 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe3766-b52e-447b-a4d9-11391dbe0a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:52.627621 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe3766-b52e-447b-a4d9-11391dbe0a30 admin admin] PATH_INFO: `/v3/projects/7692db5f23a347a793193f1c2acdabe1/users/d9ff58e414254db0826b86de0e201ef0/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:52.647960 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe3766-b52e-447b-a4d9-11391dbe0a30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7692db5f23a347a793193f1c2acdabe1, user_id=d9ff58e414254db0826b86de0e201ef0, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:52.652379 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe3766-b52e-447b-a4d9-11391dbe0a30 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:52.688818 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 920/1851] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:52 2022] PUT /identity/v3/projects/7692db5f23a347a793193f1c2acdabe1/users/d9ff58e414254db0826b86de0e201ef0/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:52.688818 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339d124-a91c-460a-ad63-1d667886bfd6 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:52.688818 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339d124-a91c-460a-ad63-1d667886bfd6 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:52.688818 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339d124-a91c-460a-ad63-1d667886bfd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:52.706640 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-2339d124-a91c-460a-ad63-1d667886bfd6 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:52.708301 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-2339d124-a91c-460a-ad63-1d667886bfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:52.709969 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 932/1852] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:52 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:52.711304 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf3424-6a02-451f-9a87-1fcfa94f0ffb None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:52.711590 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf3424-6a02-451f-9a87-1fcfa94f0ffb None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:52.712396 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf3424-6a02-451f-9a87-1fcfa94f0ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:52.753663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-87cf3424-6a02-451f-9a87-1fcfa94f0ffb None None] MFA Rules not processed for user `d9ff58e414254db0826b86de0e201ef0`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:52.756879 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-87cf3424-6a02-451f-9a87-1fcfa94f0ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:52.813565 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 921/1853] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:52.814516 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339d124-a91c-460a-ad63-1d667886bfd6 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:52.819451 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-2339d124-a91c-460a-ad63-1d667886bfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:52.880573 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 933/1854] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:52 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:52.882059 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d98f72-aa3a-4eab-9bbe-4bfc11e5a0fa None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:52.882353 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d98f72-aa3a-4eab-9bbe-4bfc11e5a0fa None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:52.882633 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d98f72-aa3a-4eab-9bbe-4bfc11e5a0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:52.904977 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:52.913749 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:52.938732 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-55d98f72-aa3a-4eab-9bbe-4bfc11e5a0fa None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:52.940185 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-55d98f72-aa3a-4eab-9bbe-4bfc11e5a0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:52.952849 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 934/1855] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:52.953739 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d98f72-aa3a-4eab-9bbe-4bfc11e5a0fa None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:52.955749 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-55d98f72-aa3a-4eab-9bbe-4bfc11e5a0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:52.976146 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d98f72-aa3a-4eab-9bbe-4bfc11e5a0fa None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:52.978406 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339d124-a91c-460a-ad63-1d667886bfd6 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:52.982848 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af6ca0-9454-4d77-87eb-455b1efe0090 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:52.983756 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af6ca0-9454-4d77-87eb-455b1efe0090 service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:52.984107 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af6ca0-9454-4d77-87eb-455b1efe0090 service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:52.984448 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af6ca0-9454-4d77-87eb-455b1efe0090 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:52.989082 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e1afd-464c-4804-b255-b06facb367c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:52.989893 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e1afd-464c-4804-b255-b06facb367c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:52.990176 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e1afd-464c-4804-b255-b06facb367c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:52.991883 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e1afd-464c-4804-b255-b06facb367c1 admin admin] PATH_INFO: `/v3/projects/01177dbab7d74ea2b8ae61d2527710da` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:52.997333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e1afd-464c-4804-b255-b06facb367c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01177dbab7d74ea2b8ae61d2527710da)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:53.002063 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e1afd-464c-4804-b255-b06facb367c1 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:53.069808 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af6ca0-9454-4d77-87eb-455b1efe0090 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:53.071618 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af6ca0-9454-4d77-87eb-455b1efe0090 service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:53.081133 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e95e1afd-464c-4804-b255-b06facb367c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01177dbab7d74ea2b8ae61d2527710da', 'request_id': 'req-e95e1afd-464c-4804-b255-b06facb367c1'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:53.085137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 922/1856] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:52 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:53.086308 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af6ca0-9454-4d77-87eb-455b1efe0090 service cinder] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:53.098071 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af6ca0-9454-4d77-87eb-455b1efe0090 service cinder] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:53.126297 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e95e1afd-464c-4804-b255-b06facb367c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01177dbab7d74ea2b8ae61d2527710da', 'request_id': 'req-e95e1afd-464c-4804-b255-b06facb367c1'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:53.142972 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e95e1afd-464c-4804-b255-b06facb367c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01177dbab7d74ea2b8ae61d2527710da', 'request_id': 'req-e95e1afd-464c-4804-b255-b06facb367c1'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:53.172638 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5652a2-4abd-4e77-a715-998a91e77583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:53.173556 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5652a2-4abd-4e77-a715-998a91e77583 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:53.173894 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5652a2-4abd-4e77-a715-998a91e77583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:53.174174 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5652a2-4abd-4e77-a715-998a91e77583 admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:53.174898 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5652a2-4abd-4e77-a715-998a91e77583 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:53.176244 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e95e1afd-464c-4804-b255-b06facb367c1 admin admin] The token cache is being invalidate because project 01177dbab7d74ea2b8ae61d2527710da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:59:53.177715 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5652a2-4abd-4e77-a715-998a91e77583 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:53.178127 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e95e1afd-464c-4804-b255-b06facb367c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:53.180000 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e95e1afd-464c-4804-b255-b06facb367c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:53.186319 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 935/1857] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 15:59:52 2022] DELETE /identity/v3/projects/01177dbab7d74ea2b8ae61d2527710da => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:53.187538 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e1afd-464c-4804-b255-b06facb367c1 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:53.191732 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-e95e1afd-464c-4804-b255-b06facb367c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:53.216370 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e1afd-464c-4804-b255-b06facb367c1 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:53.223333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00413cff-4d72-48aa-8de3-e8fc42bbbed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:53.224158 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00413cff-4d72-48aa-8de3-e8fc42bbbed7 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:53.224505 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00413cff-4d72-48aa-8de3-e8fc42bbbed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:53.224913 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00413cff-4d72-48aa-8de3-e8fc42bbbed7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:53.225743 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00413cff-4d72-48aa-8de3-e8fc42bbbed7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:59:53.226112 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00413cff-4d72-48aa-8de3-e8fc42bbbed7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:53.228016 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00413cff-4d72-48aa-8de3-e8fc42bbbed7 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:53.243114 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 936/1858] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 15:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:59:53.244142 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00413cff-4d72-48aa-8de3-e8fc42bbbed7 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:53.246644 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-00413cff-4d72-48aa-8de3-e8fc42bbbed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:53.260659 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00413cff-4d72-48aa-8de3-e8fc42bbbed7 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:53.266925 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355da4b-fbea-4804-b680-b1e9a0163394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:53.267660 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355da4b-fbea-4804-b680-b1e9a0163394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:53.268018 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355da4b-fbea-4804-b680-b1e9a0163394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:53.268417 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355da4b-fbea-4804-b680-b1e9a0163394 admin admin] PATH_INFO: `/v3/users/90b23254a5ce4368ab00c9aee806bb30` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:53.269209 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 923/1859] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 15:59:53 2022] POST /identity/v3/projects => generated 357 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:53.269766 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e355da4b-fbea-4804-b680-b1e9a0163394 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90b23254a5ce4368ab00c9aee806bb30)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:53.271765 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e355da4b-fbea-4804-b680-b1e9a0163394 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:53.274877 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0de69-1f4a-4bd3-bc9a-c54207dc7eba None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:53.275448 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0de69-1f4a-4bd3-bc9a-c54207dc7eba None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:53.275740 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0de69-1f4a-4bd3-bc9a-c54207dc7eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:53.307121 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-07d0de69-1f4a-4bd3-bc9a-c54207dc7eba None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:53.308494 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-07d0de69-1f4a-4bd3-bc9a-c54207dc7eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:53.337261 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e355da4b-fbea-4804-b680-b1e9a0163394 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90b23254a5ce4368ab00c9aee806bb30'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:53.338221 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e355da4b-fbea-4804-b680-b1e9a0163394 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90b23254a5ce4368ab00c9aee806bb30'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:53.347924 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e355da4b-fbea-4804-b680-b1e9a0163394 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90b23254a5ce4368ab00c9aee806bb30'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:53.363790 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e355da4b-fbea-4804-b680-b1e9a0163394 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90b23254a5ce4368ab00c9aee806bb30'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:53.377217 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e355da4b-fbea-4804-b680-b1e9a0163394 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90b23254a5ce4368ab00c9aee806bb30'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:53.394195 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 937/1860] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 15:59:53 2022] DELETE /identity/v3/users/90b23254a5ce4368ab00c9aee806bb30 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:53.395525 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355da4b-fbea-4804-b680-b1e9a0163394 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:53.397613 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-e355da4b-fbea-4804-b680-b1e9a0163394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:53.400240 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 924/1861] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:53.401353 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0de69-1f4a-4bd3-bc9a-c54207dc7eba None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:53.403003 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-07d0de69-1f4a-4bd3-bc9a-c54207dc7eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:53.442832 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0de69-1f4a-4bd3-bc9a-c54207dc7eba None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:53.451623 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:53.473031 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:53.506634 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355da4b-fbea-4804-b680-b1e9a0163394 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:53.513512 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01824c68-a858-497c-be67-5859c383caa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:53.514436 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01824c68-a858-497c-be67-5859c383caa2 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:53.515119 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01824c68-a858-497c-be67-5859c383caa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:53.515569 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01824c68-a858-497c-be67-5859c383caa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:53.516396 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01824c68-a858-497c-be67-5859c383caa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:53.518525 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01824c68-a858-497c-be67-5859c383caa2 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:53.519777 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1c0ee-2d53-4443-8b6c-b5dfa6fac845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:53.520400 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1c0ee-2d53-4443-8b6c-b5dfa6fac845 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:53.520683 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1c0ee-2d53-4443-8b6c-b5dfa6fac845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:53.520991 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1c0ee-2d53-4443-8b6c-b5dfa6fac845 admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:53.521698 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee1c0ee-2d53-4443-8b6c-b5dfa6fac845 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:53.524153 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee1c0ee-2d53-4443-8b6c-b5dfa6fac845 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:53.555191 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 938/1862] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 15:59:53 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:53.556536 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71750e55-0c0f-4f91-98f2-ad706a88d561 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:53.556849 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71750e55-0c0f-4f91-98f2-ad706a88d561 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:53.557126 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71750e55-0c0f-4f91-98f2-ad706a88d561 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:53.558509 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 925/1863] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:59:53 2022] POST /identity/v3/users => generated 285 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:53.559066 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 939/1864] 10.222.0.25 () {54 vars in 921 bytes} [Tue Aug 30 15:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:59:53.560140 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a270e4-b0d2-47af-a070-b8ddf4640fbe None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:53.560634 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a270e4-b0d2-47af-a070-b8ddf4640fbe None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:53.560736 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a0557-4f10-4b85-be3b-15c099be5a1f None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:53.561352 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a0557-4f10-4b85-be3b-15c099be5a1f None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:53.561845 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a0557-4f10-4b85-be3b-15c099be5a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:53.562138 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a270e4-b0d2-47af-a070-b8ddf4640fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:53.585975 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-98a270e4-b0d2-47af-a070-b8ddf4640fbe None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:53.587748 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-98a270e4-b0d2-47af-a070-b8ddf4640fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:53.588436 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-809a0557-4f10-4b85-be3b-15c099be5a1f None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:53.589833 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-809a0557-4f10-4b85-be3b-15c099be5a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:53.682377 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 926/1865] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:53.683579 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a270e4-b0d2-47af-a070-b8ddf4640fbe None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:53.697426 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a270e4-b0d2-47af-a070-b8ddf4640fbe None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:53.703822 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6493bd-ae7b-4214-9f35-84e1207a0c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:53.706091 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6493bd-ae7b-4214-9f35-84e1207a0c1a admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:53.706596 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6493bd-ae7b-4214-9f35-84e1207a0c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:53.707042 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6493bd-ae7b-4214-9f35-84e1207a0c1a admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:53.707985 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6493bd-ae7b-4214-9f35-84e1207a0c1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:53.710340 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6493bd-ae7b-4214-9f35-84e1207a0c1a admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:53.713503 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 940/1866] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:53.714441 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a0557-4f10-4b85-be3b-15c099be5a1f None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:53.734858 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a0557-4f10-4b85-be3b-15c099be5a1f None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:53.742508 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef55bad-c4f5-4df4-80f0-082f6b0e64b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:53.743102 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef55bad-c4f5-4df4-80f0-082f6b0e64b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:53.743386 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef55bad-c4f5-4df4-80f0-082f6b0e64b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:53.743659 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef55bad-c4f5-4df4-80f0-082f6b0e64b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:53.744323 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef55bad-c4f5-4df4-80f0-082f6b0e64b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:53.745738 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 927/1867] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:59:53 2022] POST /identity/v3/users => generated 281 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:53.745992 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef55bad-c4f5-4df4-80f0-082f6b0e64b2 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:53.747147 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef3e9e-d576-4d7f-a88e-872b9f253fb7 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:53.747528 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef3e9e-d576-4d7f-a88e-872b9f253fb7 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:53.747860 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef3e9e-d576-4d7f-a88e-872b9f253fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:53.761975 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 941/1868] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:53.761975 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef55bad-c4f5-4df4-80f0-082f6b0e64b2 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:53.771726 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-10ef3e9e-d576-4d7f-a88e-872b9f253fb7 None None] MFA Rules not processed for user `ebc80bf891614fb895af33ca1ded6b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:53.773101 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-10ef3e9e-d576-4d7f-a88e-872b9f253fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:53.780734 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef55bad-c4f5-4df4-80f0-082f6b0e64b2 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:53.786387 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10069592-eac7-4d32-84e7-d9873097a7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:53.787117 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10069592-eac7-4d32-84e7-d9873097a7dd admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:53.787410 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10069592-eac7-4d32-84e7-d9873097a7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:53.787601 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10069592-eac7-4d32-84e7-d9873097a7dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:53.788268 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10069592-eac7-4d32-84e7-d9873097a7dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:59:53.788582 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10069592-eac7-4d32-84e7-d9873097a7dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:53.790438 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10069592-eac7-4d32-84e7-d9873097a7dd admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:53.806237 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 942/1869] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 15:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:59:53.807191 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10069592-eac7-4d32-84e7-d9873097a7dd admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:53.809805 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-10069592-eac7-4d32-84e7-d9873097a7dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:53.870616 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 928/1870] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Aug 30 15:59:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:53.871737 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef3e9e-d576-4d7f-a88e-872b9f253fb7 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:53.883095 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10069592-eac7-4d32-84e7-d9873097a7dd admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:53.885165 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef3e9e-d576-4d7f-a88e-872b9f253fb7 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:53.888774 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48560381-b88a-4f79-87b8-452b09fca140 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:53.890134 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48560381-b88a-4f79-87b8-452b09fca140 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:53.890494 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48560381-b88a-4f79-87b8-452b09fca140 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:53.890842 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48560381-b88a-4f79-87b8-452b09fca140 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:53.891187 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eca505-c124-44ac-aae1-ae0d9896da80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:53.892086 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eca505-c124-44ac-aae1-ae0d9896da80 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:53.892437 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eca505-c124-44ac-aae1-ae0d9896da80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:53.892956 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eca505-c124-44ac-aae1-ae0d9896da80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:53.893686 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eca505-c124-44ac-aae1-ae0d9896da80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:53.895881 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eca505-c124-44ac-aae1-ae0d9896da80 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:53.904030 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48560381-b88a-4f79-87b8-452b09fca140 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:53.906522 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48560381-b88a-4f79-87b8-452b09fca140 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:53.908453 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 929/1871] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:53.909583 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eca505-c124-44ac-aae1-ae0d9896da80 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:53.916037 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:53.920274 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 943/1872] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:53.921938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48560381-b88a-4f79-87b8-452b09fca140 service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:53.945115 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eca505-c124-44ac-aae1-ae0d9896da80 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:53.954055 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48560381-b88a-4f79-87b8-452b09fca140 service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:53.959980 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff3f98-3a9d-4c3a-ba9c-328f0eeacde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:53.960740 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff3f98-3a9d-4c3a-ba9c-328f0eeacde8 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:53.961011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff3f98-3a9d-4c3a-ba9c-328f0eeacde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:53.961347 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff3f98-3a9d-4c3a-ba9c-328f0eeacde8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:53.962285 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c130d-9d34-4221-8dcf-40e657e63d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:53.962423 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff3f98-3a9d-4c3a-ba9c-328f0eeacde8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:53.962560 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c130d-9d34-4221-8dcf-40e657e63d60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:53.962837 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c130d-9d34-4221-8dcf-40e657e63d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:53.963111 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c130d-9d34-4221-8dcf-40e657e63d60 admin admin] PATH_INFO: `/v3/projects/c37ee0e3074a401fa16bbf8f52ceb603/users/10bcc15d9d8448dab02ed36b51590dff/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:53.963916 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff3f98-3a9d-4c3a-ba9c-328f0eeacde8 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:53.990930 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c130d-9d34-4221-8dcf-40e657e63d60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c37ee0e3074a401fa16bbf8f52ceb603, user_id=10bcc15d9d8448dab02ed36b51590dff, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:53.995108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c130d-9d34-4221-8dcf-40e657e63d60 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:54.005376 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 944/1873] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 15:59:53 2022] POST /identity/v3/projects => generated 387 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:54.008283 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff3f98-3a9d-4c3a-ba9c-328f0eeacde8 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:54.017952 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 930/1874] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:53 2022] PUT /identity/v3/projects/c37ee0e3074a401fa16bbf8f52ceb603/users/10bcc15d9d8448dab02ed36b51590dff/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:54.019564 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c130d-9d34-4221-8dcf-40e657e63d60 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:54.022439 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-5a2c130d-9d34-4221-8dcf-40e657e63d60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:54.065620 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:54.113861 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff3f98-3a9d-4c3a-ba9c-328f0eeacde8 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:54.161257 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c130d-9d34-4221-8dcf-40e657e63d60 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:54.171521 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d0d45-226b-4d5d-bc79-d1e0ee20dcfa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:54.172954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d0d45-226b-4d5d-bc79-d1e0ee20dcfa service nova] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:54.173406 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d0d45-226b-4d5d-bc79-d1e0ee20dcfa service nova] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:54.175019 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d0d45-226b-4d5d-bc79-d1e0ee20dcfa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:54.196869 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d0d45-226b-4d5d-bc79-d1e0ee20dcfa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:54.200624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d0d45-226b-4d5d-bc79-d1e0ee20dcfa service nova] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:54.218507 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 931/1875] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:54.219437 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d0d45-226b-4d5d-bc79-d1e0ee20dcfa service nova] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:54.222028 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370ae8a-5dc6-48e8-a777-24942fdcbdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:54.222837 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370ae8a-5dc6-48e8-a777-24942fdcbdd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:54.223265 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370ae8a-5dc6-48e8-a777-24942fdcbdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:54.223695 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370ae8a-5dc6-48e8-a777-24942fdcbdd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:54.224500 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370ae8a-5dc6-48e8-a777-24942fdcbdd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:54.226288 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370ae8a-5dc6-48e8-a777-24942fdcbdd4 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:54.230820 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d0d45-226b-4d5d-bc79-d1e0ee20dcfa service nova] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:54.237487 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7bc26c-676b-454a-b929-47f71d858b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:54.239522 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7bc26c-676b-454a-b929-47f71d858b64 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:54.239988 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7bc26c-676b-454a-b929-47f71d858b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:54.240409 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7bc26c-676b-454a-b929-47f71d858b64 admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:54.241321 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7bc26c-676b-454a-b929-47f71d858b64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:54.244252 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7bc26c-676b-454a-b929-47f71d858b64 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:54.254773 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 945/1876] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:54.254773 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370ae8a-5dc6-48e8-a777-24942fdcbdd4 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:54.279665 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370ae8a-5dc6-48e8-a777-24942fdcbdd4 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:54.282216 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 932/1877] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:59:54 2022] POST /identity/v3/users => generated 294 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:54.283249 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7bc26c-676b-454a-b929-47f71d858b64 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:54.297467 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92064cc6-8807-4370-8c0e-fe6dc99aa3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:54.297832 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7bc26c-676b-454a-b929-47f71d858b64 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:54.298681 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92064cc6-8807-4370-8c0e-fe6dc99aa3db admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:54.298996 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92064cc6-8807-4370-8c0e-fe6dc99aa3db admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:54.299248 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92064cc6-8807-4370-8c0e-fe6dc99aa3db admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:54.301093 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92064cc6-8807-4370-8c0e-fe6dc99aa3db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:54.303704 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92064cc6-8807-4370-8c0e-fe6dc99aa3db admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:54.323002 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22baf0f-b431-4125-9648-8c6391f398a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:54.323972 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 946/1878] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:54.324554 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22baf0f-b431-4125-9648-8c6391f398a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:54.325335 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92064cc6-8807-4370-8c0e-fe6dc99aa3db admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:54.327624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22baf0f-b431-4125-9648-8c6391f398a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:54.329083 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22baf0f-b431-4125-9648-8c6391f398a4 admin admin] PATH_INFO: `/v3/projects/bae9d71ce4a741daaf8da573fdb354fb/users/05545e4f9f9f46b6861f5a5f29c37aec/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:54.352068 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92064cc6-8807-4370-8c0e-fe6dc99aa3db admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:54.355465 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22baf0f-b431-4125-9648-8c6391f398a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bae9d71ce4a741daaf8da573fdb354fb, user_id=05545e4f9f9f46b6861f5a5f29c37aec, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:54.360951 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22baf0f-b431-4125-9648-8c6391f398a4 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:54.363836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc8884-6ed9-4f79-b994-9cad8b40b9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:54.364981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc8884-6ed9-4f79-b994-9cad8b40b9dd admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:54.365460 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc8884-6ed9-4f79-b994-9cad8b40b9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:54.365829 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc8884-6ed9-4f79-b994-9cad8b40b9dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:54.367281 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddc8884-6ed9-4f79-b994-9cad8b40b9dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:54.370029 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddc8884-6ed9-4f79-b994-9cad8b40b9dd admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:54.379861 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 933/1879] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:54 2022] PUT /identity/v3/projects/bae9d71ce4a741daaf8da573fdb354fb/users/05545e4f9f9f46b6861f5a5f29c37aec/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:54.380945 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22baf0f-b431-4125-9648-8c6391f398a4 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:54.382708 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-c22baf0f-b431-4125-9648-8c6391f398a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:54.396172 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 947/1880] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:54.396172 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc8884-6ed9-4f79-b994-9cad8b40b9dd admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:54.407677 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc8884-6ed9-4f79-b994-9cad8b40b9dd admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:54.463720 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22baf0f-b431-4125-9648-8c6391f398a4 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:54.469129 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193bcc2-9691-4aab-9c24-215652637857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:54.469845 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193bcc2-9691-4aab-9c24-215652637857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:54.470229 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193bcc2-9691-4aab-9c24-215652637857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:54.470578 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193bcc2-9691-4aab-9c24-215652637857 admin admin] PATH_INFO: `/v3/projects/e8c8dc0ff36d4e17b80f28b99fbdfe8d` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:54.471780 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8193bcc2-9691-4aab-9c24-215652637857 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8c8dc0ff36d4e17b80f28b99fbdfe8d)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:54.473822 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8193bcc2-9691-4aab-9c24-215652637857 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:54.475124 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9df311-6c62-471d-95b6-d3f08b2e298f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:54.475784 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9df311-6c62-471d-95b6-d3f08b2e298f admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:54.476058 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9df311-6c62-471d-95b6-d3f08b2e298f admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:54.476334 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9df311-6c62-471d-95b6-d3f08b2e298f admin admin] PATH_INFO: `/v3/projects/c37ee0e3074a401fa16bbf8f52ceb603/users/10bcc15d9d8448dab02ed36b51590dff/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:54.478261 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9df311-6c62-471d-95b6-d3f08b2e298f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c37ee0e3074a401fa16bbf8f52ceb603, user_id=10bcc15d9d8448dab02ed36b51590dff, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:54.480943 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9df311-6c62-471d-95b6-d3f08b2e298f admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:54.491422 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 948/1881] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:54 2022] PUT /identity/v3/projects/c37ee0e3074a401fa16bbf8f52ceb603/users/10bcc15d9d8448dab02ed36b51590dff/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:54.492658 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6c487-7836-402b-953f-eee5126c7863 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:54.492975 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6c487-7836-402b-953f-eee5126c7863 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:54.493249 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6c487-7836-402b-953f-eee5126c7863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:54.509439 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:54.526255 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-f5e6c487-7836-402b-953f-eee5126c7863 None None] MFA Rules not processed for user `05545e4f9f9f46b6861f5a5f29c37aec`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:54.527753 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-f5e6c487-7836-402b-953f-eee5126c7863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:54.535737 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-8193bcc2-9691-4aab-9c24-215652637857 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8c8dc0ff36d4e17b80f28b99fbdfe8d', 'request_id': 'req-8193bcc2-9691-4aab-9c24-215652637857'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:54.541132 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-8193bcc2-9691-4aab-9c24-215652637857 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8c8dc0ff36d4e17b80f28b99fbdfe8d', 'request_id': 'req-8193bcc2-9691-4aab-9c24-215652637857'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:54.550176 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-8193bcc2-9691-4aab-9c24-215652637857 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8c8dc0ff36d4e17b80f28b99fbdfe8d', 'request_id': 'req-8193bcc2-9691-4aab-9c24-215652637857'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:54.562736 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-8193bcc2-9691-4aab-9c24-215652637857 admin admin] The token cache is being invalidate because project e8c8dc0ff36d4e17b80f28b99fbdfe8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:59:54.563030 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-8193bcc2-9691-4aab-9c24-215652637857 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:54.563529 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:54.563704 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-8193bcc2-9691-4aab-9c24-215652637857 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:54.565928 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 934/1882] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 15:59:54 2022] DELETE /identity/v3/projects/e8c8dc0ff36d4e17b80f28b99fbdfe8d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:54.566491 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193bcc2-9691-4aab-9c24-215652637857 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:54.568265 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-8193bcc2-9691-4aab-9c24-215652637857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:54.603810 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 949/1883] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:54.604712 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6c487-7836-402b-953f-eee5126c7863 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:54.605995 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-f5e6c487-7836-402b-953f-eee5126c7863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:54.652327 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193bcc2-9691-4aab-9c24-215652637857 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:54.658034 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c9886-58fc-4cc0-86c5-d726988eb76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:54.658626 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c9886-58fc-4cc0-86c5-d726988eb76a admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:54.659351 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c9886-58fc-4cc0-86c5-d726988eb76a admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:54.659351 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c9886-58fc-4cc0-86c5-d726988eb76a admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:54.659932 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c9886-58fc-4cc0-86c5-d726988eb76a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:54.661590 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c9886-58fc-4cc0-86c5-d726988eb76a admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:54.687053 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 935/1884] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:54.688447 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084236ed-ad55-417e-a2be-838925e4db5a None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:54.688736 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084236ed-ad55-417e-a2be-838925e4db5a None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:54.689042 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084236ed-ad55-417e-a2be-838925e4db5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:54.693771 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6c487-7836-402b-953f-eee5126c7863 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:54.699026 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbcf93f-4cd2-424e-89ff-283b97189a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:54.699984 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbcf93f-4cd2-424e-89ff-283b97189a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:54.700457 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbcf93f-4cd2-424e-89ff-283b97189a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:54.700960 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbcf93f-4cd2-424e-89ff-283b97189a2e admin admin] PATH_INFO: `/v3/users/9b552424b3884082be8b095409aa23ea` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:54.703206 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbcf93f-4cd2-424e-89ff-283b97189a2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b552424b3884082be8b095409aa23ea)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:54.705723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbcf93f-4cd2-424e-89ff-283b97189a2e admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:54.732210 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-084236ed-ad55-417e-a2be-838925e4db5a None None] MFA Rules not processed for user `10bcc15d9d8448dab02ed36b51590dff`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:54.734275 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-084236ed-ad55-417e-a2be-838925e4db5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:54.762952 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6dbcf93f-4cd2-424e-89ff-283b97189a2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b552424b3884082be8b095409aa23ea'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:54.763751 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6dbcf93f-4cd2-424e-89ff-283b97189a2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b552424b3884082be8b095409aa23ea'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:54.773125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6dbcf93f-4cd2-424e-89ff-283b97189a2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b552424b3884082be8b095409aa23ea'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:54.791188 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6dbcf93f-4cd2-424e-89ff-283b97189a2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b552424b3884082be8b095409aa23ea'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:54.799519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6dbcf93f-4cd2-424e-89ff-283b97189a2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b552424b3884082be8b095409aa23ea'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:54.809553 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 950/1885] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 15:59:54 2022] DELETE /identity/v3/users/9b552424b3884082be8b095409aa23ea => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:54.809553 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbcf93f-4cd2-424e-89ff-283b97189a2e admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:54.819705 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-6dbcf93f-4cd2-424e-89ff-283b97189a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:54.826571 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 936/1886] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:54 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:54.826571 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084236ed-ad55-417e-a2be-838925e4db5a None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:54.831765 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-084236ed-ad55-417e-a2be-838925e4db5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:54.896054 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:54.913935 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:54.929701 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084236ed-ad55-417e-a2be-838925e4db5a None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:54.940652 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbcf93f-4cd2-424e-89ff-283b97189a2e admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:54.947366 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c487d5a-a68b-408e-8f07-22f5ed29e13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:54.949085 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c487d5a-a68b-408e-8f07-22f5ed29e13c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:54.949380 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c487d5a-a68b-408e-8f07-22f5ed29e13c admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:54.949784 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c487d5a-a68b-408e-8f07-22f5ed29e13c admin admin] PATH_INFO: `/v3/users/c1d37b892581438ebce5169d6a0636bd` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:54.951060 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c487d5a-a68b-408e-8f07-22f5ed29e13c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1d37b892581438ebce5169d6a0636bd)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:54.964574 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c487d5a-a68b-408e-8f07-22f5ed29e13c admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:55.033580 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ef9c9-d0b0-427e-962f-096de53aff84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:55.034353 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ef9c9-d0b0-427e-962f-096de53aff84 service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:55.034839 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ef9c9-d0b0-427e-962f-096de53aff84 service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:55.035157 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ef9c9-d0b0-427e-962f-096de53aff84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:55.039148 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-b94ef9c9-d0b0-427e-962f-096de53aff84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:55.059071 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-1c487d5a-a68b-408e-8f07-22f5ed29e13c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1d37b892581438ebce5169d6a0636bd'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:55.059932 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-1c487d5a-a68b-408e-8f07-22f5ed29e13c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1d37b892581438ebce5169d6a0636bd'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:55.098210 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-1c487d5a-a68b-408e-8f07-22f5ed29e13c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1d37b892581438ebce5169d6a0636bd'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:55.114578 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-1c487d5a-a68b-408e-8f07-22f5ed29e13c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1d37b892581438ebce5169d6a0636bd'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:55.125258 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-1c487d5a-a68b-408e-8f07-22f5ed29e13c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1d37b892581438ebce5169d6a0636bd'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:55.131784 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 951/1887] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 15:59:54 2022] DELETE /identity/v3/users/c1d37b892581438ebce5169d6a0636bd => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:55.132373 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c487d5a-a68b-408e-8f07-22f5ed29e13c admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:55.134245 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-1c487d5a-a68b-408e-8f07-22f5ed29e13c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:55.145425 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ef9c9-d0b0-427e-962f-096de53aff84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:55.147004 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ef9c9-d0b0-427e-962f-096de53aff84 service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:55.157975 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 937/1888] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:55.158724 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ef9c9-d0b0-427e-962f-096de53aff84 service cinder] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:55.160120 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-b94ef9c9-d0b0-427e-962f-096de53aff84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:55.179011 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ef9c9-d0b0-427e-962f-096de53aff84 service cinder] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:55.211508 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c487d5a-a68b-408e-8f07-22f5ed29e13c admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:55.216817 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a35e0-a970-481b-b18f-f174f59d3ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:55.217957 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a35e0-a970-481b-b18f-f174f59d3ca1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:55.218242 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a35e0-a970-481b-b18f-f174f59d3ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:55.218527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a35e0-a970-481b-b18f-f174f59d3ca1 admin admin] PATH_INFO: `/v3/projects/018117fc976a4011aeb6849123957a89/users/d95fe023ed084b2d95af8daa58ff9c38/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:55.241933 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a35e0-a970-481b-b18f-f174f59d3ca1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=018117fc976a4011aeb6849123957a89, user_id=d95fe023ed084b2d95af8daa58ff9c38, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:55.247313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a35e0-a970-481b-b18f-f174f59d3ca1 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:55.257168 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d521c-6645-4687-94d8-99364768d84b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:55.261367 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d521c-6645-4687-94d8-99364768d84b service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:55.261602 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d521c-6645-4687-94d8-99364768d84b service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:55.262055 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d521c-6645-4687-94d8-99364768d84b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:55.267934 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-287d521c-6645-4687-94d8-99364768d84b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:55.276886 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 952/1889] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:55 2022] PUT /identity/v3/projects/018117fc976a4011aeb6849123957a89/users/d95fe023ed084b2d95af8daa58ff9c38/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:55.278794 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a35e0-a970-481b-b18f-f174f59d3ca1 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:55.280700 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-f50a35e0-a970-481b-b18f-f174f59d3ca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:55.370667 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:55.377895 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:55.391158 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d521c-6645-4687-94d8-99364768d84b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:55.393160 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d521c-6645-4687-94d8-99364768d84b service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:55.395387 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a35e0-a970-481b-b18f-f174f59d3ca1 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:55.401776 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b53c14-f1fe-4321-a3af-3d28a3b78be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:55.402794 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b53c14-f1fe-4321-a3af-3d28a3b78be3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:55.402794 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b53c14-f1fe-4321-a3af-3d28a3b78be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:55.402974 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b53c14-f1fe-4321-a3af-3d28a3b78be3 admin admin] PATH_INFO: `/v3/projects/5b199e0f1ea2490b90941d15ef71ed65` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:55.404355 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b53c14-f1fe-4321-a3af-3d28a3b78be3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b199e0f1ea2490b90941d15ef71ed65)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:55.407890 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b53c14-f1fe-4321-a3af-3d28a3b78be3 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:55.433230 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 938/1890] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:55 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:55.434534 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d521c-6645-4687-94d8-99364768d84b service cinder] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:55.445882 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-287d521c-6645-4687-94d8-99364768d84b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:55.490367 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-46b53c14-f1fe-4321-a3af-3d28a3b78be3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b199e0f1ea2490b90941d15ef71ed65', 'request_id': 'req-46b53c14-f1fe-4321-a3af-3d28a3b78be3'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:55.502290 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d521c-6645-4687-94d8-99364768d84b service cinder] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:55.510881 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-46b53c14-f1fe-4321-a3af-3d28a3b78be3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b199e0f1ea2490b90941d15ef71ed65', 'request_id': 'req-46b53c14-f1fe-4321-a3af-3d28a3b78be3'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:55.533889 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-46b53c14-f1fe-4321-a3af-3d28a3b78be3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b199e0f1ea2490b90941d15ef71ed65', 'request_id': 'req-46b53c14-f1fe-4321-a3af-3d28a3b78be3'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:55.551506 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-46b53c14-f1fe-4321-a3af-3d28a3b78be3 admin admin] The token cache is being invalidate because project 5b199e0f1ea2490b90941d15ef71ed65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:59:55.551882 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-46b53c14-f1fe-4321-a3af-3d28a3b78be3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:55.552569 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-46b53c14-f1fe-4321-a3af-3d28a3b78be3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:55.554359 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 953/1891] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 15:59:55 2022] DELETE /identity/v3/projects/5b199e0f1ea2490b90941d15ef71ed65 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:55.560019 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e90af-9bac-4a55-9659-1b8770fa0dd5 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:55.560995 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e90af-9bac-4a55-9659-1b8770fa0dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:55.561997 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e90af-9bac-4a55-9659-1b8770fa0dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:55.602999 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-069e90af-9bac-4a55-9659-1b8770fa0dd5 None None] MFA Rules not processed for user `d95fe023ed084b2d95af8daa58ff9c38`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:55.604830 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-069e90af-9bac-4a55-9659-1b8770fa0dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:55.615830 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc15e4-15d7-445f-a002-f8dea48bdb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:55.616696 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc15e4-15d7-445f-a002-f8dea48bdb9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:55.617032 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc15e4-15d7-445f-a002-f8dea48bdb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:55.617322 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc15e4-15d7-445f-a002-f8dea48bdb9e admin admin] PATH_INFO: `/v3/users/05545e4f9f9f46b6861f5a5f29c37aec` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:55.618470 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc15e4-15d7-445f-a002-f8dea48bdb9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=05545e4f9f9f46b6861f5a5f29c37aec)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:55.620413 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc15e4-15d7-445f-a002-f8dea48bdb9e admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:55.685991 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-62dc15e4-15d7-445f-a002-f8dea48bdb9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05545e4f9f9f46b6861f5a5f29c37aec'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:55.686809 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 954/1892] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:55.687140 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e90af-9bac-4a55-9659-1b8770fa0dd5 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:55.690752 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-069e90af-9bac-4a55-9659-1b8770fa0dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:55.706344 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e90af-9bac-4a55-9659-1b8770fa0dd5 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:55.706559 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-62dc15e4-15d7-445f-a002-f8dea48bdb9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05545e4f9f9f46b6861f5a5f29c37aec'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:55.707554 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-62dc15e4-15d7-445f-a002-f8dea48bdb9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05545e4f9f9f46b6861f5a5f29c37aec'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:55.708829 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-62dc15e4-15d7-445f-a002-f8dea48bdb9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05545e4f9f9f46b6861f5a5f29c37aec'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:55.711851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970c91b-cc6d-448e-a77a-31daad055719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:55.712446 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970c91b-cc6d-448e-a77a-31daad055719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:55.712446 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970c91b-cc6d-448e-a77a-31daad055719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:55.712970 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970c91b-cc6d-448e-a77a-31daad055719 admin admin] PATH_INFO: `/v3/projects/5b8c777da67447c5af7ca47d1fb4e21d` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:55.714338 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e970c91b-cc6d-448e-a77a-31daad055719 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b8c777da67447c5af7ca47d1fb4e21d)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:55.717181 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-62dc15e4-15d7-445f-a002-f8dea48bdb9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05545e4f9f9f46b6861f5a5f29c37aec'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:55.722060 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e970c91b-cc6d-448e-a77a-31daad055719 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:55.734870 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 939/1893] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 15:59:55 2022] DELETE /identity/v3/users/05545e4f9f9f46b6861f5a5f29c37aec => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:55.736187 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc15e4-15d7-445f-a002-f8dea48bdb9e admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:55.737783 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-62dc15e4-15d7-445f-a002-f8dea48bdb9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:55.783538 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e970c91b-cc6d-448e-a77a-31daad055719 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b8c777da67447c5af7ca47d1fb4e21d', 'request_id': 'req-e970c91b-cc6d-448e-a77a-31daad055719'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:55.791011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e970c91b-cc6d-448e-a77a-31daad055719 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b8c777da67447c5af7ca47d1fb4e21d', 'request_id': 'req-e970c91b-cc6d-448e-a77a-31daad055719'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:55.798684 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e970c91b-cc6d-448e-a77a-31daad055719 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b8c777da67447c5af7ca47d1fb4e21d', 'request_id': 'req-e970c91b-cc6d-448e-a77a-31daad055719'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:55.802662 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:55.807419 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc15e4-15d7-445f-a002-f8dea48bdb9e admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:55.813885 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e970c91b-cc6d-448e-a77a-31daad055719 admin admin] The token cache is being invalidate because project 5b8c777da67447c5af7ca47d1fb4e21d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:59:55.814580 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e970c91b-cc6d-448e-a77a-31daad055719 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:55.815535 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e970c91b-cc6d-448e-a77a-31daad055719 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:55.817107 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 955/1894] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 15:59:55 2022] DELETE /identity/v3/projects/5b8c777da67447c5af7ca47d1fb4e21d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:55.817981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970c91b-cc6d-448e-a77a-31daad055719 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:55.821556 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-e970c91b-cc6d-448e-a77a-31daad055719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:55.836627 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:55.882414 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba8849-8241-4d3f-8dee-dd71238f903e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:55.883182 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba8849-8241-4d3f-8dee-dd71238f903e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:55.883530 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba8849-8241-4d3f-8dee-dd71238f903e admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:55.884133 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba8849-8241-4d3f-8dee-dd71238f903e admin admin] PATH_INFO: `/v3/users/f37871115df84d508aa19d9d3cc3ab1e` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:55.885375 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba8849-8241-4d3f-8dee-dd71238f903e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f37871115df84d508aa19d9d3cc3ab1e)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:55.887389 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba8849-8241-4d3f-8dee-dd71238f903e admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:55.888244 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970c91b-cc6d-448e-a77a-31daad055719 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:55.893202 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0393c5b-d661-4758-9bd6-bfd80ea31b7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:55.893829 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0393c5b-d661-4758-9bd6-bfd80ea31b7a service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:55.894110 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0393c5b-d661-4758-9bd6-bfd80ea31b7a service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:55.894385 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0393c5b-d661-4758-9bd6-bfd80ea31b7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:55.896368 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-d0393c5b-d661-4758-9bd6-bfd80ea31b7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:55.945617 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-dbba8849-8241-4d3f-8dee-dd71238f903e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f37871115df84d508aa19d9d3cc3ab1e'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:55.963066 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-dbba8849-8241-4d3f-8dee-dd71238f903e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f37871115df84d508aa19d9d3cc3ab1e'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:55.964349 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-dbba8849-8241-4d3f-8dee-dd71238f903e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f37871115df84d508aa19d9d3cc3ab1e'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:55.965145 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-dbba8849-8241-4d3f-8dee-dd71238f903e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f37871115df84d508aa19d9d3cc3ab1e'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:55.965612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0393c5b-d661-4758-9bd6-bfd80ea31b7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:55.967057 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0393c5b-d661-4758-9bd6-bfd80ea31b7a service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:55.974961 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-dbba8849-8241-4d3f-8dee-dd71238f903e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f37871115df84d508aa19d9d3cc3ab1e'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:55.977821 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 956/1895] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:55 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:55.978530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0393c5b-d661-4758-9bd6-bfd80ea31b7a service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:55.979917 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-d0393c5b-d661-4758-9bd6-bfd80ea31b7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:55.990401 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 940/1896] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 15:59:55 2022] DELETE /identity/v3/users/f37871115df84d508aa19d9d3cc3ab1e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:55.991572 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b08a7-602e-42b3-8ee4-fbe65b3faef9 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:55.991924 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b08a7-602e-42b3-8ee4-fbe65b3faef9 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:55.992263 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b08a7-602e-42b3-8ee4-fbe65b3faef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:55.997359 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0393c5b-d661-4758-9bd6-bfd80ea31b7a service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:56.017102 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-de0b08a7-602e-42b3-8ee4-fbe65b3faef9 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:56.018419 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-de0b08a7-602e-42b3-8ee4-fbe65b3faef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:56.073495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b16ad-ea50-40e1-b93e-f31380a99fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:56.074206 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b16ad-ea50-40e1-b93e-f31380a99fb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:56.074597 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b16ad-ea50-40e1-b93e-f31380a99fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:56.075863 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b16ad-ea50-40e1-b93e-f31380a99fb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:56.077414 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b16ad-ea50-40e1-b93e-f31380a99fb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:56.079737 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b16ad-ea50-40e1-b93e-f31380a99fb3 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:56.159715 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 957/1897] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 15:59:55 2022] POST /identity/v3/projects => generated 387 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:56.159715 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887ab47-6597-43b3-af93-af259bec3546 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:56.160118 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887ab47-6597-43b3-af93-af259bec3546 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:56.160336 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887ab47-6597-43b3-af93-af259bec3546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:56.174042 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 941/1898] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:56.174769 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b08a7-602e-42b3-8ee4-fbe65b3faef9 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:56.180694 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-de0b08a7-602e-42b3-8ee4-fbe65b3faef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:56.185028 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-0887ab47-6597-43b3-af93-af259bec3546 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:56.186239 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-0887ab47-6597-43b3-af93-af259bec3546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:56.221317 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b08a7-602e-42b3-8ee4-fbe65b3faef9 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:56.253648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:56.309043 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:56.343040 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 958/1899] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:56.347647 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0887ab47-6597-43b3-af93-af259bec3546 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:56.349094 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-0887ab47-6597-43b3-af93-af259bec3546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:56.404705 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de7a878-6e3b-472c-acc4-30d3b946b91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:56.406808 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7a878-6e3b-472c-acc4-30d3b946b91a admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:56.407207 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7a878-6e3b-472c-acc4-30d3b946b91a admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:56.407512 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7a878-6e3b-472c-acc4-30d3b946b91a admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:56.408267 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de7a878-6e3b-472c-acc4-30d3b946b91a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:56.411347 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de7a878-6e3b-472c-acc4-30d3b946b91a admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:56.447731 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 942/1900] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:59:56 2022] POST /identity/v3/users => generated 300 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:56.449856 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c15e19-7f66-43b0-a807-e6c02dec4ff0 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:56.450486 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c15e19-7f66-43b0-a807-e6c02dec4ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:56.450831 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c15e19-7f66-43b0-a807-e6c02dec4ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:56.487391 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0887ab47-6597-43b3-af93-af259bec3546 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:56.488027 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-33c15e19-7f66-43b0-a807-e6c02dec4ff0 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:56.492284 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571675df-734c-43b8-a52e-04d651835512 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:56.492561 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-33c15e19-7f66-43b0-a807-e6c02dec4ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:56.492937 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571675df-734c-43b8-a52e-04d651835512 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:56.493217 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571675df-734c-43b8-a52e-04d651835512 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:56.493486 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571675df-734c-43b8-a52e-04d651835512 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:56.508028 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571675df-734c-43b8-a52e-04d651835512 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:56.510042 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571675df-734c-43b8-a52e-04d651835512 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:56.521871 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 943/1901] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:56.521871 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c15e19-7f66-43b0-a807-e6c02dec4ff0 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:56.521871 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-33c15e19-7f66-43b0-a807-e6c02dec4ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:56.533654 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 959/1902] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:56.534874 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571675df-734c-43b8-a52e-04d651835512 service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:56.579045 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c15e19-7f66-43b0-a807-e6c02dec4ff0 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:56.593736 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570d30a-8dd5-47ce-8bdd-b3468bb98dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:56.594907 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570d30a-8dd5-47ce-8bdd-b3468bb98dfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:56.595402 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570d30a-8dd5-47ce-8bdd-b3468bb98dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:56.596071 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571675df-734c-43b8-a52e-04d651835512 service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:56.596530 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570d30a-8dd5-47ce-8bdd-b3468bb98dfd admin admin] PATH_INFO: `/v3/projects/26cf794b463c4804af97646dff33fb6e` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:56.598940 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d570d30a-8dd5-47ce-8bdd-b3468bb98dfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=26cf794b463c4804af97646dff33fb6e)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:56.603437 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d570d30a-8dd5-47ce-8bdd-b3468bb98dfd admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:56.610714 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158237d-cc52-4d28-ab45-a9944c75514b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:56.611760 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158237d-cc52-4d28-ab45-a9944c75514b admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:56.612181 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158237d-cc52-4d28-ab45-a9944c75514b admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:56.612610 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158237d-cc52-4d28-ab45-a9944c75514b admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:56.614105 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c158237d-cc52-4d28-ab45-a9944c75514b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:56.619262 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c158237d-cc52-4d28-ab45-a9944c75514b admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:56.653056 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 960/1903] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:56.653056 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158237d-cc52-4d28-ab45-a9944c75514b admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:56.678508 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158237d-cc52-4d28-ab45-a9944c75514b admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:56.685241 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa7b4b-ad85-4c98-803c-1bfa2f9fe9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:56.685876 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa7b4b-ad85-4c98-803c-1bfa2f9fe9fe admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:56.687026 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa7b4b-ad85-4c98-803c-1bfa2f9fe9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:56.687647 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa7b4b-ad85-4c98-803c-1bfa2f9fe9fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:56.688200 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfa7b4b-ad85-4c98-803c-1bfa2f9fe9fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:59:56.688586 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfa7b4b-ad85-4c98-803c-1bfa2f9fe9fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:56.690817 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfa7b4b-ad85-4c98-803c-1bfa2f9fe9fe admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:56.711843 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 961/1904] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 15:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:59:56.712748 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa7b4b-ad85-4c98-803c-1bfa2f9fe9fe admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:56.718240 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-d570d30a-8dd5-47ce-8bdd-b3468bb98dfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26cf794b463c4804af97646dff33fb6e', 'request_id': 'req-d570d30a-8dd5-47ce-8bdd-b3468bb98dfd'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:56.733141 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-d570d30a-8dd5-47ce-8bdd-b3468bb98dfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26cf794b463c4804af97646dff33fb6e', 'request_id': 'req-d570d30a-8dd5-47ce-8bdd-b3468bb98dfd'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:56.735905 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa7b4b-ad85-4c98-803c-1bfa2f9fe9fe admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:56.745894 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-d570d30a-8dd5-47ce-8bdd-b3468bb98dfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26cf794b463c4804af97646dff33fb6e', 'request_id': 'req-d570d30a-8dd5-47ce-8bdd-b3468bb98dfd'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:56.763857 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-d570d30a-8dd5-47ce-8bdd-b3468bb98dfd admin admin] The token cache is being invalidate because project 26cf794b463c4804af97646dff33fb6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:59:56.764253 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-d570d30a-8dd5-47ce-8bdd-b3468bb98dfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:56.765876 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-d570d30a-8dd5-47ce-8bdd-b3468bb98dfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:56.767712 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 944/1905] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 15:59:56 2022] DELETE /identity/v3/projects/26cf794b463c4804af97646dff33fb6e => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:56.768522 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570d30a-8dd5-47ce-8bdd-b3468bb98dfd admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:56.772019 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-d570d30a-8dd5-47ce-8bdd-b3468bb98dfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:56.830168 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff91d9-e4c9-4d85-8ed6-04fb6a72784f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:56.830870 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff91d9-e4c9-4d85-8ed6-04fb6a72784f admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:56.831246 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff91d9-e4c9-4d85-8ed6-04fb6a72784f admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:56.831529 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff91d9-e4c9-4d85-8ed6-04fb6a72784f admin admin] PATH_INFO: `/v3/projects/0431a6d633934ac298a25294a8e97a9c/users/0ec938a2a23d44d4ab81feedb05286f5/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:56.850758 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff91d9-e4c9-4d85-8ed6-04fb6a72784f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0431a6d633934ac298a25294a8e97a9c, user_id=0ec938a2a23d44d4ab81feedb05286f5, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:56.853615 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff91d9-e4c9-4d85-8ed6-04fb6a72784f admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:56.869377 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570d30a-8dd5-47ce-8bdd-b3468bb98dfd admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:56.874190 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 962/1906] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:56 2022] PUT /identity/v3/projects/0431a6d633934ac298a25294a8e97a9c/users/0ec938a2a23d44d4ab81feedb05286f5/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:56.874190 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae715e-d6a7-49e9-a9e4-d520cf9421ae None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:56.874190 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae715e-d6a7-49e9-a9e4-d520cf9421ae None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:56.874190 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae715e-d6a7-49e9-a9e4-d520cf9421ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:56.897172 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-99ae715e-d6a7-49e9-a9e4-d520cf9421ae None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:56.898409 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-99ae715e-d6a7-49e9-a9e4-d520cf9421ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:56.935664 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:56.935967 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:56.953406 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b6a83-ac03-45fb-9be9-2b71d79287c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:56.954288 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b6a83-ac03-45fb-9be9-2b71d79287c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:56.954754 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b6a83-ac03-45fb-9be9-2b71d79287c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:56.955260 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b6a83-ac03-45fb-9be9-2b71d79287c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:56.956835 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b6a83-ac03-45fb-9be9-2b71d79287c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:56.960133 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b6a83-ac03-45fb-9be9-2b71d79287c0 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:57.012861 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 963/1907] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:57.013251 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 945/1908] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 15:59:56 2022] POST /identity/v3/projects => generated 401 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:57.014279 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b6a83-ac03-45fb-9be9-2b71d79287c0 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:57.016341 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-514b6a83-ac03-45fb-9be9-2b71d79287c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:57.017183 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae715e-d6a7-49e9-a9e4-d520cf9421ae None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:57.018737 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-99ae715e-d6a7-49e9-a9e4-d520cf9421ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:57.030880 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae715e-d6a7-49e9-a9e4-d520cf9421ae None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:57.081269 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b6a83-ac03-45fb-9be9-2b71d79287c0 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:57.085883 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72884fa-e0d2-4343-bc68-fd3d0146c604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:57.086033 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4981a34e-0efe-49c7-a2ef-fcbba5d7bdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:57.086494 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72884fa-e0d2-4343-bc68-fd3d0146c604 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:57.086609 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981a34e-0efe-49c7-a2ef-fcbba5d7bdfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:57.086770 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72884fa-e0d2-4343-bc68-fd3d0146c604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:57.086867 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981a34e-0efe-49c7-a2ef-fcbba5d7bdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:57.087498 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72884fa-e0d2-4343-bc68-fd3d0146c604 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:57.087665 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981a34e-0efe-49c7-a2ef-fcbba5d7bdfb admin admin] PATH_INFO: `/v3/projects/bae9d71ce4a741daaf8da573fdb354fb` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:57.087762 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72884fa-e0d2-4343-bc68-fd3d0146c604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:57.088212 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4981a34e-0efe-49c7-a2ef-fcbba5d7bdfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=bae9d71ce4a741daaf8da573fdb354fb)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:57.089317 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72884fa-e0d2-4343-bc68-fd3d0146c604 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:57.090147 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4981a34e-0efe-49c7-a2ef-fcbba5d7bdfb admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:57.099634 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 964/1909] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:57.100425 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72884fa-e0d2-4343-bc68-fd3d0146c604 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:57.112302 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72884fa-e0d2-4343-bc68-fd3d0146c604 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:57.117072 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b30d0-b155-4b3b-8303-6b3f76dae8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:57.117696 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b30d0-b155-4b3b-8303-6b3f76dae8f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:57.117975 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b30d0-b155-4b3b-8303-6b3f76dae8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:57.118483 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b30d0-b155-4b3b-8303-6b3f76dae8f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:57.119254 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b30d0-b155-4b3b-8303-6b3f76dae8f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:57.121658 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b30d0-b155-4b3b-8303-6b3f76dae8f8 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:57.139250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4981a34e-0efe-49c7-a2ef-fcbba5d7bdfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bae9d71ce4a741daaf8da573fdb354fb', 'request_id': 'req-4981a34e-0efe-49c7-a2ef-fcbba5d7bdfb'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:57.145042 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4981a34e-0efe-49c7-a2ef-fcbba5d7bdfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bae9d71ce4a741daaf8da573fdb354fb', 'request_id': 'req-4981a34e-0efe-49c7-a2ef-fcbba5d7bdfb'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:57.156842 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4981a34e-0efe-49c7-a2ef-fcbba5d7bdfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bae9d71ce4a741daaf8da573fdb354fb', 'request_id': 'req-4981a34e-0efe-49c7-a2ef-fcbba5d7bdfb'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:57.165599 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 965/1910] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:59:57 2022] POST /identity/v3/users => generated 301 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:57.167167 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce130f14-d079-4841-9dfe-c165f39666b2 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:57.167673 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce130f14-d079-4841-9dfe-c165f39666b2 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:57.167947 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce130f14-d079-4841-9dfe-c165f39666b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:57.170368 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4981a34e-0efe-49c7-a2ef-fcbba5d7bdfb admin admin] The token cache is being invalidate because project bae9d71ce4a741daaf8da573fdb354fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:59:57.171379 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4981a34e-0efe-49c7-a2ef-fcbba5d7bdfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:57.172038 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4981a34e-0efe-49c7-a2ef-fcbba5d7bdfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:57.173555 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 946/1911] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 15:59:57 2022] DELETE /identity/v3/projects/bae9d71ce4a741daaf8da573fdb354fb => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:57.174304 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4981a34e-0efe-49c7-a2ef-fcbba5d7bdfb admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:57.175584 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-4981a34e-0efe-49c7-a2ef-fcbba5d7bdfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:57.192164 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-ce130f14-d079-4841-9dfe-c165f39666b2 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:57.193399 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-ce130f14-d079-4841-9dfe-c165f39666b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:57.242497 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4981a34e-0efe-49c7-a2ef-fcbba5d7bdfb admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:57.248196 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276ddf2-31d2-45de-8610-2b9cbd26360a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:57.249143 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276ddf2-31d2-45de-8610-2b9cbd26360a admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:57.249428 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276ddf2-31d2-45de-8610-2b9cbd26360a admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:57.249701 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276ddf2-31d2-45de-8610-2b9cbd26360a admin admin] PATH_INFO: `/v3/projects/0431a6d633934ac298a25294a8e97a9c/users/0ec938a2a23d44d4ab81feedb05286f5/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:57.251719 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0276ddf2-31d2-45de-8610-2b9cbd26360a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0431a6d633934ac298a25294a8e97a9c, user_id=0ec938a2a23d44d4ab81feedb05286f5, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:57.255384 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0276ddf2-31d2-45de-8610-2b9cbd26360a admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:57.259410 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 966/1912] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:57.260273 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce130f14-d079-4841-9dfe-c165f39666b2 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:57.261709 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-ce130f14-d079-4841-9dfe-c165f39666b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:57.271974 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 947/1913] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:57 2022] PUT /identity/v3/projects/0431a6d633934ac298a25294a8e97a9c/users/0ec938a2a23d44d4ab81feedb05286f5/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:57.274490 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce130f14-d079-4841-9dfe-c165f39666b2 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:57.278401 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e239df-5ad6-49d1-891b-bdbe2764869e None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:57.280411 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e239df-5ad6-49d1-891b-bdbe2764869e None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:57.281213 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e239df-5ad6-49d1-891b-bdbe2764869e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:57.289530 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:57.305796 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-06e239df-5ad6-49d1-891b-bdbe2764869e None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:57.307830 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-06e239df-5ad6-49d1-891b-bdbe2764869e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:57.334891 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:57.345014 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc1845-7b05-45b6-9e98-abd79eca0ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:57.346227 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc1845-7b05-45b6-9e98-abd79eca0ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:57.346883 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc1845-7b05-45b6-9e98-abd79eca0ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:57.347528 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc1845-7b05-45b6-9e98-abd79eca0ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:57.347925 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc1845-7b05-45b6-9e98-abd79eca0ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:57.349851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc1845-7b05-45b6-9e98-abd79eca0ea0 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:57.367136 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 967/1914] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:57.367136 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc1845-7b05-45b6-9e98-abd79eca0ea0 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:57.378033 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc1845-7b05-45b6-9e98-abd79eca0ea0 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:57.383968 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d165f4-2590-4a03-9c7b-1056539cc2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:57.384695 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d165f4-2590-4a03-9c7b-1056539cc2f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:57.385005 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d165f4-2590-4a03-9c7b-1056539cc2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:57.385281 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d165f4-2590-4a03-9c7b-1056539cc2f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:57.385983 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 948/1915] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:57.387348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d4046-c628-4396-bc8c-7e8e27242f8e None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:57.387638 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d4046-c628-4396-bc8c-7e8e27242f8e None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:57.387913 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d4046-c628-4396-bc8c-7e8e27242f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:57.388955 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d165f4-2590-4a03-9c7b-1056539cc2f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:59:57.389685 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d165f4-2590-4a03-9c7b-1056539cc2f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:57.392813 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d165f4-2590-4a03-9c7b-1056539cc2f4 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:57.409328 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 968/1916] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 15:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:59:57.410250 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d165f4-2590-4a03-9c7b-1056539cc2f4 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:57.422248 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-0d7d4046-c628-4396-bc8c-7e8e27242f8e None None] MFA Rules not processed for user `0ec938a2a23d44d4ab81feedb05286f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:57.423319 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-0d7d4046-c628-4396-bc8c-7e8e27242f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:57.425746 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d165f4-2590-4a03-9c7b-1056539cc2f4 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:57.432739 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0ee8d-6aa8-4698-ad73-e4f1f1b05373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:57.433719 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0ee8d-6aa8-4698-ad73-e4f1f1b05373 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:57.434054 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0ee8d-6aa8-4698-ad73-e4f1f1b05373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:57.434365 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0ee8d-6aa8-4698-ad73-e4f1f1b05373 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:57.435674 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0ee8d-6aa8-4698-ad73-e4f1f1b05373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:57.438996 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0ee8d-6aa8-4698-ad73-e4f1f1b05373 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:57.456896 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 969/1917] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:57.456896 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95061cc-5f60-4c5b-8dca-9647ef147c01 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:57.456896 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95061cc-5f60-4c5b-8dca-9647ef147c01 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:57.456896 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95061cc-5f60-4c5b-8dca-9647ef147c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:57.480657 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-b95061cc-5f60-4c5b-8dca-9647ef147c01 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:57.482121 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-b95061cc-5f60-4c5b-8dca-9647ef147c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:57.496032 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 970/1918] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:57.500982 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95061cc-5f60-4c5b-8dca-9647ef147c01 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:57.513051 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95061cc-5f60-4c5b-8dca-9647ef147c01 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:57.519365 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba678a5-b807-4e9c-9e52-98118aed1ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:57.519992 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba678a5-b807-4e9c-9e52-98118aed1ad5 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:57.520412 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba678a5-b807-4e9c-9e52-98118aed1ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:57.520678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba678a5-b807-4e9c-9e52-98118aed1ad5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:57.522093 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba678a5-b807-4e9c-9e52-98118aed1ad5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:57.523649 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba678a5-b807-4e9c-9e52-98118aed1ad5 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:57.537325 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 949/1919] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:57 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:57.538703 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d4046-c628-4396-bc8c-7e8e27242f8e None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:57.554547 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d4046-c628-4396-bc8c-7e8e27242f8e None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:57.559662 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5416871a-e447-4cba-8db8-a32a50d09504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:57.560511 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416871a-e447-4cba-8db8-a32a50d09504 admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:57.560992 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416871a-e447-4cba-8db8-a32a50d09504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:57.562108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416871a-e447-4cba-8db8-a32a50d09504 admin admin] PATH_INFO: `/v3/projects/813b92d8308345bab7a78fabb0585711/users/34a0a755c412470dbfb3198d2440aac9/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:57.570265 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 971/1920] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 15:59:57 2022] POST /identity/v3/projects => generated 369 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:57.572150 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba678a5-b807-4e9c-9e52-98118aed1ad5 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:57.581992 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5416871a-e447-4cba-8db8-a32a50d09504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=813b92d8308345bab7a78fabb0585711, user_id=34a0a755c412470dbfb3198d2440aac9, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:57.586310 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5416871a-e447-4cba-8db8-a32a50d09504 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:57.611872 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 950/1921] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:57 2022] PUT /identity/v3/projects/813b92d8308345bab7a78fabb0585711/users/34a0a755c412470dbfb3198d2440aac9/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:57.613074 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5416871a-e447-4cba-8db8-a32a50d09504 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:57.615250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-5416871a-e447-4cba-8db8-a32a50d09504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:57.645717 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba678a5-b807-4e9c-9e52-98118aed1ad5 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:57.705068 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5416871a-e447-4cba-8db8-a32a50d09504 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:57.706242 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b8aeb6-deef-46ec-8604-97817578a6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:57.706747 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b8aeb6-deef-46ec-8604-97817578a6b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:57.707029 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b8aeb6-deef-46ec-8604-97817578a6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:57.707301 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b8aeb6-deef-46ec-8604-97817578a6b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:57.707959 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b8aeb6-deef-46ec-8604-97817578a6b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:59:57.708262 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b8aeb6-deef-46ec-8604-97817578a6b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:57.709775 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef21aed-dc48-48c9-8911-a7b78f109c29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:57.709905 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b8aeb6-deef-46ec-8604-97817578a6b7 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:57.711020 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef21aed-dc48-48c9-8911-a7b78f109c29 service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:57.711020 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef21aed-dc48-48c9-8911-a7b78f109c29 service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:57.711199 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef21aed-dc48-48c9-8911-a7b78f109c29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:57.738798 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 972/1922] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 15:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:59:57.739697 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b8aeb6-deef-46ec-8604-97817578a6b7 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:57.749811 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:57.757768 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b8aeb6-deef-46ec-8604-97817578a6b7 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:57.764870 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884be0c3-fcac-4dd0-af03-bd17bf3cac08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:57.765502 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884be0c3-fcac-4dd0-af03-bd17bf3cac08 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:57.765796 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884be0c3-fcac-4dd0-af03-bd17bf3cac08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:57.766033 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884be0c3-fcac-4dd0-af03-bd17bf3cac08 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:57.766690 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884be0c3-fcac-4dd0-af03-bd17bf3cac08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:57.768609 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884be0c3-fcac-4dd0-af03-bd17bf3cac08 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:57.799628 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 973/1923] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:59:57 2022] POST /identity/v3/users => generated 285 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:57.799628 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2ef39-98a4-45f1-a475-0cf3e0bd0aca None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:57.799628 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2ef39-98a4-45f1-a475-0cf3e0bd0aca None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:57.799628 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2ef39-98a4-45f1-a475-0cf3e0bd0aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:57.814863 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef21aed-dc48-48c9-8911-a7b78f109c29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:57.816901 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef21aed-dc48-48c9-8911-a7b78f109c29 service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:57.835446 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-d3a2ef39-98a4-45f1-a475-0cf3e0bd0aca None None] MFA Rules not processed for user `34a0a755c412470dbfb3198d2440aac9`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:57.837262 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-d3a2ef39-98a4-45f1-a475-0cf3e0bd0aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:57.848814 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 951/1924] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:57 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:57.851662 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef21aed-dc48-48c9-8911-a7b78f109c29 service cinder] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:57.854212 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:57.879176 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef21aed-dc48-48c9-8911-a7b78f109c29 service cinder] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:57.890908 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e0e5a-f6cf-47cf-9891-fa3b1116373d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:57.891541 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e0e5a-f6cf-47cf-9891-fa3b1116373d admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:57.891815 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e0e5a-f6cf-47cf-9891-fa3b1116373d admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:57.892085 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e0e5a-f6cf-47cf-9891-fa3b1116373d admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:57.894418 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e0e5a-f6cf-47cf-9891-fa3b1116373d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:57.899648 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e0e5a-f6cf-47cf-9891-fa3b1116373d admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:57.938803 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 974/1925] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:57 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:57.939850 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2ef39-98a4-45f1-a475-0cf3e0bd0aca None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:57.956761 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2ef39-98a4-45f1-a475-0cf3e0bd0aca None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:57.965186 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 952/1926] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 15:59:57 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:57.965333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2fcbc-548d-449f-9497-f4ed072ed177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:57.965455 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e0e5a-f6cf-47cf-9891-fa3b1116373d admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:57.965530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2fcbc-548d-449f-9497-f4ed072ed177 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:57.965530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2fcbc-548d-449f-9497-f4ed072ed177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:57.965530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2fcbc-548d-449f-9497-f4ed072ed177 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:57.965530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c2fcbc-548d-449f-9497-f4ed072ed177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:57.967350 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c2fcbc-548d-449f-9497-f4ed072ed177 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:57.982956 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 975/1927] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:57.984128 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2fcbc-548d-449f-9497-f4ed072ed177 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:57.998333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2fcbc-548d-449f-9497-f4ed072ed177 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:58.077981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cafaf32-3079-4075-ae80-32c86ddc74bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:58.079323 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cafaf32-3079-4075-ae80-32c86ddc74bf admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:58.079323 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cafaf32-3079-4075-ae80-32c86ddc74bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:58.079323 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cafaf32-3079-4075-ae80-32c86ddc74bf admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:58.080874 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cafaf32-3079-4075-ae80-32c86ddc74bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:58.084716 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cafaf32-3079-4075-ae80-32c86ddc74bf admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:58.098303 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e0e5a-f6cf-47cf-9891-fa3b1116373d admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:58.105492 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c390f5-7bfb-4e39-8cf6-aeeb34b069ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:58.106653 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c390f5-7bfb-4e39-8cf6-aeeb34b069ad admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:58.107116 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c390f5-7bfb-4e39-8cf6-aeeb34b069ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:58.107704 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c390f5-7bfb-4e39-8cf6-aeeb34b069ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:58.108704 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c390f5-7bfb-4e39-8cf6-aeeb34b069ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:58.111250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c390f5-7bfb-4e39-8cf6-aeeb34b069ad admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:58.117250 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 976/1928] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:59:57 2022] POST /identity/v3/users => generated 288 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:58.117250 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cafaf32-3079-4075-ae80-32c86ddc74bf admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:58.132439 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cafaf32-3079-4075-ae80-32c86ddc74bf admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:58.142622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75679556-e43e-4aed-8207-1d2389c729c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:58.143389 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75679556-e43e-4aed-8207-1d2389c729c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:58.144157 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75679556-e43e-4aed-8207-1d2389c729c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:58.144336 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75679556-e43e-4aed-8207-1d2389c729c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:58.145166 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75679556-e43e-4aed-8207-1d2389c729c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:58.147574 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75679556-e43e-4aed-8207-1d2389c729c5 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:58.162071 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 977/1929] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:58.163331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75679556-e43e-4aed-8207-1d2389c729c5 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:58.173004 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 953/1930] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 15:59:57 2022] POST /identity/v3/projects => generated 399 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:58.174505 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c390f5-7bfb-4e39-8cf6-aeeb34b069ad admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:58.181344 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75679556-e43e-4aed-8207-1d2389c729c5 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:58.277784 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56dd4e9-a84b-49b2-8a6b-f2e2423a38cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:58.278805 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56dd4e9-a84b-49b2-8a6b-f2e2423a38cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:58.279153 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56dd4e9-a84b-49b2-8a6b-f2e2423a38cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:58.279497 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56dd4e9-a84b-49b2-8a6b-f2e2423a38cf admin admin] PATH_INFO: `/v3/users/d95fe023ed084b2d95af8daa58ff9c38` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:58.280588 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c390f5-7bfb-4e39-8cf6-aeeb34b069ad admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:58.281965 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56dd4e9-a84b-49b2-8a6b-f2e2423a38cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d95fe023ed084b2d95af8daa58ff9c38)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:58.284734 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56dd4e9-a84b-49b2-8a6b-f2e2423a38cf admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:58.286202 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce3a1c-86ac-4284-a179-ab0854521b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:58.287207 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce3a1c-86ac-4284-a179-ab0854521b5b admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:58.287568 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce3a1c-86ac-4284-a179-ab0854521b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:58.288293 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce3a1c-86ac-4284-a179-ab0854521b5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:58.289067 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce3a1c-86ac-4284-a179-ab0854521b5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:58.291731 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce3a1c-86ac-4284-a179-ab0854521b5b admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:58.310042 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 954/1931] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:58.314702 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce3a1c-86ac-4284-a179-ab0854521b5b admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:58.316496 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:58.328152 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce3a1c-86ac-4284-a179-ab0854521b5b admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:58.334485 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127df09d-ca79-4e57-ad32-67c67976d7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:58.335166 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127df09d-ca79-4e57-ad32-67c67976d7f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:58.335531 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127df09d-ca79-4e57-ad32-67c67976d7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:58.335863 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127df09d-ca79-4e57-ad32-67c67976d7f3 admin admin] PATH_INFO: `/v3/projects/15f5518b27d6430b8a93d4b11d0cd784/users/cd44c24624bc4e38a84efa42533f284b/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:58.353025 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:58.361076 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127df09d-ca79-4e57-ad32-67c67976d7f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15f5518b27d6430b8a93d4b11d0cd784, user_id=cd44c24624bc4e38a84efa42533f284b, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:58.364338 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127df09d-ca79-4e57-ad32-67c67976d7f3 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:58.366208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a56dd4e9-a84b-49b2-8a6b-f2e2423a38cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd95fe023ed084b2d95af8daa58ff9c38'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:58.366949 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a56dd4e9-a84b-49b2-8a6b-f2e2423a38cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd95fe023ed084b2d95af8daa58ff9c38'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:58.381283 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a56dd4e9-a84b-49b2-8a6b-f2e2423a38cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd95fe023ed084b2d95af8daa58ff9c38'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:58.396157 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 955/1932] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:58 2022] PUT /identity/v3/projects/15f5518b27d6430b8a93d4b11d0cd784/users/cd44c24624bc4e38a84efa42533f284b/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:58.396157 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127df09d-ca79-4e57-ad32-67c67976d7f3 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:58.396157 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-127df09d-ca79-4e57-ad32-67c67976d7f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:58.400579 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a56dd4e9-a84b-49b2-8a6b-f2e2423a38cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd95fe023ed084b2d95af8daa58ff9c38'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:58.412524 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a56dd4e9-a84b-49b2-8a6b-f2e2423a38cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd95fe023ed084b2d95af8daa58ff9c38'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:58.424374 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 978/1933] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 15:59:58 2022] DELETE /identity/v3/users/d95fe023ed084b2d95af8daa58ff9c38 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:58.426235 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56dd4e9-a84b-49b2-8a6b-f2e2423a38cf admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:58.427436 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-a56dd4e9-a84b-49b2-8a6b-f2e2423a38cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:58.485627 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127df09d-ca79-4e57-ad32-67c67976d7f3 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:58.541208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56dd4e9-a84b-49b2-8a6b-f2e2423a38cf admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:58.557978 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63e24a-a116-4bf5-a7fd-3cc3cef99604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:58.559077 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63e24a-a116-4bf5-a7fd-3cc3cef99604 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:58.559750 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63e24a-a116-4bf5-a7fd-3cc3cef99604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:58.560107 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63e24a-a116-4bf5-a7fd-3cc3cef99604 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:58.563574 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63e24a-a116-4bf5-a7fd-3cc3cef99604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:58.566868 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63e24a-a116-4bf5-a7fd-3cc3cef99604 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:58.583030 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c520a3f-1e0b-4480-b169-1abfe91b2713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:58.584337 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c520a3f-1e0b-4480-b169-1abfe91b2713 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:58.585265 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c520a3f-1e0b-4480-b169-1abfe91b2713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:58.585729 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c520a3f-1e0b-4480-b169-1abfe91b2713 admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:58.587230 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c520a3f-1e0b-4480-b169-1abfe91b2713 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:58.588633 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 979/1934] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:58.590765 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c520a3f-1e0b-4480-b169-1abfe91b2713 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:58.591313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5da6c1-5bd9-4a7a-aeb9-a14aaf074717 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:58.591961 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5da6c1-5bd9-4a7a-aeb9-a14aaf074717 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:58.592583 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5da6c1-5bd9-4a7a-aeb9-a14aaf074717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:58.639213 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 956/1935] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:59:58 2022] POST /identity/v3/users => generated 306 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:58.639213 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40855b99-2d1e-498f-a015-6044c95c1105 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:58.639213 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40855b99-2d1e-498f-a015-6044c95c1105 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:58.639213 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40855b99-2d1e-498f-a015-6044c95c1105 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:58.641462 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 957/1936] 10.222.0.25 () {54 vars in 921 bytes} [Tue Aug 30 15:59:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:59:58.642787 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5159f-8f71-4996-bc61-578e85a48247 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:58.643147 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5159f-8f71-4996-bc61-578e85a48247 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:58.643494 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5159f-8f71-4996-bc61-578e85a48247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:58.654392 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-9e5da6c1-5bd9-4a7a-aeb9-a14aaf074717 None None] MFA Rules not processed for user `cd44c24624bc4e38a84efa42533f284b`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:58.656242 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-9e5da6c1-5bd9-4a7a-aeb9-a14aaf074717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:58.677946 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-1db5159f-8f71-4996-bc61-578e85a48247 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:58.679163 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-1db5159f-8f71-4996-bc61-578e85a48247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:58.693258 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 958/1937] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:58.693258 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5159f-8f71-4996-bc61-578e85a48247 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:58.702288 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5159f-8f71-4996-bc61-578e85a48247 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:58.714397 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5afc5-3b0c-484d-a3f8-60fda66160f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:58.715065 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5afc5-3b0c-484d-a3f8-60fda66160f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:58.715341 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5afc5-3b0c-484d-a3f8-60fda66160f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:58.715610 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5afc5-3b0c-484d-a3f8-60fda66160f2 admin admin] PATH_INFO: `/v3/projects/d6cf18bcda2d47c799c78e54473c4a6b/users/d337651be07e402e97dd54661db4d2c8/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:58.744628 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f5afc5-3b0c-484d-a3f8-60fda66160f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6cf18bcda2d47c799c78e54473c4a6b, user_id=d337651be07e402e97dd54661db4d2c8, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:58.748638 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f5afc5-3b0c-484d-a3f8-60fda66160f2 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:58.772164 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 980/1938] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:58.773045 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5da6c1-5bd9-4a7a-aeb9-a14aaf074717 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:58.785189 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 959/1939] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:58 2022] PUT /identity/v3/projects/d6cf18bcda2d47c799c78e54473c4a6b/users/d337651be07e402e97dd54661db4d2c8/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:58.785189 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d8d4a-7440-442a-94e4-e06e6f069f6b None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:58.785189 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d8d4a-7440-442a-94e4-e06e6f069f6b None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:58.785189 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d8d4a-7440-442a-94e4-e06e6f069f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:58.797944 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5da6c1-5bd9-4a7a-aeb9-a14aaf074717 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:58.813389 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-6f1d8d4a-7440-442a-94e4-e06e6f069f6b None None] MFA Rules not processed for user `ebc80bf891614fb895af33ca1ded6b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:58.814909 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-6f1d8d4a-7440-442a-94e4-e06e6f069f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:58.823079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:58.876564 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02559cdf-e9df-4072-a8c2-85230666af64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:58.877226 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02559cdf-e9df-4072-a8c2-85230666af64 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:58.878816 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02559cdf-e9df-4072-a8c2-85230666af64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:58.879009 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02559cdf-e9df-4072-a8c2-85230666af64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:58.880155 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:58.881100 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02559cdf-e9df-4072-a8c2-85230666af64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:58.882721 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02559cdf-e9df-4072-a8c2-85230666af64 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:58.903438 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 981/1940] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:58.904536 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02559cdf-e9df-4072-a8c2-85230666af64 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:58.908327 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-02559cdf-e9df-4072-a8c2-85230666af64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:58.923381 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 960/1941] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Aug 30 15:59:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:58.924200 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d8d4a-7440-442a-94e4-e06e6f069f6b None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:58.927860 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-6f1d8d4a-7440-442a-94e4-e06e6f069f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:58.956279 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d8d4a-7440-442a-94e4-e06e6f069f6b None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:58.962949 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1edeab-3e7b-476c-beaa-8c9b5c137f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:58.964477 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1edeab-3e7b-476c-beaa-8c9b5c137f28 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:58.964477 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1edeab-3e7b-476c-beaa-8c9b5c137f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:58.964477 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1edeab-3e7b-476c-beaa-8c9b5c137f28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:58.965655 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1edeab-3e7b-476c-beaa-8c9b5c137f28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:58.968445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1edeab-3e7b-476c-beaa-8c9b5c137f28 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:58.996635 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02559cdf-e9df-4072-a8c2-85230666af64 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:59.001939 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031aa6a-8523-4fa4-a8f9-24f0f18f2081 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:59.002569 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031aa6a-8523-4fa4-a8f9-24f0f18f2081 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:59.002854 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031aa6a-8523-4fa4-a8f9-24f0f18f2081 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:59.003127 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031aa6a-8523-4fa4-a8f9-24f0f18f2081 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:59.008975 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 961/1942] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 15:59:58 2022] POST /identity/v3/projects => generated 369 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:59.010534 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6896e15-0827-420d-910a-4447b7b7934f None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:59.011204 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6896e15-0827-420d-910a-4447b7b7934f None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:59.011204 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6896e15-0827-420d-910a-4447b7b7934f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:59.022910 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031aa6a-8523-4fa4-a8f9-24f0f18f2081 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:59.025788 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031aa6a-8523-4fa4-a8f9-24f0f18f2081 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:59.038538 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 982/1943] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:59.039655 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031aa6a-8523-4fa4-a8f9-24f0f18f2081 service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:59.053486 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-f6896e15-0827-420d-910a-4447b7b7934f None None] MFA Rules not processed for user `d337651be07e402e97dd54661db4d2c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:59.053693 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031aa6a-8523-4fa4-a8f9-24f0f18f2081 service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:59.055271 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-f6896e15-0827-420d-910a-4447b7b7934f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:59.145057 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48010c21-4b33-4b61-bab7-4c24c42f4f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:59.145634 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48010c21-4b33-4b61-bab7-4c24c42f4f16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:59.145915 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48010c21-4b33-4b61-bab7-4c24c42f4f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:59.146189 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48010c21-4b33-4b61-bab7-4c24c42f4f16 admin admin] PATH_INFO: `/v3/projects/9c35add69405475fa5af087b371948fc/users/8c0dd5e42ec249dd88515a916d690c28/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:59.166308 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48010c21-4b33-4b61-bab7-4c24c42f4f16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c35add69405475fa5af087b371948fc, user_id=8c0dd5e42ec249dd88515a916d690c28, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:59.170268 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48010c21-4b33-4b61-bab7-4c24c42f4f16 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:59.171169 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 962/1944] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:59:59.172283 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6896e15-0827-420d-910a-4447b7b7934f None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:59.174071 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-f6896e15-0827-420d-910a-4447b7b7934f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:59.191865 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 983/1945] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:59 2022] PUT /identity/v3/projects/9c35add69405475fa5af087b371948fc/users/8c0dd5e42ec249dd88515a916d690c28/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:59.192943 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48010c21-4b33-4b61-bab7-4c24c42f4f16 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:59.287253 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:59.308302 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48010c21-4b33-4b61-bab7-4c24c42f4f16 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:59.309208 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6896e15-0827-420d-910a-4447b7b7934f None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:59.313987 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7add9df-3c6b-471e-9968-ece0a20414e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:59.314692 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7add9df-3c6b-471e-9968-ece0a20414e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:59.315087 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7add9df-3c6b-471e-9968-ece0a20414e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:59.315474 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7add9df-3c6b-471e-9968-ece0a20414e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:59.316259 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7add9df-3c6b-471e-9968-ece0a20414e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:59.318771 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7add9df-3c6b-471e-9968-ece0a20414e8 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:59.349726 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 984/1946] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:59:59 2022] POST /identity/v3/users => generated 291 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:59.351167 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7add9df-3c6b-471e-9968-ece0a20414e8 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:59.367479 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7add9df-3c6b-471e-9968-ece0a20414e8 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:59.375689 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fac01e-54eb-45b3-a2c1-73cac0474801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:59.376366 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fac01e-54eb-45b3-a2c1-73cac0474801 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:59.376646 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fac01e-54eb-45b3-a2c1-73cac0474801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:59.376944 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fac01e-54eb-45b3-a2c1-73cac0474801 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:59.377786 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fac01e-54eb-45b3-a2c1-73cac0474801 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:59.379649 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fac01e-54eb-45b3-a2c1-73cac0474801 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:59.397292 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:59.425452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b67aa2-5cfe-48dc-881b-0c7c75fb48d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:59.426168 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b67aa2-5cfe-48dc-881b-0c7c75fb48d8 service nova] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:59.426548 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b67aa2-5cfe-48dc-881b-0c7c75fb48d8 service nova] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:59.426832 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b67aa2-5cfe-48dc-881b-0c7c75fb48d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:59.428858 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 985/1947] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 15:59:59 2022] POST /identity/v3/projects => generated 373 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:59.430484 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fac01e-54eb-45b3-a2c1-73cac0474801 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:59.444935 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b67aa2-5cfe-48dc-881b-0c7c75fb48d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:59.447107 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b67aa2-5cfe-48dc-881b-0c7c75fb48d8 service nova] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:59.466379 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 963/1948] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 15:59:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:59:59.477864 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b67aa2-5cfe-48dc-881b-0c7c75fb48d8 service nova] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:59.493614 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b67aa2-5cfe-48dc-881b-0c7c75fb48d8 service nova] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:59.522438 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fac01e-54eb-45b3-a2c1-73cac0474801 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:59.527335 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0891b66-5a0a-4731-895b-d469fb3aa58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:59.527889 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0891b66-5a0a-4731-895b-d469fb3aa58a admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:59.528166 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0891b66-5a0a-4731-895b-d469fb3aa58a admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:59.528434 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0891b66-5a0a-4731-895b-d469fb3aa58a admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:59.529131 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0891b66-5a0a-4731-895b-d469fb3aa58a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:59.531250 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0891b66-5a0a-4731-895b-d469fb3aa58a admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:59.541359 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 986/1949] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:59.542244 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0891b66-5a0a-4731-895b-d469fb3aa58a admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:59.543907 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-f0891b66-5a0a-4731-895b-d469fb3aa58a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:59.556096 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6655e73c-e820-459f-b9b1-a1abd214df17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:59.556981 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655e73c-e820-459f-b9b1-a1abd214df17 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:59.557447 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655e73c-e820-459f-b9b1-a1abd214df17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:59.557846 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0891b66-5a0a-4731-895b-d469fb3aa58a admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:59.557932 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655e73c-e820-459f-b9b1-a1abd214df17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:59.558687 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6655e73c-e820-459f-b9b1-a1abd214df17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:59.560770 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6655e73c-e820-459f-b9b1-a1abd214df17 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:59.563044 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6030e28-54b9-40c7-bc9e-2eb1033548f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:59.563684 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6030e28-54b9-40c7-bc9e-2eb1033548f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:59.563958 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6030e28-54b9-40c7-bc9e-2eb1033548f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:59.564226 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6030e28-54b9-40c7-bc9e-2eb1033548f6 admin admin] PATH_INFO: `/v3/projects/018117fc976a4011aeb6849123957a89` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:59.566722 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6030e28-54b9-40c7-bc9e-2eb1033548f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=018117fc976a4011aeb6849123957a89)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:59.571016 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6030e28-54b9-40c7-bc9e-2eb1033548f6 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:59.585654 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 964/1950] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:59.588314 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6655e73c-e820-459f-b9b1-a1abd214df17 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:59.600438 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6655e73c-e820-459f-b9b1-a1abd214df17 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:59.605557 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbbf4f6-e059-4705-82b2-d3f0b51bcdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:59.606142 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbf4f6-e059-4705-82b2-d3f0b51bcdca admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:59.606448 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbf4f6-e059-4705-82b2-d3f0b51bcdca admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:59.606685 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbf4f6-e059-4705-82b2-d3f0b51bcdca admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:59.607348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbbf4f6-e059-4705-82b2-d3f0b51bcdca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:59.611439 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbbf4f6-e059-4705-82b2-d3f0b51bcdca admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:59.629930 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f6030e28-54b9-40c7-bc9e-2eb1033548f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '018117fc976a4011aeb6849123957a89', 'request_id': 'req-f6030e28-54b9-40c7-bc9e-2eb1033548f6'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:59.637735 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 965/1951] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 15:59:59 2022] POST /identity/v3/users => generated 293 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:59:59.638873 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbbf4f6-e059-4705-82b2-d3f0b51bcdca admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:59.646307 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f6030e28-54b9-40c7-bc9e-2eb1033548f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '018117fc976a4011aeb6849123957a89', 'request_id': 'req-f6030e28-54b9-40c7-bc9e-2eb1033548f6'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:59.656632 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f6030e28-54b9-40c7-bc9e-2eb1033548f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '018117fc976a4011aeb6849123957a89', 'request_id': 'req-f6030e28-54b9-40c7-bc9e-2eb1033548f6'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:59.661095 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbbf4f6-e059-4705-82b2-d3f0b51bcdca admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:59.677087 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f6030e28-54b9-40c7-bc9e-2eb1033548f6 admin admin] The token cache is being invalidate because project 018117fc976a4011aeb6849123957a89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:59:59.677720 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f6030e28-54b9-40c7-bc9e-2eb1033548f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:59.678583 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f6030e28-54b9-40c7-bc9e-2eb1033548f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:59:59.680388 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 987/1952] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 15:59:59 2022] DELETE /identity/v3/projects/018117fc976a4011aeb6849123957a89 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:59.681375 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6030e28-54b9-40c7-bc9e-2eb1033548f6 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:59.683786 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-f6030e28-54b9-40c7-bc9e-2eb1033548f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:59.731024 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:59.739252 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355ed58-6dc2-4742-81fa-ed9994da70a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:59.742200 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355ed58-6dc2-4742-81fa-ed9994da70a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:59.742794 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355ed58-6dc2-4742-81fa-ed9994da70a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:59.743743 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355ed58-6dc2-4742-81fa-ed9994da70a2 admin admin] PATH_INFO: `/v3/projects/9c35add69405475fa5af087b371948fc/users/8c0dd5e42ec249dd88515a916d690c28/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:59.747428 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9355ed58-6dc2-4742-81fa-ed9994da70a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c35add69405475fa5af087b371948fc, user_id=8c0dd5e42ec249dd88515a916d690c28, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:59.750868 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9355ed58-6dc2-4742-81fa-ed9994da70a2 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:59.762044 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 966/1953] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:59 2022] PUT /identity/v3/projects/9c35add69405475fa5af087b371948fc/users/8c0dd5e42ec249dd88515a916d690c28/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:59.762861 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355ed58-6dc2-4742-81fa-ed9994da70a2 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:59.767647 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-9355ed58-6dc2-4742-81fa-ed9994da70a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:59.779389 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6030e28-54b9-40c7-bc9e-2eb1033548f6 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:59.863865 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e141ed-ba7a-4f2e-86fd-b009cc3ac4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:59.864090 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:59.864215 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e141ed-ba7a-4f2e-86fd-b009cc3ac4d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:59.864215 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e141ed-ba7a-4f2e-86fd-b009cc3ac4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:59.864215 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e141ed-ba7a-4f2e-86fd-b009cc3ac4d5 admin admin] PATH_INFO: `/v3/projects/3e89084716184e1b88e40b541ee80248/users/8860a1d0f7c14a2c8e8bac15a4358b60/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:59.885864 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e141ed-ba7a-4f2e-86fd-b009cc3ac4d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e89084716184e1b88e40b541ee80248, user_id=8860a1d0f7c14a2c8e8bac15a4358b60, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:59.888513 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355ed58-6dc2-4742-81fa-ed9994da70a2 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:59:59.889512 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e141ed-ba7a-4f2e-86fd-b009cc3ac4d5 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:59.895260 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c34e6e-cd84-4eee-807e-39c8e5656f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:59:59.896475 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c34e6e-cd84-4eee-807e-39c8e5656f4f admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:59.896475 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c34e6e-cd84-4eee-807e-39c8e5656f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:59.896475 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c34e6e-cd84-4eee-807e-39c8e5656f4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:59.897466 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c34e6e-cd84-4eee-807e-39c8e5656f4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:59:59.901113 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c34e6e-cd84-4eee-807e-39c8e5656f4f admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:59:59.914173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 988/1954] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 15:59:59 2022] PUT /identity/v3/projects/3e89084716184e1b88e40b541ee80248/users/8860a1d0f7c14a2c8e8bac15a4358b60/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:59:59.915542 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e141ed-ba7a-4f2e-86fd-b009cc3ac4d5 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:59:59.917525 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-54e141ed-ba7a-4f2e-86fd-b009cc3ac4d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:59:59.919669 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 967/1955] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 15:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:59:59.922166 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8233a-ebe5-4514-a1c2-beeaf06ffefd None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:59:59.922459 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8233a-ebe5-4514-a1c2-beeaf06ffefd None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:59:59.923282 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8233a-ebe5-4514-a1c2-beeaf06ffefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:59:59.969540 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-60b8233a-ebe5-4514-a1c2-beeaf06ffefd None None] MFA Rules not processed for user `8c0dd5e42ec249dd88515a916d690c28`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:59:59.970985 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-60b8233a-ebe5-4514-a1c2-beeaf06ffefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:00.009138 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e141ed-ba7a-4f2e-86fd-b009cc3ac4d5 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:00.014872 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19326c30-3e41-46cc-98bc-3228706a0a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:00.015895 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19326c30-3e41-46cc-98bc-3228706a0a68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:00.016166 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19326c30-3e41-46cc-98bc-3228706a0a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:00.016604 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19326c30-3e41-46cc-98bc-3228706a0a68 admin admin] PATH_INFO: `/v3/users/0ec938a2a23d44d4ab81feedb05286f5` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:00.017855 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19326c30-3e41-46cc-98bc-3228706a0a68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ec938a2a23d44d4ab81feedb05286f5)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:00.019787 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19326c30-3e41-46cc-98bc-3228706a0a68 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:00.080248 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-19326c30-3e41-46cc-98bc-3228706a0a68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ec938a2a23d44d4ab81feedb05286f5'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:00.080967 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-19326c30-3e41-46cc-98bc-3228706a0a68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ec938a2a23d44d4ab81feedb05286f5'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:00.090085 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-19326c30-3e41-46cc-98bc-3228706a0a68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ec938a2a23d44d4ab81feedb05286f5'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:00.090284 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 968/1956] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 15:59:59 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:00.100523 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:00.106251 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8233a-ebe5-4514-a1c2-beeaf06ffefd None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:00.107608 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-19326c30-3e41-46cc-98bc-3228706a0a68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ec938a2a23d44d4ab81feedb05286f5'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:00.118606 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-19326c30-3e41-46cc-98bc-3228706a0a68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ec938a2a23d44d4ab81feedb05286f5'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:00.120039 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8233a-ebe5-4514-a1c2-beeaf06ffefd None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:00.126174 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e54416-794b-478a-9b0e-f7c4979255f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:00.126811 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e54416-794b-478a-9b0e-f7c4979255f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:00.127095 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e54416-794b-478a-9b0e-f7c4979255f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:00.127334 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 989/1957] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 15:59:59 2022] DELETE /identity/v3/users/0ec938a2a23d44d4ab81feedb05286f5 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:00.128480 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19326c30-3e41-46cc-98bc-3228706a0a68 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:00.130098 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-19326c30-3e41-46cc-98bc-3228706a0a68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:00.144470 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e54416-794b-478a-9b0e-f7c4979255f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:00.150547 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e54416-794b-478a-9b0e-f7c4979255f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:00.153736 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e54416-794b-478a-9b0e-f7c4979255f8 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:00.177149 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 969/1958] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:00.178219 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e54416-794b-478a-9b0e-f7c4979255f8 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:00.180065 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-49e54416-794b-478a-9b0e-f7c4979255f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:00.246410 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19326c30-3e41-46cc-98bc-3228706a0a68 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:00.254638 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caed016-ba48-43fa-8a1a-eaaa1345c459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:00.255324 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caed016-ba48-43fa-8a1a-eaaa1345c459 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:00.255694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caed016-ba48-43fa-8a1a-eaaa1345c459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:00.255972 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caed016-ba48-43fa-8a1a-eaaa1345c459 admin admin] PATH_INFO: `/v3/projects/b8a85068e90f462798ebe0f75536d80a/users/e21668186f954db7a5f54d46c2631fb3/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:00.257279 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e54416-794b-478a-9b0e-f7c4979255f8 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:00.309706 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caed016-ba48-43fa-8a1a-eaaa1345c459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8a85068e90f462798ebe0f75536d80a, user_id=e21668186f954db7a5f54d46c2631fb3, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:00.314348 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caed016-ba48-43fa-8a1a-eaaa1345c459 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:00.345620 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 990/1959] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:00:00 2022] PUT /identity/v3/projects/b8a85068e90f462798ebe0f75536d80a/users/e21668186f954db7a5f54d46c2631fb3/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:00.345620 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caed016-ba48-43fa-8a1a-eaaa1345c459 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:00.348074 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-2caed016-ba48-43fa-8a1a-eaaa1345c459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:00.353676 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bec2a0-1d4c-4eaa-a142-747c10838ef2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:00.355316 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bec2a0-1d4c-4eaa-a142-747c10838ef2 service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:00.355609 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bec2a0-1d4c-4eaa-a142-747c10838ef2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:00.355889 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bec2a0-1d4c-4eaa-a142-747c10838ef2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:00.360702 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-48bec2a0-1d4c-4eaa-a142-747c10838ef2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:00.456893 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:00.502223 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caed016-ba48-43fa-8a1a-eaaa1345c459 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:00.515088 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ecd2b-dedc-4a03-9dfa-60e8b6b27a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:00.515733 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ecd2b-dedc-4a03-9dfa-60e8b6b27a1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:00.516012 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ecd2b-dedc-4a03-9dfa-60e8b6b27a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:00.516419 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ecd2b-dedc-4a03-9dfa-60e8b6b27a1d admin admin] PATH_INFO: `/v3/projects/3e89084716184e1b88e40b541ee80248/users/8860a1d0f7c14a2c8e8bac15a4358b60/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:00.520247 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7ecd2b-dedc-4a03-9dfa-60e8b6b27a1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e89084716184e1b88e40b541ee80248, user_id=8860a1d0f7c14a2c8e8bac15a4358b60, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:00.522954 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7ecd2b-dedc-4a03-9dfa-60e8b6b27a1d admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:00.558290 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 991/1960] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:00:00 2022] PUT /identity/v3/projects/3e89084716184e1b88e40b541ee80248/users/8860a1d0f7c14a2c8e8bac15a4358b60/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:00.558290 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ecd2b-dedc-4a03-9dfa-60e8b6b27a1d admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:00.565297 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bec2a0-1d4c-4eaa-a142-747c10838ef2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:00.567161 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bec2a0-1d4c-4eaa-a142-747c10838ef2 service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:00.585669 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 970/1961] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:00 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:00:00.588775 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774967f7-8447-46a8-9b65-f50e55bc309d None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:00.588775 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774967f7-8447-46a8-9b65-f50e55bc309d None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:00.588775 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774967f7-8447-46a8-9b65-f50e55bc309d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:00.631348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-774967f7-8447-46a8-9b65-f50e55bc309d None None] MFA Rules not processed for user `8860a1d0f7c14a2c8e8bac15a4358b60`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:00.632768 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-774967f7-8447-46a8-9b65-f50e55bc309d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:00.686797 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ecd2b-dedc-4a03-9dfa-60e8b6b27a1d admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:00.698351 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1187a-6f29-4fe3-9dce-fa8a45c0dc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:00.698983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1187a-6f29-4fe3-9dce-fa8a45c0dc36 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:00.699263 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1187a-6f29-4fe3-9dce-fa8a45c0dc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:00.700130 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1187a-6f29-4fe3-9dce-fa8a45c0dc36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:00.700815 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b1187a-6f29-4fe3-9dce-fa8a45c0dc36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:00.703159 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b1187a-6f29-4fe3-9dce-fa8a45c0dc36 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:00.704771 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:00.729817 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 992/1962] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:00.730689 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1187a-6f29-4fe3-9dce-fa8a45c0dc36 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:00.732847 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-27b1187a-6f29-4fe3-9dce-fa8a45c0dc36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:00.757810 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 971/1963] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:00 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:00.759111 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774967f7-8447-46a8-9b65-f50e55bc309d None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:00.776978 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1187a-6f29-4fe3-9dce-fa8a45c0dc36 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:00.781687 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774967f7-8447-46a8-9b65-f50e55bc309d None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:00.787768 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275705d-4bcf-4546-9b67-195ab8cec237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:00.788758 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275705d-4bcf-4546-9b67-195ab8cec237 admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:00.789011 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275705d-4bcf-4546-9b67-195ab8cec237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:00.789625 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275705d-4bcf-4546-9b67-195ab8cec237 admin admin] PATH_INFO: `/v3/projects/b8a85068e90f462798ebe0f75536d80a/users/e21668186f954db7a5f54d46c2631fb3/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:00.792131 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6275705d-4bcf-4546-9b67-195ab8cec237 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8a85068e90f462798ebe0f75536d80a, user_id=e21668186f954db7a5f54d46c2631fb3, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:00.795082 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6275705d-4bcf-4546-9b67-195ab8cec237 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:00.803394 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b068fe7-a8d3-4b80-a8b3-b200b4b7c630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:00.804046 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b068fe7-a8d3-4b80-a8b3-b200b4b7c630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:00.804322 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b068fe7-a8d3-4b80-a8b3-b200b4b7c630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:00.804596 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b068fe7-a8d3-4b80-a8b3-b200b4b7c630 admin admin] PATH_INFO: `/v3/projects/0431a6d633934ac298a25294a8e97a9c` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:00.806414 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b068fe7-a8d3-4b80-a8b3-b200b4b7c630 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0431a6d633934ac298a25294a8e97a9c)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:00.808310 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b068fe7-a8d3-4b80-a8b3-b200b4b7c630 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:00.810758 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 972/1964] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:00:00 2022] PUT /identity/v3/projects/b8a85068e90f462798ebe0f75536d80a/users/e21668186f954db7a5f54d46c2631fb3/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:00.819014 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275705d-4bcf-4546-9b67-195ab8cec237 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:00.868345 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-0b068fe7-a8d3-4b80-a8b3-b200b4b7c630 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0431a6d633934ac298a25294a8e97a9c', 'request_id': 'req-0b068fe7-a8d3-4b80-a8b3-b200b4b7c630'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:00.878202 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-0b068fe7-a8d3-4b80-a8b3-b200b4b7c630 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0431a6d633934ac298a25294a8e97a9c', 'request_id': 'req-0b068fe7-a8d3-4b80-a8b3-b200b4b7c630'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:00.888447 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-0b068fe7-a8d3-4b80-a8b3-b200b4b7c630 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0431a6d633934ac298a25294a8e97a9c', 'request_id': 'req-0b068fe7-a8d3-4b80-a8b3-b200b4b7c630'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:00.895632 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275705d-4bcf-4546-9b67-195ab8cec237 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:00.903071 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-0b068fe7-a8d3-4b80-a8b3-b200b4b7c630 admin admin] The token cache is being invalidate because project 0431a6d633934ac298a25294a8e97a9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:00:00.903364 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-0b068fe7-a8d3-4b80-a8b3-b200b4b7c630 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:00.904045 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-0b068fe7-a8d3-4b80-a8b3-b200b4b7c630 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:00.905802 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 993/1965] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:00:00 2022] DELETE /identity/v3/projects/0431a6d633934ac298a25294a8e97a9c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:00.910807 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd2edb-fb22-452e-9ef1-04e7411fac04 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:00.911094 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd2edb-fb22-452e-9ef1-04e7411fac04 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:00.911421 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd2edb-fb22-452e-9ef1-04e7411fac04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:00.944831 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-c1dd2edb-fb22-452e-9ef1-04e7411fac04 None None] MFA Rules not processed for user `e21668186f954db7a5f54d46c2631fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:00.946065 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c1dd2edb-fb22-452e-9ef1-04e7411fac04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:00.957667 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa0d4b-57ed-468a-9810-bca544c28608 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:00.958315 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa0d4b-57ed-468a-9810-bca544c28608 service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:00.958559 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa0d4b-57ed-468a-9810-bca544c28608 service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:00.958825 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa0d4b-57ed-468a-9810-bca544c28608 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:00.960703 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-a6fa0d4b-57ed-468a-9810-bca544c28608 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:00.972891 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:01.024510 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 994/1966] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:01.027539 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3b47c-c7b4-4ed1-95b5-8e1feb0271c2 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:01.028010 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3b47c-c7b4-4ed1-95b5-8e1feb0271c2 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:01.028445 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3b47c-c7b4-4ed1-95b5-8e1feb0271c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:01.041178 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa0d4b-57ed-468a-9810-bca544c28608 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:01.042916 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa0d4b-57ed-468a-9810-bca544c28608 service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:01.051402 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-52e3b47c-c7b4-4ed1-95b5-8e1feb0271c2 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:01.052837 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-52e3b47c-c7b4-4ed1-95b5-8e1feb0271c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:01.055253 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 973/1967] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:00 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:00:01.069891 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa0d4b-57ed-468a-9810-bca544c28608 service cinder] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:01.071349 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-a6fa0d4b-57ed-468a-9810-bca544c28608 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:01.089050 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa0d4b-57ed-468a-9810-bca544c28608 service cinder] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:01.094572 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a4302-b327-4c5d-8019-6343b59599a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:01.095881 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a4302-b327-4c5d-8019-6343b59599a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:01.096356 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a4302-b327-4c5d-8019-6343b59599a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:01.096737 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a4302-b327-4c5d-8019-6343b59599a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:01.098882 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-d41a4302-b327-4c5d-8019-6343b59599a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:01.128234 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 995/1968] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:01.137902 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd4884-3c71-400d-a811-a7680a754d61 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:01.138377 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd4884-3c71-400d-a811-a7680a754d61 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:01.138503 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd4884-3c71-400d-a811-a7680a754d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:01.148536 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:01.183175 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-e8dd4884-3c71-400d-a811-a7680a754d61 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:01.186514 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-e8dd4884-3c71-400d-a811-a7680a754d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:01.211437 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 996/1969] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:01.218635 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd4884-3c71-400d-a811-a7680a754d61 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:01.252522 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd4884-3c71-400d-a811-a7680a754d61 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:01.261848 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81fe2a-9141-46a6-ae40-6d3a33a42868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:01.262790 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81fe2a-9141-46a6-ae40-6d3a33a42868 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:01.263176 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81fe2a-9141-46a6-ae40-6d3a33a42868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:01.263542 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81fe2a-9141-46a6-ae40-6d3a33a42868 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:01.263805 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a4302-b327-4c5d-8019-6343b59599a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:01.264562 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81fe2a-9141-46a6-ae40-6d3a33a42868 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:00:01.265041 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81fe2a-9141-46a6-ae40-6d3a33a42868 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:01.266652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a4302-b327-4c5d-8019-6343b59599a1 service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:01.267134 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81fe2a-9141-46a6-ae40-6d3a33a42868 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:01.282631 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 997/1970] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 16:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:00:01.283878 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81fe2a-9141-46a6-ae40-6d3a33a42868 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:01.289910 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 974/1971] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:01 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:00:01.290874 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a4302-b327-4c5d-8019-6343b59599a1 service cinder] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:01.297084 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-cc81fe2a-9141-46a6-ae40-6d3a33a42868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:01.307632 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a4302-b327-4c5d-8019-6343b59599a1 service cinder] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:01.310472 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81fe2a-9141-46a6-ae40-6d3a33a42868 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:01.313378 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb9274-97ef-46b6-85d4-494973d7f919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:01.314640 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3c07a-4721-4161-9fd8-29ae65464ddd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:01.314857 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb9274-97ef-46b6-85d4-494973d7f919 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:01.315105 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb9274-97ef-46b6-85d4-494973d7f919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:01.315267 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3c07a-4721-4161-9fd8-29ae65464ddd service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:01.315503 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb9274-97ef-46b6-85d4-494973d7f919 admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:01.315683 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3c07a-4721-4161-9fd8-29ae65464ddd service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:01.315905 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3c07a-4721-4161-9fd8-29ae65464ddd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:01.316378 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cb9274-97ef-46b6-85d4-494973d7f919 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:01.318434 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-5ea3c07a-4721-4161-9fd8-29ae65464ddd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:01.320051 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cb9274-97ef-46b6-85d4-494973d7f919 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:01.372539 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 975/1972] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:00:01 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:01.373981 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb9274-97ef-46b6-85d4-494973d7f919 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:01.423036 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3c07a-4721-4161-9fd8-29ae65464ddd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:01.424577 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3c07a-4721-4161-9fd8-29ae65464ddd service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:01.446097 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb9274-97ef-46b6-85d4-494973d7f919 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:01.449944 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 998/1973] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:00:01.452221 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314daba3-0eb9-4218-8f23-b68025ac97f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:01.452875 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314daba3-0eb9-4218-8f23-b68025ac97f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:01.453156 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314daba3-0eb9-4218-8f23-b68025ac97f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:01.453421 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314daba3-0eb9-4218-8f23-b68025ac97f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:01.454058 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314daba3-0eb9-4218-8f23-b68025ac97f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:01.455998 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314daba3-0eb9-4218-8f23-b68025ac97f5 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:01.485567 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 976/1974] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:00:01 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:01.486912 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3c07a-4721-4161-9fd8-29ae65464ddd service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:01.500739 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3c07a-4721-4161-9fd8-29ae65464ddd service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:01.507755 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077bba8-a234-4338-aeed-f918890f8f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:01.508390 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077bba8-a234-4338-aeed-f918890f8f7e admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:01.508959 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077bba8-a234-4338-aeed-f918890f8f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:01.509241 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077bba8-a234-4338-aeed-f918890f8f7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:01.509902 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3077bba8-a234-4338-aeed-f918890f8f7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:01.511983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3077bba8-a234-4338-aeed-f918890f8f7e admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:01.531658 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 999/1975] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:01.533178 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314daba3-0eb9-4218-8f23-b68025ac97f5 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:01.545167 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314daba3-0eb9-4218-8f23-b68025ac97f5 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:01.553191 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09f8f5-90a9-4ed3-8053-df528a179e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:01.553729 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09f8f5-90a9-4ed3-8053-df528a179e94 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:01.554028 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09f8f5-90a9-4ed3-8053-df528a179e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:01.554264 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09f8f5-90a9-4ed3-8053-df528a179e94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:01.554918 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa09f8f5-90a9-4ed3-8053-df528a179e94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:01.556517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa09f8f5-90a9-4ed3-8053-df528a179e94 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:01.563117 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:01.574196 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 977/1976] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:01.581271 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077bba8-a234-4338-aeed-f918890f8f7e admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:01.598774 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077bba8-a234-4338-aeed-f918890f8f7e admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:01.610701 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641beec-da3c-42c3-b9c1-528a44db8012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:01.611566 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641beec-da3c-42c3-b9c1-528a44db8012 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:01.613865 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641beec-da3c-42c3-b9c1-528a44db8012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:01.613865 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641beec-da3c-42c3-b9c1-528a44db8012 admin admin] PATH_INFO: `/v3/projects/bce20b821dd3429bbeab04954af94f01/users/5e6a2e2e0e694c84b60a43ea73619f30/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:01.647109 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8641beec-da3c-42c3-b9c1-528a44db8012 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bce20b821dd3429bbeab04954af94f01, user_id=5e6a2e2e0e694c84b60a43ea73619f30, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:01.650847 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8641beec-da3c-42c3-b9c1-528a44db8012 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:01.680823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1000/1977] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:00:01 2022] PUT /identity/v3/projects/bce20b821dd3429bbeab04954af94f01/users/5e6a2e2e0e694c84b60a43ea73619f30/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:01.690397 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2b804-b782-49bc-b14c-a392af157222 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:01.690921 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2b804-b782-49bc-b14c-a392af157222 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:01.691371 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2b804-b782-49bc-b14c-a392af157222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:01.758222 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-3dd2b804-b782-49bc-b14c-a392af157222 None None] MFA Rules not processed for user `5e6a2e2e0e694c84b60a43ea73619f30`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:01.759899 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-3dd2b804-b782-49bc-b14c-a392af157222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:01.926071 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 978/1978] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:01.978682 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641beec-da3c-42c3-b9c1-528a44db8012 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:02.071363 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641beec-da3c-42c3-b9c1-528a44db8012 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:02.077733 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5a998-e32b-4efc-8d60-531a4a3f7c0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:02.078681 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5a998-e32b-4efc-8d60-531a4a3f7c0c service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:02.079210 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5a998-e32b-4efc-8d60-531a4a3f7c0c service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:02.079693 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5a998-e32b-4efc-8d60-531a4a3f7c0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:02.090890 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5a998-e32b-4efc-8d60-531a4a3f7c0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:02.092579 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5a998-e32b-4efc-8d60-531a4a3f7c0c service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:02.115547 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1001/1979] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:00:02.156235 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2b804-b782-49bc-b14c-a392af157222 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:02.234232 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2b804-b782-49bc-b14c-a392af157222 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:02.240903 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe9a09-e8d1-4f74-b307-4023e4cc9330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:02.241720 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe9a09-e8d1-4f74-b307-4023e4cc9330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:02.242268 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe9a09-e8d1-4f74-b307-4023e4cc9330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:02.242684 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe9a09-e8d1-4f74-b307-4023e4cc9330 admin admin] PATH_INFO: `/v3/users/5e6a2e2e0e694c84b60a43ea73619f30` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:02.244024 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe9a09-e8d1-4f74-b307-4023e4cc9330 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e6a2e2e0e694c84b60a43ea73619f30)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:02.246340 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe9a09-e8d1-4f74-b307-4023e4cc9330 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:02.310332 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-c7fe9a09-e8d1-4f74-b307-4023e4cc9330 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e6a2e2e0e694c84b60a43ea73619f30'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:02.327420 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-c7fe9a09-e8d1-4f74-b307-4023e4cc9330 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e6a2e2e0e694c84b60a43ea73619f30'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:02.327976 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-c7fe9a09-e8d1-4f74-b307-4023e4cc9330 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e6a2e2e0e694c84b60a43ea73619f30'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:02.328650 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-c7fe9a09-e8d1-4f74-b307-4023e4cc9330 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e6a2e2e0e694c84b60a43ea73619f30'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:02.340494 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-c7fe9a09-e8d1-4f74-b307-4023e4cc9330 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e6a2e2e0e694c84b60a43ea73619f30'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:02.353962 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 979/1980] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:00:02 2022] DELETE /identity/v3/users/5e6a2e2e0e694c84b60a43ea73619f30 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:00:02.359476 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79832ebd-a136-4de9-9812-44fd9d93055c None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:02.359817 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79832ebd-a136-4de9-9812-44fd9d93055c None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:02.360100 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79832ebd-a136-4de9-9812-44fd9d93055c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:02.393378 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-79832ebd-a136-4de9-9812-44fd9d93055c None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:02.394594 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-79832ebd-a136-4de9-9812-44fd9d93055c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:02.460592 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:02.485146 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1002/1981] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:02.497401 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe9a09-e8d1-4f74-b307-4023e4cc9330 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:02.499166 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-c7fe9a09-e8d1-4f74-b307-4023e4cc9330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:02.513279 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:02.581553 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe9a09-e8d1-4f74-b307-4023e4cc9330 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:02.585256 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f21c5-acc5-4cae-a79d-6398df3f1ae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:02.585891 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f21c5-acc5-4cae-a79d-6398df3f1ae1 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:02.586169 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f21c5-acc5-4cae-a79d-6398df3f1ae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:02.586466 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f21c5-acc5-4cae-a79d-6398df3f1ae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:02.600716 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35f21c5-acc5-4cae-a79d-6398df3f1ae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:02.602563 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35f21c5-acc5-4cae-a79d-6398df3f1ae1 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:02.614801 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 980/1982] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:00:03.152299 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79832ebd-a136-4de9-9812-44fd9d93055c None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:03.157147 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-79832ebd-a136-4de9-9812-44fd9d93055c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:03.181664 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79832ebd-a136-4de9-9812-44fd9d93055c None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:03.200386 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558a9dc-21d6-4393-adc2-7fde973cd592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:03.201083 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558a9dc-21d6-4393-adc2-7fde973cd592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:03.201401 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558a9dc-21d6-4393-adc2-7fde973cd592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:03.202394 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558a9dc-21d6-4393-adc2-7fde973cd592 admin admin] PATH_INFO: `/v3/projects/bce20b821dd3429bbeab04954af94f01` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:03.203692 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6558a9dc-21d6-4393-adc2-7fde973cd592 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bce20b821dd3429bbeab04954af94f01)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:03.205659 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6558a9dc-21d6-4393-adc2-7fde973cd592 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:03.335920 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6558a9dc-21d6-4393-adc2-7fde973cd592 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bce20b821dd3429bbeab04954af94f01', 'request_id': 'req-6558a9dc-21d6-4393-adc2-7fde973cd592'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:03.366150 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6558a9dc-21d6-4393-adc2-7fde973cd592 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bce20b821dd3429bbeab04954af94f01', 'request_id': 'req-6558a9dc-21d6-4393-adc2-7fde973cd592'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:03.375389 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6558a9dc-21d6-4393-adc2-7fde973cd592 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bce20b821dd3429bbeab04954af94f01', 'request_id': 'req-6558a9dc-21d6-4393-adc2-7fde973cd592'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:03.394850 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6558a9dc-21d6-4393-adc2-7fde973cd592 admin admin] The token cache is being invalidate because project bce20b821dd3429bbeab04954af94f01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:00:03.395792 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6558a9dc-21d6-4393-adc2-7fde973cd592 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:03.399637 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6558a9dc-21d6-4393-adc2-7fde973cd592 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:03.411007 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1003/1983] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:00:03 2022] DELETE /identity/v3/projects/bce20b821dd3429bbeab04954af94f01 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:03.411817 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c817c-a611-4457-a113-694f7c75ec5c None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:03.412290 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c817c-a611-4457-a113-694f7c75ec5c None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:03.412383 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c817c-a611-4457-a113-694f7c75ec5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:03.451150 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-519c817c-a611-4457-a113-694f7c75ec5c None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:03.452730 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-519c817c-a611-4457-a113-694f7c75ec5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:03.616820 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 981/1984] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:03.629547 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fe370-76ff-40d6-ad9c-206dcf0e7822 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:03.631491 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fe370-76ff-40d6-ad9c-206dcf0e7822 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:03.635800 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fe370-76ff-40d6-ad9c-206dcf0e7822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:03.685475 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-380fe370-76ff-40d6-ad9c-206dcf0e7822 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:03.689221 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-380fe370-76ff-40d6-ad9c-206dcf0e7822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:03.706162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1004/1985] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:03.714250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c817c-a611-4457-a113-694f7c75ec5c None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:03.726307 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c817c-a611-4457-a113-694f7c75ec5c None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:03.740394 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a142fc-72a5-4b91-9f32-bb7e074ba338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:03.741136 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a142fc-72a5-4b91-9f32-bb7e074ba338 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:03.741476 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a142fc-72a5-4b91-9f32-bb7e074ba338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:03.741776 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a142fc-72a5-4b91-9f32-bb7e074ba338 admin admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:03.742454 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a142fc-72a5-4b91-9f32-bb7e074ba338 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:00:03.742759 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a142fc-72a5-4b91-9f32-bb7e074ba338 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:03.744611 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a142fc-72a5-4b91-9f32-bb7e074ba338 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:03.757745 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 982/1986] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 16:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:00:03.762718 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380fe370-76ff-40d6-ad9c-206dcf0e7822 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:03.777907 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380fe370-76ff-40d6-ad9c-206dcf0e7822 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:03.806068 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7c94e-3d86-4ede-a0d7-ecb81a53c072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:03.809286 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7c94e-3d86-4ede-a0d7-ecb81a53c072 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:03.809580 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7c94e-3d86-4ede-a0d7-ecb81a53c072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:03.810360 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7c94e-3d86-4ede-a0d7-ecb81a53c072 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:03.810508 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c7c94e-3d86-4ede-a0d7-ecb81a53c072 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:03.823524 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c7c94e-3d86-4ede-a0d7-ecb81a53c072 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:03.930460 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1005/1987] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:00:03 2022] POST /identity/v3/projects => generated 367 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:03.931137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a142fc-72a5-4b91-9f32-bb7e074ba338 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:03.945712 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a142fc-72a5-4b91-9f32-bb7e074ba338 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:04.026969 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf72d4-44ea-411e-bf6b-1a8921f7c6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:04.027750 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf72d4-44ea-411e-bf6b-1a8921f7c6ee admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:04.028075 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf72d4-44ea-411e-bf6b-1a8921f7c6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:04.028366 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf72d4-44ea-411e-bf6b-1a8921f7c6ee admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:04.031425 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf72d4-44ea-411e-bf6b-1a8921f7c6ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:04.035054 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf72d4-44ea-411e-bf6b-1a8921f7c6ee admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:04.072924 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 983/1988] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:00:03 2022] POST /identity/v3/users => generated 284 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:04.077894 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7c94e-3d86-4ede-a0d7-ecb81a53c072 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:04.097453 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7c94e-3d86-4ede-a0d7-ecb81a53c072 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:04.102651 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262499d1-ec13-4905-9805-ee5e175c77cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:04.103296 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262499d1-ec13-4905-9805-ee5e175c77cc admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:04.103571 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262499d1-ec13-4905-9805-ee5e175c77cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:04.104014 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262499d1-ec13-4905-9805-ee5e175c77cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:04.104669 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262499d1-ec13-4905-9805-ee5e175c77cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:04.106319 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262499d1-ec13-4905-9805-ee5e175c77cc admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:04.118187 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1006/1989] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:04.123024 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf72d4-44ea-411e-bf6b-1a8921f7c6ee admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:04.134773 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf72d4-44ea-411e-bf6b-1a8921f7c6ee admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:04.139998 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11baa304-736b-4901-ad19-d2119d29dc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:04.140853 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11baa304-736b-4901-ad19-d2119d29dc22 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:04.141134 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11baa304-736b-4901-ad19-d2119d29dc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:04.141486 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11baa304-736b-4901-ad19-d2119d29dc22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:04.142138 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11baa304-736b-4901-ad19-d2119d29dc22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:04.143886 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11baa304-736b-4901-ad19-d2119d29dc22 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:04.162467 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 984/1990] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:04.167370 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262499d1-ec13-4905-9805-ee5e175c77cc admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:04.180450 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262499d1-ec13-4905-9805-ee5e175c77cc admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:04.187145 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e053e34-7180-40d6-b96a-ce036fb28dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:04.188054 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e053e34-7180-40d6-b96a-ce036fb28dfe admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:04.188386 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e053e34-7180-40d6-b96a-ce036fb28dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:04.188733 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e053e34-7180-40d6-b96a-ce036fb28dfe admin admin] PATH_INFO: `/v3/projects/d57943e222ff40a5b7767d126b3abed6/users/732004e1aecb4830a375976194c2dbb1/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:04.205674 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e053e34-7180-40d6-b96a-ce036fb28dfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=d57943e222ff40a5b7767d126b3abed6, user_id=732004e1aecb4830a375976194c2dbb1, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:04.208451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e053e34-7180-40d6-b96a-ce036fb28dfe admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:04.225417 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1007/1991] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:00:04 2022] PUT /identity/v3/projects/d57943e222ff40a5b7767d126b3abed6/users/732004e1aecb4830a375976194c2dbb1/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:04.238877 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cc68d-c085-4279-834f-5129cfaf3d86 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:04.239272 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cc68d-c085-4279-834f-5129cfaf3d86 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:04.239654 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cc68d-c085-4279-834f-5129cfaf3d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:04.262672 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e053e34-7180-40d6-b96a-ce036fb28dfe admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:04.264560 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-8e053e34-7180-40d6-b96a-ce036fb28dfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:04.288853 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-cb4cc68d-c085-4279-834f-5129cfaf3d86 None None] MFA Rules not processed for user `732004e1aecb4830a375976194c2dbb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:04.290076 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-cb4cc68d-c085-4279-834f-5129cfaf3d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:04.297923 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:04.344513 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e053e34-7180-40d6-b96a-ce036fb28dfe admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:04.350173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481476c-4b4d-43f9-9b14-f95a9c5c04e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:04.351297 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481476c-4b4d-43f9-9b14-f95a9c5c04e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:04.351754 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481476c-4b4d-43f9-9b14-f95a9c5c04e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:04.352176 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481476c-4b4d-43f9-9b14-f95a9c5c04e4 admin admin] PATH_INFO: `/v3/users/cd44c24624bc4e38a84efa42533f284b` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:04.353683 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1481476c-4b4d-43f9-9b14-f95a9c5c04e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd44c24624bc4e38a84efa42533f284b)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:04.355867 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1481476c-4b4d-43f9-9b14-f95a9c5c04e4 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:04.381839 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:04.393115 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 985/1992] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:00:04.406805 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4cc68d-c085-4279-834f-5129cfaf3d86 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:04.408597 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-cb4cc68d-c085-4279-834f-5129cfaf3d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:04.441090 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-1481476c-4b4d-43f9-9b14-f95a9c5c04e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd44c24624bc4e38a84efa42533f284b'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:04.441833 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-1481476c-4b4d-43f9-9b14-f95a9c5c04e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd44c24624bc4e38a84efa42533f284b'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:04.455622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-1481476c-4b4d-43f9-9b14-f95a9c5c04e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd44c24624bc4e38a84efa42533f284b'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:04.475108 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-1481476c-4b4d-43f9-9b14-f95a9c5c04e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd44c24624bc4e38a84efa42533f284b'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:04.485469 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-1481476c-4b4d-43f9-9b14-f95a9c5c04e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd44c24624bc4e38a84efa42533f284b'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:04.493415 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1008/1993] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:00:04 2022] DELETE /identity/v3/users/cd44c24624bc4e38a84efa42533f284b => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:04.497398 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3209542-a768-453f-82ba-8d5321219451 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:04.497677 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3209542-a768-453f-82ba-8d5321219451 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:04.497946 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3209542-a768-453f-82ba-8d5321219451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:04.513999 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4cc68d-c085-4279-834f-5129cfaf3d86 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:04.519067 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-c3209542-a768-453f-82ba-8d5321219451 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:04.520267 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c3209542-a768-453f-82ba-8d5321219451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:04.584105 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd13f1-dcb3-489b-b681-553138a41f89 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9bd815f8fe54d7d99e00a47212ad9ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:04.585060 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd13f1-dcb3-489b-b681-553138a41f89 service glance] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:04.585496 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd13f1-dcb3-489b-b681-553138a41f89 service glance] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:04.586289 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd13f1-dcb3-489b-b681-553138a41f89 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:04.588516 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-78dd13f1-dcb3-489b-b681-553138a41f89 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:04.609541 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1009/1994] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:00:04.622876 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3209542-a768-453f-82ba-8d5321219451 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:04.631368 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c3209542-a768-453f-82ba-8d5321219451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:04.673786 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd13f1-dcb3-489b-b681-553138a41f89 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:04.677377 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd13f1-dcb3-489b-b681-553138a41f89 service glance] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:04.683974 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:04.695985 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 986/1995] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:00:04.696871 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd13f1-dcb3-489b-b681-553138a41f89 service glance] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:04.698765 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-78dd13f1-dcb3-489b-b681-553138a41f89 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:04.721699 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3209542-a768-453f-82ba-8d5321219451 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:04.735293 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd13f1-dcb3-489b-b681-553138a41f89 service glance] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:04.737755 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85e03e-221e-47aa-b40a-4851cd12cfc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:04.740404 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26878e3-47f7-4c28-b8d3-8a4370fc7991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:04.741178 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26878e3-47f7-4c28-b8d3-8a4370fc7991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:04.741558 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85e03e-221e-47aa-b40a-4851cd12cfc3 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:04.741660 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26878e3-47f7-4c28-b8d3-8a4370fc7991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:04.741827 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85e03e-221e-47aa-b40a-4851cd12cfc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:04.741933 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26878e3-47f7-4c28-b8d3-8a4370fc7991 admin admin] PATH_INFO: `/v3/users/d337651be07e402e97dd54661db4d2c8` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:04.742238 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85e03e-221e-47aa-b40a-4851cd12cfc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:04.743311 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26878e3-47f7-4c28-b8d3-8a4370fc7991 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d337651be07e402e97dd54661db4d2c8)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:04.746519 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26878e3-47f7-4c28-b8d3-8a4370fc7991 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:04.771202 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc85e03e-221e-47aa-b40a-4851cd12cfc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:04.772847 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc85e03e-221e-47aa-b40a-4851cd12cfc3 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:04.785121 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1010/1996] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:00:04.836900 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-f26878e3-47f7-4c28-b8d3-8a4370fc7991 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd337651be07e402e97dd54661db4d2c8'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:04.853839 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-f26878e3-47f7-4c28-b8d3-8a4370fc7991 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd337651be07e402e97dd54661db4d2c8'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:04.854699 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-f26878e3-47f7-4c28-b8d3-8a4370fc7991 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd337651be07e402e97dd54661db4d2c8'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:04.855485 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-f26878e3-47f7-4c28-b8d3-8a4370fc7991 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd337651be07e402e97dd54661db4d2c8'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:04.876524 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-f26878e3-47f7-4c28-b8d3-8a4370fc7991 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd337651be07e402e97dd54661db4d2c8'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:04.930434 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 987/1997] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:00:04 2022] DELETE /identity/v3/users/d337651be07e402e97dd54661db4d2c8 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:04.932715 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987f9c5-d2ee-4a12-8a69-a0439f6d5cbd None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:04.933301 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987f9c5-d2ee-4a12-8a69-a0439f6d5cbd None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:04.937093 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987f9c5-d2ee-4a12-8a69-a0439f6d5cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:04.991363 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-7987f9c5-d2ee-4a12-8a69-a0439f6d5cbd None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:05.002312 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7987f9c5-d2ee-4a12-8a69-a0439f6d5cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:05.088644 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:05.164989 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1011/1998] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:05.189086 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26878e3-47f7-4c28-b8d3-8a4370fc7991 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:05.189086 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-f26878e3-47f7-4c28-b8d3-8a4370fc7991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:05.267868 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987f9c5-d2ee-4a12-8a69-a0439f6d5cbd None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:05.269460 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7987f9c5-d2ee-4a12-8a69-a0439f6d5cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:05.292909 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987f9c5-d2ee-4a12-8a69-a0439f6d5cbd None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:05.293871 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26878e3-47f7-4c28-b8d3-8a4370fc7991 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:05.301013 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265979f-d2f5-4bde-8e5a-abb299987963 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:05.302190 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265979f-d2f5-4bde-8e5a-abb299987963 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:05.302752 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265979f-d2f5-4bde-8e5a-abb299987963 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:05.303339 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265979f-d2f5-4bde-8e5a-abb299987963 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:05.316390 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617646b1-01e8-42f8-bf6f-de5e2ca8130f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:05.318975 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617646b1-01e8-42f8-bf6f-de5e2ca8130f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:05.319804 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617646b1-01e8-42f8-bf6f-de5e2ca8130f admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:05.320087 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617646b1-01e8-42f8-bf6f-de5e2ca8130f admin admin] PATH_INFO: `/v3/projects/15f5518b27d6430b8a93d4b11d0cd784` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:05.333176 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617646b1-01e8-42f8-bf6f-de5e2ca8130f admin admin] RBAC: Authorizing `identity:delete_project(project_id=15f5518b27d6430b8a93d4b11d0cd784)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:05.333426 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5265979f-d2f5-4bde-8e5a-abb299987963 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:05.333426 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5265979f-d2f5-4bde-8e5a-abb299987963 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:05.333699 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617646b1-01e8-42f8-bf6f-de5e2ca8130f admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:05.353254 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 988/1999] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:00:05.458234 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-617646b1-01e8-42f8-bf6f-de5e2ca8130f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15f5518b27d6430b8a93d4b11d0cd784', 'request_id': 'req-617646b1-01e8-42f8-bf6f-de5e2ca8130f'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:05.475648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-617646b1-01e8-42f8-bf6f-de5e2ca8130f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15f5518b27d6430b8a93d4b11d0cd784', 'request_id': 'req-617646b1-01e8-42f8-bf6f-de5e2ca8130f'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:05.489530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-617646b1-01e8-42f8-bf6f-de5e2ca8130f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15f5518b27d6430b8a93d4b11d0cd784', 'request_id': 'req-617646b1-01e8-42f8-bf6f-de5e2ca8130f'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:05.517973 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-617646b1-01e8-42f8-bf6f-de5e2ca8130f admin admin] The token cache is being invalidate because project 15f5518b27d6430b8a93d4b11d0cd784 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:00:05.518430 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-617646b1-01e8-42f8-bf6f-de5e2ca8130f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:05.519412 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-617646b1-01e8-42f8-bf6f-de5e2ca8130f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:05.521488 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1012/2000] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:00:05 2022] DELETE /identity/v3/projects/15f5518b27d6430b8a93d4b11d0cd784 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:05.525916 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265979f-d2f5-4bde-8e5a-abb299987963 service neutron] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:05.544545 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265979f-d2f5-4bde-8e5a-abb299987963 service neutron] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:05.723287 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c87097-729f-486f-a56a-ee03ee10483b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:05.724194 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c87097-729f-486f-a56a-ee03ee10483b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:05.726450 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c87097-729f-486f-a56a-ee03ee10483b admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:05.726808 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c87097-729f-486f-a56a-ee03ee10483b admin admin] PATH_INFO: `/v3/users/8860a1d0f7c14a2c8e8bac15a4358b60` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:05.728287 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c87097-729f-486f-a56a-ee03ee10483b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8860a1d0f7c14a2c8e8bac15a4358b60)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:05.731500 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c87097-729f-486f-a56a-ee03ee10483b admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:05.767475 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:05.773309 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617646b1-01e8-42f8-bf6f-de5e2ca8130f admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:05.774952 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-617646b1-01e8-42f8-bf6f-de5e2ca8130f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:05.803405 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617646b1-01e8-42f8-bf6f-de5e2ca8130f admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:05.820026 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48129e2a-dff0-4a56-98e8-9153eebb5d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:05.820999 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48129e2a-dff0-4a56-98e8-9153eebb5d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:05.821087 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48129e2a-dff0-4a56-98e8-9153eebb5d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:05.821381 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48129e2a-dff0-4a56-98e8-9153eebb5d8b admin admin] PATH_INFO: `/v3/projects/d6cf18bcda2d47c799c78e54473c4a6b` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:05.822413 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48129e2a-dff0-4a56-98e8-9153eebb5d8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6cf18bcda2d47c799c78e54473c4a6b)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:05.824662 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48129e2a-dff0-4a56-98e8-9153eebb5d8b admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:05.830504 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-f7c87097-729f-486f-a56a-ee03ee10483b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8860a1d0f7c14a2c8e8bac15a4358b60'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:05.855611 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-f7c87097-729f-486f-a56a-ee03ee10483b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8860a1d0f7c14a2c8e8bac15a4358b60'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:05.856543 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-f7c87097-729f-486f-a56a-ee03ee10483b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8860a1d0f7c14a2c8e8bac15a4358b60'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:05.859500 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-f7c87097-729f-486f-a56a-ee03ee10483b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8860a1d0f7c14a2c8e8bac15a4358b60'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:05.872381 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-f7c87097-729f-486f-a56a-ee03ee10483b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8860a1d0f7c14a2c8e8bac15a4358b60'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:05.899514 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 989/2001] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:00:05 2022] DELETE /identity/v3/users/8860a1d0f7c14a2c8e8bac15a4358b60 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:00:05.904480 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-48129e2a-dff0-4a56-98e8-9153eebb5d8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6cf18bcda2d47c799c78e54473c4a6b', 'request_id': 'req-48129e2a-dff0-4a56-98e8-9153eebb5d8b'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:05.920904 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-48129e2a-dff0-4a56-98e8-9153eebb5d8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6cf18bcda2d47c799c78e54473c4a6b', 'request_id': 'req-48129e2a-dff0-4a56-98e8-9153eebb5d8b'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:05.927934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-48129e2a-dff0-4a56-98e8-9153eebb5d8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6cf18bcda2d47c799c78e54473c4a6b', 'request_id': 'req-48129e2a-dff0-4a56-98e8-9153eebb5d8b'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:05.943495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-48129e2a-dff0-4a56-98e8-9153eebb5d8b admin admin] The token cache is being invalidate because project d6cf18bcda2d47c799c78e54473c4a6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:00:05.943789 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-48129e2a-dff0-4a56-98e8-9153eebb5d8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:05.944643 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-48129e2a-dff0-4a56-98e8-9153eebb5d8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:05.946663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1013/2002] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:00:05 2022] DELETE /identity/v3/projects/d6cf18bcda2d47c799c78e54473c4a6b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:00:05.950671 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c87097-729f-486f-a56a-ee03ee10483b admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:05.952712 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-f7c87097-729f-486f-a56a-ee03ee10483b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:06.048339 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c87097-729f-486f-a56a-ee03ee10483b admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:06.054565 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1a92e-851e-41a9-a351-8ed34283bb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:06.055323 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1a92e-851e-41a9-a351-8ed34283bb20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:06.055685 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1a92e-851e-41a9-a351-8ed34283bb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:06.055968 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1a92e-851e-41a9-a351-8ed34283bb20 admin admin] PATH_INFO: `/v3/users/e21668186f954db7a5f54d46c2631fb3` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:06.057265 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f1a92e-851e-41a9-a351-8ed34283bb20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e21668186f954db7a5f54d46c2631fb3)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:06.059515 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f1a92e-851e-41a9-a351-8ed34283bb20 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:06.118543 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-d8f1a92e-851e-41a9-a351-8ed34283bb20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e21668186f954db7a5f54d46c2631fb3'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:06.131571 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-d8f1a92e-851e-41a9-a351-8ed34283bb20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e21668186f954db7a5f54d46c2631fb3'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:06.132398 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-d8f1a92e-851e-41a9-a351-8ed34283bb20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e21668186f954db7a5f54d46c2631fb3'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:06.133122 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-d8f1a92e-851e-41a9-a351-8ed34283bb20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e21668186f954db7a5f54d46c2631fb3'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:06.157740 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-d8f1a92e-851e-41a9-a351-8ed34283bb20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e21668186f954db7a5f54d46c2631fb3'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:06.183816 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 990/2003] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:00:05 2022] DELETE /identity/v3/users/e21668186f954db7a5f54d46c2631fb3 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:06.467983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48129e2a-dff0-4a56-98e8-9153eebb5d8b admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:06.469466 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-48129e2a-dff0-4a56-98e8-9153eebb5d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:06.549033 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:06.611215 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48129e2a-dff0-4a56-98e8-9153eebb5d8b admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:06.686174 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1a92e-851e-41a9-a351-8ed34283bb20 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:06.688808 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-d8f1a92e-851e-41a9-a351-8ed34283bb20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:06.724981 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:06.767679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38624edb-1234-4e33-974b-ffcd692076bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:06.768768 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38624edb-1234-4e33-974b-ffcd692076bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:06.769266 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38624edb-1234-4e33-974b-ffcd692076bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:06.769627 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38624edb-1234-4e33-974b-ffcd692076bb admin admin] PATH_INFO: `/v3/users/34a0a755c412470dbfb3198d2440aac9` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:06.771694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38624edb-1234-4e33-974b-ffcd692076bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=34a0a755c412470dbfb3198d2440aac9)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:06.776151 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38624edb-1234-4e33-974b-ffcd692076bb admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:06.828356 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1a92e-851e-41a9-a351-8ed34283bb20 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:06.833493 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658587bf-9920-4083-99b9-449dafb7348d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:06.834149 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658587bf-9920-4083-99b9-449dafb7348d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:06.834521 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658587bf-9920-4083-99b9-449dafb7348d admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:06.834737 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658587bf-9920-4083-99b9-449dafb7348d admin admin] PATH_INFO: `/v3/projects/b8a85068e90f462798ebe0f75536d80a` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:06.835838 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658587bf-9920-4083-99b9-449dafb7348d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8a85068e90f462798ebe0f75536d80a)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:06.837839 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658587bf-9920-4083-99b9-449dafb7348d admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:06.839741 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-38624edb-1234-4e33-974b-ffcd692076bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34a0a755c412470dbfb3198d2440aac9'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:06.840826 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-38624edb-1234-4e33-974b-ffcd692076bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34a0a755c412470dbfb3198d2440aac9'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:06.851408 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-38624edb-1234-4e33-974b-ffcd692076bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34a0a755c412470dbfb3198d2440aac9'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:06.867133 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-38624edb-1234-4e33-974b-ffcd692076bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34a0a755c412470dbfb3198d2440aac9'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:06.877505 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-38624edb-1234-4e33-974b-ffcd692076bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34a0a755c412470dbfb3198d2440aac9'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:06.891211 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1014/2004] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:00:06 2022] DELETE /identity/v3/users/34a0a755c412470dbfb3198d2440aac9 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:06.892525 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38624edb-1234-4e33-974b-ffcd692076bb admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:06.895327 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-38624edb-1234-4e33-974b-ffcd692076bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:06.906604 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-658587bf-9920-4083-99b9-449dafb7348d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8a85068e90f462798ebe0f75536d80a', 'request_id': 'req-658587bf-9920-4083-99b9-449dafb7348d'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:06.917373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-658587bf-9920-4083-99b9-449dafb7348d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8a85068e90f462798ebe0f75536d80a', 'request_id': 'req-658587bf-9920-4083-99b9-449dafb7348d'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:06.931768 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-658587bf-9920-4083-99b9-449dafb7348d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8a85068e90f462798ebe0f75536d80a', 'request_id': 'req-658587bf-9920-4083-99b9-449dafb7348d'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:06.950998 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-658587bf-9920-4083-99b9-449dafb7348d admin admin] The token cache is being invalidate because project b8a85068e90f462798ebe0f75536d80a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:00:06.951511 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-658587bf-9920-4083-99b9-449dafb7348d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:06.952303 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-658587bf-9920-4083-99b9-449dafb7348d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:06.954361 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 991/2005] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:00:06 2022] DELETE /identity/v3/projects/b8a85068e90f462798ebe0f75536d80a => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:06.955737 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5a536-ec6e-4839-bf3c-f89e0a11171d None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:06.956275 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5a536-ec6e-4839-bf3c-f89e0a11171d None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:06.956642 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5a536-ec6e-4839-bf3c-f89e0a11171d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:06.980760 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-80d5a536-ec6e-4839-bf3c-f89e0a11171d None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:06.982531 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-80d5a536-ec6e-4839-bf3c-f89e0a11171d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:07.084465 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38624edb-1234-4e33-974b-ffcd692076bb admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:07.091759 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee114d-2fd3-4ae2-bb2a-5029d0c5e162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:07.093408 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee114d-2fd3-4ae2-bb2a-5029d0c5e162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:07.093825 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee114d-2fd3-4ae2-bb2a-5029d0c5e162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:07.094309 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee114d-2fd3-4ae2-bb2a-5029d0c5e162 admin admin] PATH_INFO: `/v3/projects/3e89084716184e1b88e40b541ee80248` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:07.095946 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ee114d-2fd3-4ae2-bb2a-5029d0c5e162 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e89084716184e1b88e40b541ee80248)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:07.098979 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ee114d-2fd3-4ae2-bb2a-5029d0c5e162 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:07.116465 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:07.124757 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 992/2006] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:07.126783 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a703c2c-bd68-4603-9c06-37f08fbf92fb None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:07.127166 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a703c2c-bd68-4603-9c06-37f08fbf92fb None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:07.127538 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a703c2c-bd68-4603-9c06-37f08fbf92fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:07.155629 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-5a703c2c-bd68-4603-9c06-37f08fbf92fb None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:07.157585 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-5a703c2c-bd68-4603-9c06-37f08fbf92fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:07.168954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 993/2007] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:07.170754 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a703c2c-bd68-4603-9c06-37f08fbf92fb None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:07.172353 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-5a703c2c-bd68-4603-9c06-37f08fbf92fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:07.229320 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a3ee114d-2fd3-4ae2-bb2a-5029d0c5e162 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e89084716184e1b88e40b541ee80248', 'request_id': 'req-a3ee114d-2fd3-4ae2-bb2a-5029d0c5e162'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:07.230648 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:07.244682 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a3ee114d-2fd3-4ae2-bb2a-5029d0c5e162 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e89084716184e1b88e40b541ee80248', 'request_id': 'req-a3ee114d-2fd3-4ae2-bb2a-5029d0c5e162'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:07.256157 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a3ee114d-2fd3-4ae2-bb2a-5029d0c5e162 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e89084716184e1b88e40b541ee80248', 'request_id': 'req-a3ee114d-2fd3-4ae2-bb2a-5029d0c5e162'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:07.262559 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a703c2c-bd68-4603-9c06-37f08fbf92fb None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:07.274635 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a3ee114d-2fd3-4ae2-bb2a-5029d0c5e162 admin admin] The token cache is being invalidate because project 3e89084716184e1b88e40b541ee80248 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:00:07.274912 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a3ee114d-2fd3-4ae2-bb2a-5029d0c5e162 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:07.276347 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a3ee114d-2fd3-4ae2-bb2a-5029d0c5e162 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:07.281003 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1015/2008] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:00:06 2022] DELETE /identity/v3/projects/3e89084716184e1b88e40b541ee80248 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:07.291362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36b59d-ebf9-4f63-b47c-18bc63c73575 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:07.293242 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36b59d-ebf9-4f63-b47c-18bc63c73575 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:07.293521 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36b59d-ebf9-4f63-b47c-18bc63c73575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:07.336636 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-dc36b59d-ebf9-4f63-b47c-18bc63c73575 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:07.340215 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-dc36b59d-ebf9-4f63-b47c-18bc63c73575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:07.352513 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bba520-03f1-4d40-ab39-f9bbdd57c763 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:07.353821 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bba520-03f1-4d40-ab39-f9bbdd57c763 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:07.354670 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bba520-03f1-4d40-ab39-f9bbdd57c763 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:07.355345 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bba520-03f1-4d40-ab39-f9bbdd57c763 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:07.359711 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-f9bba520-03f1-4d40-ab39-f9bbdd57c763 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:07.478037 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bba520-03f1-4d40-ab39-f9bbdd57c763 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:07.479670 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bba520-03f1-4d40-ab39-f9bbdd57c763 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:07.481841 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1016/2009] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:07.484758 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e356341-df1b-440a-b320-3ef5b2617b61 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:07.485080 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e356341-df1b-440a-b320-3ef5b2617b61 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:07.485803 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e356341-df1b-440a-b320-3ef5b2617b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:07.505229 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 994/2010] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:00:07.506987 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bba520-03f1-4d40-ab39-f9bbdd57c763 service neutron] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:07.517265 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-7e356341-df1b-440a-b320-3ef5b2617b61 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:07.518732 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7e356341-df1b-440a-b320-3ef5b2617b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:07.552649 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1017/2011] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:07.562182 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d920b96-ec26-4543-b0bc-0f1bc2c6d6c7 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:07.562518 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d920b96-ec26-4543-b0bc-0f1bc2c6d6c7 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:07.562903 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d920b96-ec26-4543-b0bc-0f1bc2c6d6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:07.569000 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bba520-03f1-4d40-ab39-f9bbdd57c763 service neutron] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:07.584641 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300019ff-24e8-4910-b46a-3f51e6fd7120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:07.584641 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300019ff-24e8-4910-b46a-3f51e6fd7120 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:07.584641 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300019ff-24e8-4910-b46a-3f51e6fd7120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:07.584641 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300019ff-24e8-4910-b46a-3f51e6fd7120 admin admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:07.585091 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300019ff-24e8-4910-b46a-3f51e6fd7120 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:00:07.585302 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300019ff-24e8-4910-b46a-3f51e6fd7120 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:07.586931 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300019ff-24e8-4910-b46a-3f51e6fd7120 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:07.597052 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-6d920b96-ec26-4543-b0bc-0f1bc2c6d6c7 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:07.597052 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-6d920b96-ec26-4543-b0bc-0f1bc2c6d6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:07.611810 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1018/2012] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:00:07.616567 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d920b96-ec26-4543-b0bc-0f1bc2c6d6c7 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:07.654445 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d920b96-ec26-4543-b0bc-0f1bc2c6d6c7 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:07.668363 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 995/2013] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 16:00:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:00:07.668557 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16caf2-6efe-482e-8ff9-a7cd1ee60dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:07.670932 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300019ff-24e8-4910-b46a-3f51e6fd7120 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:07.673441 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16caf2-6efe-482e-8ff9-a7cd1ee60dfc admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:07.674268 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16caf2-6efe-482e-8ff9-a7cd1ee60dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:07.676733 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16caf2-6efe-482e-8ff9-a7cd1ee60dfc admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:07.679169 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c16caf2-6efe-482e-8ff9-a7cd1ee60dfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:00:07.681248 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c16caf2-6efe-482e-8ff9-a7cd1ee60dfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:07.688594 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c16caf2-6efe-482e-8ff9-a7cd1ee60dfc admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:07.725288 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300019ff-24e8-4910-b46a-3f51e6fd7120 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:07.743277 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9dbaf-4572-433e-8f82-851d213ba4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:07.747307 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9dbaf-4572-433e-8f82-851d213ba4ed admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:07.747667 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9dbaf-4572-433e-8f82-851d213ba4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:07.749199 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9dbaf-4572-433e-8f82-851d213ba4ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:07.749951 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9dbaf-4572-433e-8f82-851d213ba4ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:07.750420 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1019/2014] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 16:00:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:00:07.755971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16caf2-6efe-482e-8ff9-a7cd1ee60dfc admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:07.759893 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9dbaf-4572-433e-8f82-851d213ba4ed admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:07.785764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16caf2-6efe-482e-8ff9-a7cd1ee60dfc admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:07.794296 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad816fa-4356-4723-81c0-683154649fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:07.796210 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad816fa-4356-4723-81c0-683154649fdf admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:07.796666 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad816fa-4356-4723-81c0-683154649fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:07.796985 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad816fa-4356-4723-81c0-683154649fdf admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:07.797972 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad816fa-4356-4723-81c0-683154649fdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:07.800057 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad816fa-4356-4723-81c0-683154649fdf admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:07.804630 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 996/2015] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:00:07 2022] POST /identity/v3/projects => generated 375 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:07.808702 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9dbaf-4572-433e-8f82-851d213ba4ed admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:07.849669 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1020/2016] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:00:07 2022] POST /identity/v3/projects => generated 381 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:07.850939 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad816fa-4356-4723-81c0-683154649fdf admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:07.963851 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9dbaf-4572-433e-8f82-851d213ba4ed admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:07.972141 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:07.985090 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:08.021545 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad816fa-4356-4723-81c0-683154649fdf admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:08.041793 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed8aff-4705-4a7f-b1a9-781de637be48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:08.042434 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed8aff-4705-4a7f-b1a9-781de637be48 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:08.042715 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed8aff-4705-4a7f-b1a9-781de637be48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:08.043016 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed8aff-4705-4a7f-b1a9-781de637be48 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:08.046789 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfed8aff-4705-4a7f-b1a9-781de637be48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:08.054988 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfed8aff-4705-4a7f-b1a9-781de637be48 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:08.105934 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc39b40-9022-4c5c-819b-117edaafcb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:08.108181 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc39b40-9022-4c5c-819b-117edaafcb84 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:08.108411 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc39b40-9022-4c5c-819b-117edaafcb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:08.108831 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc39b40-9022-4c5c-819b-117edaafcb84 admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:08.110512 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1021/2017] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:00:07 2022] POST /identity/v3/users => generated 291 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:08.116263 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed8aff-4705-4a7f-b1a9-781de637be48 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:08.121508 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc39b40-9022-4c5c-819b-117edaafcb84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:08.128477 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc39b40-9022-4c5c-819b-117edaafcb84 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:08.137690 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed8aff-4705-4a7f-b1a9-781de637be48 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:08.161123 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f99fb-b750-4eb5-bd0d-d8c0d804982a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:08.162101 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f99fb-b750-4eb5-bd0d-d8c0d804982a admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:08.163148 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f99fb-b750-4eb5-bd0d-d8c0d804982a admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:08.163660 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f99fb-b750-4eb5-bd0d-d8c0d804982a admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:08.164706 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f99fb-b750-4eb5-bd0d-d8c0d804982a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:08.167972 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f99fb-b750-4eb5-bd0d-d8c0d804982a admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:08.180715 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1022/2018] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:08.184627 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f99fb-b750-4eb5-bd0d-d8c0d804982a admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:08.198903 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f99fb-b750-4eb5-bd0d-d8c0d804982a admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:08.214393 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1909cfb-6012-4791-aa19-6fff344ad6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:08.215139 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1909cfb-6012-4791-aa19-6fff344ad6e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:08.217477 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1909cfb-6012-4791-aa19-6fff344ad6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:08.217477 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1909cfb-6012-4791-aa19-6fff344ad6e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:08.217728 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1909cfb-6012-4791-aa19-6fff344ad6e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:08.220269 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1909cfb-6012-4791-aa19-6fff344ad6e3 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:08.247257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1023/2019] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:00:08.247257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1909cfb-6012-4791-aa19-6fff344ad6e3 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:08.249783 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-f1909cfb-6012-4791-aa19-6fff344ad6e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:08.259512 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 997/2020] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:00:07 2022] POST /identity/v3/users => generated 288 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:00:08.260414 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc39b40-9022-4c5c-819b-117edaafcb84 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:08.270916 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1909cfb-6012-4791-aa19-6fff344ad6e3 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:08.277233 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f11b3a-2bb2-4fb0-a3d1-6b4f4b390a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:08.278316 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f11b3a-2bb2-4fb0-a3d1-6b4f4b390a62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:08.278926 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f11b3a-2bb2-4fb0-a3d1-6b4f4b390a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:08.279912 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f11b3a-2bb2-4fb0-a3d1-6b4f4b390a62 admin admin] PATH_INFO: `/v3/projects/813b92d8308345bab7a78fabb0585711` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:08.280819 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc39b40-9022-4c5c-819b-117edaafcb84 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:08.281663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f11b3a-2bb2-4fb0-a3d1-6b4f4b390a62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=813b92d8308345bab7a78fabb0585711)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:08.284057 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f11b3a-2bb2-4fb0-a3d1-6b4f4b390a62 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:08.286446 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5227d7-d519-4395-a63a-c949250f2584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:08.287125 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5227d7-d519-4395-a63a-c949250f2584 admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:08.287427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5227d7-d519-4395-a63a-c949250f2584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:08.287738 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5227d7-d519-4395-a63a-c949250f2584 admin admin] PATH_INFO: `/v3/projects/0db08288f86049dfb141960ab254c205/users/968be5aaa2ef44b6949635eb3a4929e7/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:08.307979 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5227d7-d519-4395-a63a-c949250f2584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0db08288f86049dfb141960ab254c205, user_id=968be5aaa2ef44b6949635eb3a4929e7, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:08.311254 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5227d7-d519-4395-a63a-c949250f2584 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:08.335792 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 998/2021] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:00:08 2022] PUT /identity/v3/projects/0db08288f86049dfb141960ab254c205/users/968be5aaa2ef44b6949635eb3a4929e7/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:08.336855 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5227d7-d519-4395-a63a-c949250f2584 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:08.352490 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-66f11b3a-2bb2-4fb0-a3d1-6b4f4b390a62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '813b92d8308345bab7a78fabb0585711', 'request_id': 'req-66f11b3a-2bb2-4fb0-a3d1-6b4f4b390a62'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:08.365931 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-66f11b3a-2bb2-4fb0-a3d1-6b4f4b390a62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '813b92d8308345bab7a78fabb0585711', 'request_id': 'req-66f11b3a-2bb2-4fb0-a3d1-6b4f4b390a62'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:08.376679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-66f11b3a-2bb2-4fb0-a3d1-6b4f4b390a62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '813b92d8308345bab7a78fabb0585711', 'request_id': 'req-66f11b3a-2bb2-4fb0-a3d1-6b4f4b390a62'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:08.398122 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-66f11b3a-2bb2-4fb0-a3d1-6b4f4b390a62 admin admin] The token cache is being invalidate because project 813b92d8308345bab7a78fabb0585711 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:00:08.398566 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-66f11b3a-2bb2-4fb0-a3d1-6b4f4b390a62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:08.399179 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-66f11b3a-2bb2-4fb0-a3d1-6b4f4b390a62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:08.401391 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1024/2022] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:00:08 2022] DELETE /identity/v3/projects/813b92d8308345bab7a78fabb0585711 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:08.402364 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7818a9-00c6-49b3-a673-07a8a3296c76 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:08.402645 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7818a9-00c6-49b3-a673-07a8a3296c76 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:08.402971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7818a9-00c6-49b3-a673-07a8a3296c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:08.448544 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-1a7818a9-00c6-49b3-a673-07a8a3296c76 None None] MFA Rules not processed for user `968be5aaa2ef44b6949635eb3a4929e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:08.451935 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5227d7-d519-4395-a63a-c949250f2584 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:08.453309 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-1a7818a9-00c6-49b3-a673-07a8a3296c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:08.543279 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1025/2023] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:08.544141 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7818a9-00c6-49b3-a673-07a8a3296c76 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:08.545723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-1a7818a9-00c6-49b3-a673-07a8a3296c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:08.554619 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7749f93-8f40-4993-8a42-c826ca34c833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:08.555818 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7749f93-8f40-4993-8a42-c826ca34c833 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:08.556286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7749f93-8f40-4993-8a42-c826ca34c833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:08.556742 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7749f93-8f40-4993-8a42-c826ca34c833 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:08.557873 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7749f93-8f40-4993-8a42-c826ca34c833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:08.561776 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7749f93-8f40-4993-8a42-c826ca34c833 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:08.581968 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 999/2024] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:08.582862 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7749f93-8f40-4993-8a42-c826ca34c833 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:08.588353 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-b7749f93-8f40-4993-8a42-c826ca34c833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:08.590310 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:08.615716 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7749f93-8f40-4993-8a42-c826ca34c833 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:08.624546 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3cb6f8-56b4-4955-8c5b-da0ca7dec1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:08.625147 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cb6f8-56b4-4955-8c5b-da0ca7dec1fa admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:08.625867 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cb6f8-56b4-4955-8c5b-da0ca7dec1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:08.626145 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cb6f8-56b4-4955-8c5b-da0ca7dec1fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:08.626798 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3cb6f8-56b4-4955-8c5b-da0ca7dec1fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:08.629326 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3cb6f8-56b4-4955-8c5b-da0ca7dec1fa admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:08.644651 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7818a9-00c6-49b3-a673-07a8a3296c76 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:08.652164 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47e250-9a37-43cf-a723-a534d4615bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:08.654389 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47e250-9a37-43cf-a723-a534d4615bce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:08.655079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47e250-9a37-43cf-a723-a534d4615bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:08.655356 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47e250-9a37-43cf-a723-a534d4615bce admin admin] PATH_INFO: `/v3/users/8c0dd5e42ec249dd88515a916d690c28` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:08.656719 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f47e250-9a37-43cf-a723-a534d4615bce admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c0dd5e42ec249dd88515a916d690c28)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:08.659770 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f47e250-9a37-43cf-a723-a534d4615bce admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:08.671936 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:08.685014 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1000/2025] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:00:08 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:08.687257 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3cb6f8-56b4-4955-8c5b-da0ca7dec1fa admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:08.689664 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-0e3cb6f8-56b4-4955-8c5b-da0ca7dec1fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:08.778243 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-7f47e250-9a37-43cf-a723-a534d4615bce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c0dd5e42ec249dd88515a916d690c28'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:08.778941 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-7f47e250-9a37-43cf-a723-a534d4615bce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c0dd5e42ec249dd88515a916d690c28'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:08.788201 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-7f47e250-9a37-43cf-a723-a534d4615bce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c0dd5e42ec249dd88515a916d690c28'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:08.796611 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3cb6f8-56b4-4955-8c5b-da0ca7dec1fa admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:08.802042 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5bf97-ccdc-41b1-9f66-94a0ed590434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:08.802777 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5bf97-ccdc-41b1-9f66-94a0ed590434 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:08.803066 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5bf97-ccdc-41b1-9f66-94a0ed590434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:08.803344 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5bf97-ccdc-41b1-9f66-94a0ed590434 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:08.803910 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-7f47e250-9a37-43cf-a723-a534d4615bce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c0dd5e42ec249dd88515a916d690c28'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:08.804639 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba5bf97-ccdc-41b1-9f66-94a0ed590434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:08.806546 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba5bf97-ccdc-41b1-9f66-94a0ed590434 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:08.812249 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-7f47e250-9a37-43cf-a723-a534d4615bce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c0dd5e42ec249dd88515a916d690c28'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:08.819768 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1026/2026] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:00:08 2022] DELETE /identity/v3/users/8c0dd5e42ec249dd88515a916d690c28 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:08.824397 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47e250-9a37-43cf-a723-a534d4615bce admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:08.827055 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7f47e250-9a37-43cf-a723-a534d4615bce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:08.842148 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1001/2027] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:08.843208 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5bf97-ccdc-41b1-9f66-94a0ed590434 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:08.849058 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-2ba5bf97-ccdc-41b1-9f66-94a0ed590434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:08.870000 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5bf97-ccdc-41b1-9f66-94a0ed590434 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:08.974375 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01ba8a-f142-4006-ba03-1fe2a5739445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:08.975251 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01ba8a-f142-4006-ba03-1fe2a5739445 admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:08.975472 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01ba8a-f142-4006-ba03-1fe2a5739445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:08.975830 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01ba8a-f142-4006-ba03-1fe2a5739445 admin admin] PATH_INFO: `/v3/projects/9ba3122e31034079a6d0727b60a1de4b/users/da9f3be19b6b404ebe071680fbce164f/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:08.984406 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47e250-9a37-43cf-a723-a534d4615bce admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:08.996446 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d576e-b0f2-44e8-b7e8-4eaa3ed945ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:08.997345 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01ba8a-f142-4006-ba03-1fe2a5739445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ba3122e31034079a6d0727b60a1de4b, user_id=da9f3be19b6b404ebe071680fbce164f, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:08.997703 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d576e-b0f2-44e8-b7e8-4eaa3ed945ee admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:08.999649 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d576e-b0f2-44e8-b7e8-4eaa3ed945ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:08.999649 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d576e-b0f2-44e8-b7e8-4eaa3ed945ee admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:08.999943 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d576e-b0f2-44e8-b7e8-4eaa3ed945ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:09.003789 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d576e-b0f2-44e8-b7e8-4eaa3ed945ee admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:09.007706 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01ba8a-f142-4006-ba03-1fe2a5739445 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:09.058572 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1002/2028] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:00:08 2022] PUT /identity/v3/projects/9ba3122e31034079a6d0727b60a1de4b/users/da9f3be19b6b404ebe071680fbce164f/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:09.065281 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505824f-56d8-403d-8d48-00873b64489c None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:09.067685 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505824f-56d8-403d-8d48-00873b64489c None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:09.068000 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505824f-56d8-403d-8d48-00873b64489c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:09.073503 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1027/2029] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:00:08 2022] POST /identity/v3/users => generated 298 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:09.075124 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d576e-b0f2-44e8-b7e8-4eaa3ed945ee admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:09.110122 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d576e-b0f2-44e8-b7e8-4eaa3ed945ee admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:09.154889 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-b505824f-56d8-403d-8d48-00873b64489c None None] MFA Rules not processed for user `da9f3be19b6b404ebe071680fbce164f`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:09.156329 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-b505824f-56d8-403d-8d48-00873b64489c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:09.194305 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:09.254968 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29fb4a-4982-4fc4-a403-dbc82019f561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:09.255604 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29fb4a-4982-4fc4-a403-dbc82019f561 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:09.255884 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29fb4a-4982-4fc4-a403-dbc82019f561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:09.256159 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29fb4a-4982-4fc4-a403-dbc82019f561 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:09.256910 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29fb4a-4982-4fc4-a403-dbc82019f561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:09.264795 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29fb4a-4982-4fc4-a403-dbc82019f561 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:09.286400 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1028/2030] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:09.292348 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29fb4a-4982-4fc4-a403-dbc82019f561 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:09.301105 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1003/2031] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:09.317297 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b505824f-56d8-403d-8d48-00873b64489c None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:09.319071 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-b505824f-56d8-403d-8d48-00873b64489c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:09.327775 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29fb4a-4982-4fc4-a403-dbc82019f561 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:09.334050 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9e9e9-a3f7-4b31-92df-a4ff59e143cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:09.335077 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9e9e9-a3f7-4b31-92df-a4ff59e143cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:09.335629 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9e9e9-a3f7-4b31-92df-a4ff59e143cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:09.336072 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9e9e9-a3f7-4b31-92df-a4ff59e143cb admin admin] PATH_INFO: `/v3/projects/b53101d46f33422bb49532a74bb7576b/users/ab1ba4131c354599869e59ab8e65a8bd/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:09.348929 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:09.367995 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9e9e9-a3f7-4b31-92df-a4ff59e143cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b53101d46f33422bb49532a74bb7576b, user_id=ab1ba4131c354599869e59ab8e65a8bd, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:09.373994 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9e9e9-a3f7-4b31-92df-a4ff59e143cb admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:09.419006 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1029/2032] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:00:09 2022] PUT /identity/v3/projects/b53101d46f33422bb49532a74bb7576b/users/ab1ba4131c354599869e59ab8e65a8bd/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:09.435312 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9e9e9-a3f7-4b31-92df-a4ff59e143cb admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:09.446435 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b505824f-56d8-403d-8d48-00873b64489c None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:09.523225 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091ffdf-de1a-4515-8269-290fd37d36e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:09.524261 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091ffdf-de1a-4515-8269-290fd37d36e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:09.524747 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091ffdf-de1a-4515-8269-290fd37d36e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:09.525307 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091ffdf-de1a-4515-8269-290fd37d36e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:09.586934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9e9e9-a3f7-4b31-92df-a4ff59e143cb admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:09.595051 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1ace1-5bb5-433d-968d-4a8b7b2f857a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:09.595945 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1ace1-5bb5-433d-968d-4a8b7b2f857a admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:09.596640 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1ace1-5bb5-433d-968d-4a8b7b2f857a admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:09.597116 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1ace1-5bb5-433d-968d-4a8b7b2f857a admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:09.597972 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b1ace1-5bb5-433d-968d-4a8b7b2f857a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:09.599860 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b1ace1-5bb5-433d-968d-4a8b7b2f857a admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:09.619217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d091ffdf-de1a-4515-8269-290fd37d36e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:09.631744 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d091ffdf-de1a-4515-8269-290fd37d36e5 service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:09.636624 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1030/2033] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:09.639923 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1ace1-5bb5-433d-968d-4a8b7b2f857a admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:09.646072 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-81b1ace1-5bb5-433d-968d-4a8b7b2f857a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:09.662216 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1004/2034] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:00:09.664684 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091ffdf-de1a-4515-8269-290fd37d36e5 service cinder] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:09.675177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1ace1-5bb5-433d-968d-4a8b7b2f857a admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:09.690016 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a793266-bdc5-436f-b9dd-c02d29a2b870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:09.691041 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091ffdf-de1a-4515-8269-290fd37d36e5 service cinder] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:09.692082 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a793266-bdc5-436f-b9dd-c02d29a2b870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:09.692362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a793266-bdc5-436f-b9dd-c02d29a2b870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:09.695935 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a793266-bdc5-436f-b9dd-c02d29a2b870 admin admin] PATH_INFO: `/v3/projects/9c35add69405475fa5af087b371948fc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:09.697038 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a793266-bdc5-436f-b9dd-c02d29a2b870 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c35add69405475fa5af087b371948fc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:09.701888 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a793266-bdc5-436f-b9dd-c02d29a2b870 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:09.706604 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04672a-f3fc-45fc-9c4a-d30deb9c42ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:09.707454 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04672a-f3fc-45fc-9c4a-d30deb9c42ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:09.707834 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04672a-f3fc-45fc-9c4a-d30deb9c42ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:09.710854 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04672a-f3fc-45fc-9c4a-d30deb9c42ce admin admin] PATH_INFO: `/v3/projects/b53101d46f33422bb49532a74bb7576b/users/ab1ba4131c354599869e59ab8e65a8bd/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:09.714659 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d04672a-f3fc-45fc-9c4a-d30deb9c42ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=b53101d46f33422bb49532a74bb7576b, user_id=ab1ba4131c354599869e59ab8e65a8bd, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:09.719912 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d04672a-f3fc-45fc-9c4a-d30deb9c42ce admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:09.767426 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1005/2035] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:00:09 2022] PUT /identity/v3/projects/b53101d46f33422bb49532a74bb7576b/users/ab1ba4131c354599869e59ab8e65a8bd/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:09.785617 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4d9eb-bf6b-42e8-a927-d780a5612ce0 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:09.785918 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4d9eb-bf6b-42e8-a927-d780a5612ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:09.786204 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4d9eb-bf6b-42e8-a927-d780a5612ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:09.816346 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6a793266-bdc5-436f-b9dd-c02d29a2b870 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c35add69405475fa5af087b371948fc', 'request_id': 'req-6a793266-bdc5-436f-b9dd-c02d29a2b870'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:09.829941 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6a793266-bdc5-436f-b9dd-c02d29a2b870 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c35add69405475fa5af087b371948fc', 'request_id': 'req-6a793266-bdc5-436f-b9dd-c02d29a2b870'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:09.840207 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6a793266-bdc5-436f-b9dd-c02d29a2b870 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c35add69405475fa5af087b371948fc', 'request_id': 'req-6a793266-bdc5-436f-b9dd-c02d29a2b870'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:09.868182 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6a793266-bdc5-436f-b9dd-c02d29a2b870 admin admin] The token cache is being invalidate because project 9c35add69405475fa5af087b371948fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:00:09.868559 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6a793266-bdc5-436f-b9dd-c02d29a2b870 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:09.869348 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6a793266-bdc5-436f-b9dd-c02d29a2b870 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:09.871694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1031/2036] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:00:09 2022] DELETE /identity/v3/projects/9c35add69405475fa5af087b371948fc => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:09.877519 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-01d4d9eb-bf6b-42e8-a927-d780a5612ce0 None None] MFA Rules not processed for user `ab1ba4131c354599869e59ab8e65a8bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:09.878055 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcade2da-6f2a-4da8-8ad1-80997287458a None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:09.878359 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcade2da-6f2a-4da8-8ad1-80997287458a None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:09.878757 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcade2da-6f2a-4da8-8ad1-80997287458a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:09.879507 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-01d4d9eb-bf6b-42e8-a927-d780a5612ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:09.922787 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-fcade2da-6f2a-4da8-8ad1-80997287458a None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:09.924255 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-fcade2da-6f2a-4da8-8ad1-80997287458a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:09.974218 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:09.980736 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:10.017457 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1006/2037] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:09 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:10.027848 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4d9eb-bf6b-42e8-a927-d780a5612ce0 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:10.031155 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-01d4d9eb-bf6b-42e8-a927-d780a5612ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:10.056832 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1032/2038] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:10.064760 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f585c-2e79-4e26-91e8-6564b67d2151 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:10.065201 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f585c-2e79-4e26-91e8-6564b67d2151 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:10.065579 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f585c-2e79-4e26-91e8-6564b67d2151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:10.122603 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-4d0f585c-2e79-4e26-91e8-6564b67d2151 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:10.125767 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-4d0f585c-2e79-4e26-91e8-6564b67d2151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:10.127159 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4d9eb-bf6b-42e8-a927-d780a5612ce0 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:10.131730 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b09eb-3d12-47e6-bd82-7349582d490c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:10.134444 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b09eb-3d12-47e6-bd82-7349582d490c service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:10.134825 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b09eb-3d12-47e6-bd82-7349582d490c service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:10.135192 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b09eb-3d12-47e6-bd82-7349582d490c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:10.146668 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b09eb-3d12-47e6-bd82-7349582d490c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:10.147185 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1033/2039] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:10.148542 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b09eb-3d12-47e6-bd82-7349582d490c service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:10.164068 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f585c-2e79-4e26-91e8-6564b67d2151 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:10.170824 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f585c-2e79-4e26-91e8-6564b67d2151 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:10.171514 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1007/2040] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:10 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:00:10.181457 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c8569-7d87-42f0-b51b-7c94719d9002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:10.182249 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c8569-7d87-42f0-b51b-7c94719d9002 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:10.182613 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c8569-7d87-42f0-b51b-7c94719d9002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:10.182996 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c8569-7d87-42f0-b51b-7c94719d9002 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:10.183744 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c8569-7d87-42f0-b51b-7c94719d9002 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:00:10.184322 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c8569-7d87-42f0-b51b-7c94719d9002 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:10.187378 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c8569-7d87-42f0-b51b-7c94719d9002 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:10.214551 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1034/2041] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 16:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:00:10.219085 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b09eb-3d12-47e6-bd82-7349582d490c service cinder] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:10.238271 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b09eb-3d12-47e6-bd82-7349582d490c service cinder] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:10.244602 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052fafb1-f030-469e-82e4-c2ea60438bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:10.245136 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fafb1-f030-469e-82e4-c2ea60438bbb admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:10.245413 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fafb1-f030-469e-82e4-c2ea60438bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:10.245685 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fafb1-f030-469e-82e4-c2ea60438bbb admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:10.246328 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052fafb1-f030-469e-82e4-c2ea60438bbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:10.248854 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052fafb1-f030-469e-82e4-c2ea60438bbb admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:10.288854 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1008/2042] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:00:10 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:00:10.290831 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c8569-7d87-42f0-b51b-7c94719d9002 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:10.303622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c8569-7d87-42f0-b51b-7c94719d9002 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:10.304478 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052fafb1-f030-469e-82e4-c2ea60438bbb admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:10.375372 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052fafb1-f030-469e-82e4-c2ea60438bbb admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:10.379063 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18942b74-b164-4527-9e55-ab512ec99b09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:10.379680 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18942b74-b164-4527-9e55-ab512ec99b09 service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:10.379952 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18942b74-b164-4527-9e55-ab512ec99b09 service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:10.380219 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18942b74-b164-4527-9e55-ab512ec99b09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:10.382074 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-18942b74-b164-4527-9e55-ab512ec99b09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:10.389308 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c8a59-c2ab-4080-b649-915bf5b531ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:10.390145 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c8a59-c2ab-4080-b649-915bf5b531ee admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:10.390633 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c8a59-c2ab-4080-b649-915bf5b531ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:10.391591 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c8a59-c2ab-4080-b649-915bf5b531ee admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:10.392240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c8a59-c2ab-4080-b649-915bf5b531ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:10.394209 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c8a59-c2ab-4080-b649-915bf5b531ee admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:10.417557 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1035/2043] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:00:10 2022] POST /identity/v3/users => generated 293 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:00:10.421862 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c8a59-c2ab-4080-b649-915bf5b531ee admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:10.433827 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c8a59-c2ab-4080-b649-915bf5b531ee admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:10.439640 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cace9af-c79d-4bea-8bfe-d677bb1b6c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:10.440394 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cace9af-c79d-4bea-8bfe-d677bb1b6c6a admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:10.440676 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cace9af-c79d-4bea-8bfe-d677bb1b6c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:10.440988 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cace9af-c79d-4bea-8bfe-d677bb1b6c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:10.441661 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cace9af-c79d-4bea-8bfe-d677bb1b6c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:10.443226 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cace9af-c79d-4bea-8bfe-d677bb1b6c6a admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:10.453281 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18942b74-b164-4527-9e55-ab512ec99b09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:10.455304 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18942b74-b164-4527-9e55-ab512ec99b09 service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:10.456002 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1036/2044] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:10.460097 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cace9af-c79d-4bea-8bfe-d677bb1b6c6a admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:10.466009 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1009/2045] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:00:10.472879 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cace9af-c79d-4bea-8bfe-d677bb1b6c6a admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:10.478209 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e31d5-9130-4687-96ed-8a7d2b87d5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:10.478877 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e31d5-9130-4687-96ed-8a7d2b87d5f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:10.479157 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e31d5-9130-4687-96ed-8a7d2b87d5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:10.479430 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e31d5-9130-4687-96ed-8a7d2b87d5f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:10.480079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e31d5-9130-4687-96ed-8a7d2b87d5f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:10.481681 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e31d5-9130-4687-96ed-8a7d2b87d5f9 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:10.496169 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1037/2046] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:00:10.497546 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18942b74-b164-4527-9e55-ab512ec99b09 service cinder] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:10.512579 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18942b74-b164-4527-9e55-ab512ec99b09 service cinder] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:10.518201 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337cb3b-4c19-4cc1-bf2c-ef100197d8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:10.518953 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337cb3b-4c19-4cc1-bf2c-ef100197d8c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:10.519239 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337cb3b-4c19-4cc1-bf2c-ef100197d8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:10.519527 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337cb3b-4c19-4cc1-bf2c-ef100197d8c3 admin admin] PATH_INFO: `/v3/projects/da8c2368ee4842ecb470b0c715c585a5/users/a7191d35b7544b85aa99fe379407e92a/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:10.537250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7337cb3b-4c19-4cc1-bf2c-ef100197d8c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da8c2368ee4842ecb470b0c715c585a5, user_id=a7191d35b7544b85aa99fe379407e92a, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:10.540068 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7337cb3b-4c19-4cc1-bf2c-ef100197d8c3 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:10.561966 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1010/2047] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:00:10 2022] PUT /identity/v3/projects/da8c2368ee4842ecb470b0c715c585a5/users/a7191d35b7544b85aa99fe379407e92a/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:10.572979 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1d34e-dd6c-4c84-bd03-80bcb77e3d15 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:10.572979 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1d34e-dd6c-4c84-bd03-80bcb77e3d15 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:10.573161 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1d34e-dd6c-4c84-bd03-80bcb77e3d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:10.609475 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-41a1d34e-dd6c-4c84-bd03-80bcb77e3d15 None None] MFA Rules not processed for user `a7191d35b7544b85aa99fe379407e92a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:10.611512 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-41a1d34e-dd6c-4c84-bd03-80bcb77e3d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:10.703147 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1038/2048] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:00:10.708753 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337cb3b-4c19-4cc1-bf2c-ef100197d8c3 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:10.716914 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:10.814784 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337cb3b-4c19-4cc1-bf2c-ef100197d8c3 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:10.821711 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc86c4b-b965-493a-b447-487947f091e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:10.822559 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc86c4b-b965-493a-b447-487947f091e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:10.823215 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc86c4b-b965-493a-b447-487947f091e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:10.823825 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc86c4b-b965-493a-b447-487947f091e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:10.824956 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc86c4b-b965-493a-b447-487947f091e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:10.829115 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc86c4b-b965-493a-b447-487947f091e8 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:10.872541 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1011/2049] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:00:10 2022] POST /identity/v3/projects => generated 385 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:10.876919 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1d34e-dd6c-4c84-bd03-80bcb77e3d15 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:10.892619 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1d34e-dd6c-4c84-bd03-80bcb77e3d15 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:10.896640 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:10.959748 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52400507-f115-4d68-8cea-c0de46afbf25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:10.960428 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52400507-f115-4d68-8cea-c0de46afbf25 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:10.960709 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52400507-f115-4d68-8cea-c0de46afbf25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:10.961007 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52400507-f115-4d68-8cea-c0de46afbf25 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:10.961639 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52400507-f115-4d68-8cea-c0de46afbf25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:10.963847 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52400507-f115-4d68-8cea-c0de46afbf25 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:10.988824 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1039/2050] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:00:10 2022] POST /identity/v3/users => generated 299 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:00:10.990610 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc86c4b-b965-493a-b447-487947f091e8 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:11.001760 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc86c4b-b965-493a-b447-487947f091e8 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:11.006409 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f504089-96fc-4ea2-90dd-42dc1a102165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:11.007026 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f504089-96fc-4ea2-90dd-42dc1a102165 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:11.007303 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f504089-96fc-4ea2-90dd-42dc1a102165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:11.007572 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f504089-96fc-4ea2-90dd-42dc1a102165 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:11.008218 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f504089-96fc-4ea2-90dd-42dc1a102165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:11.010456 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f504089-96fc-4ea2-90dd-42dc1a102165 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:11.022747 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1012/2051] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:11.026977 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52400507-f115-4d68-8cea-c0de46afbf25 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:11.037651 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52400507-f115-4d68-8cea-c0de46afbf25 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:11.042604 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743771a-a607-4823-8c1d-1edf2b0b0a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:11.043278 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743771a-a607-4823-8c1d-1edf2b0b0a38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:11.043558 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743771a-a607-4823-8c1d-1edf2b0b0a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:11.043829 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743771a-a607-4823-8c1d-1edf2b0b0a38 admin admin] PATH_INFO: `/v3/projects/de77a86877f943a19c6c1bd72a77d9f2/users/b039bf4ffa5f4798aae869de5f5aaf1d/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:11.063686 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1743771a-a607-4823-8c1d-1edf2b0b0a38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de77a86877f943a19c6c1bd72a77d9f2, user_id=b039bf4ffa5f4798aae869de5f5aaf1d, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:11.066921 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1743771a-a607-4823-8c1d-1edf2b0b0a38 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:11.085839 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1040/2052] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:00:11 2022] PUT /identity/v3/projects/de77a86877f943a19c6c1bd72a77d9f2/users/b039bf4ffa5f4798aae869de5f5aaf1d/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:11.089707 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f504089-96fc-4ea2-90dd-42dc1a102165 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:11.100006 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f504089-96fc-4ea2-90dd-42dc1a102165 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:11.161566 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d36068-52c8-4c90-96fb-e37b03213c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:11.162314 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d36068-52c8-4c90-96fb-e37b03213c85 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:11.162636 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d36068-52c8-4c90-96fb-e37b03213c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:11.162911 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d36068-52c8-4c90-96fb-e37b03213c85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:11.163710 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d36068-52c8-4c90-96fb-e37b03213c85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:11.165478 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d36068-52c8-4c90-96fb-e37b03213c85 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:11.176586 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1013/2053] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:11.180722 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743771a-a607-4823-8c1d-1edf2b0b0a38 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:11.192167 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743771a-a607-4823-8c1d-1edf2b0b0a38 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:11.196989 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c7ea7-a45c-4be4-996a-3c628bfa1d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:11.197852 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c7ea7-a45c-4be4-996a-3c628bfa1d3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:11.198127 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c7ea7-a45c-4be4-996a-3c628bfa1d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:11.198401 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c7ea7-a45c-4be4-996a-3c628bfa1d3a admin admin] PATH_INFO: `/v3/projects/de77a86877f943a19c6c1bd72a77d9f2/users/b039bf4ffa5f4798aae869de5f5aaf1d/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:11.200339 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c7ea7-a45c-4be4-996a-3c628bfa1d3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=de77a86877f943a19c6c1bd72a77d9f2, user_id=b039bf4ffa5f4798aae869de5f5aaf1d, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:11.203248 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c7ea7-a45c-4be4-996a-3c628bfa1d3a admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:11.217962 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1041/2054] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:00:11 2022] PUT /identity/v3/projects/de77a86877f943a19c6c1bd72a77d9f2/users/b039bf4ffa5f4798aae869de5f5aaf1d/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:00:11.228865 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b99974-62ba-47ff-9d5b-1e1ad492b002 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:11.229156 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b99974-62ba-47ff-9d5b-1e1ad492b002 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:11.229436 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b99974-62ba-47ff-9d5b-1e1ad492b002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:11.259956 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-24b99974-62ba-47ff-9d5b-1e1ad492b002 None None] MFA Rules not processed for user `b039bf4ffa5f4798aae869de5f5aaf1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:11.261236 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-24b99974-62ba-47ff-9d5b-1e1ad492b002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:11.337321 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:11.345217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1014/2055] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:11 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:11.356453 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c7ea7-a45c-4be4-996a-3c628bfa1d3a admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:11.359246 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c86c7ea7-a45c-4be4-996a-3c628bfa1d3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:11.440648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c7ea7-a45c-4be4-996a-3c628bfa1d3a admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:11.445346 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5cbd5-afa5-4b28-a962-ff78ad745997 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:11.446016 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5cbd5-afa5-4b28-a962-ff78ad745997 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:11.446320 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5cbd5-afa5-4b28-a962-ff78ad745997 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:11.446622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5cbd5-afa5-4b28-a962-ff78ad745997 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:11.505485 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5cbd5-afa5-4b28-a962-ff78ad745997 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:11.506914 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5cbd5-afa5-4b28-a962-ff78ad745997 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:11.516633 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1042/2056] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:00:13.232871 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b99974-62ba-47ff-9d5b-1e1ad492b002 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:13.241044 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-24b99974-62ba-47ff-9d5b-1e1ad492b002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:13.337090 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b99974-62ba-47ff-9d5b-1e1ad492b002 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:13.341773 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5acbb71-9557-4428-bd74-9e5d81a33470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:13.342562 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5acbb71-9557-4428-bd74-9e5d81a33470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:13.343052 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5acbb71-9557-4428-bd74-9e5d81a33470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:13.343052 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5acbb71-9557-4428-bd74-9e5d81a33470 admin admin] PATH_INFO: `/v3/users/968be5aaa2ef44b6949635eb3a4929e7` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:13.344249 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5acbb71-9557-4428-bd74-9e5d81a33470 admin admin] RBAC: Authorizing `identity:delete_user(user_id=968be5aaa2ef44b6949635eb3a4929e7)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:13.346482 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5acbb71-9557-4428-bd74-9e5d81a33470 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:13.414742 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-c5acbb71-9557-4428-bd74-9e5d81a33470 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '968be5aaa2ef44b6949635eb3a4929e7'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:13.433214 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-c5acbb71-9557-4428-bd74-9e5d81a33470 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '968be5aaa2ef44b6949635eb3a4929e7'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:13.434680 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-c5acbb71-9557-4428-bd74-9e5d81a33470 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '968be5aaa2ef44b6949635eb3a4929e7'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:13.436122 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-c5acbb71-9557-4428-bd74-9e5d81a33470 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '968be5aaa2ef44b6949635eb3a4929e7'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:13.444766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-c5acbb71-9557-4428-bd74-9e5d81a33470 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '968be5aaa2ef44b6949635eb3a4929e7'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:13.461521 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1015/2057] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:00:13 2022] DELETE /identity/v3/users/968be5aaa2ef44b6949635eb3a4929e7 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:13.466162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207360fd-d145-4b0c-88ef-cbd23b088cc2 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:13.466687 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207360fd-d145-4b0c-88ef-cbd23b088cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:13.467162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207360fd-d145-4b0c-88ef-cbd23b088cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:13.488494 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-207360fd-d145-4b0c-88ef-cbd23b088cc2 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:13.489910 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-207360fd-d145-4b0c-88ef-cbd23b088cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:13.501225 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:13.576532 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1043/2058] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:00:13.582937 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5acbb71-9557-4428-bd74-9e5d81a33470 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:13.584418 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-c5acbb71-9557-4428-bd74-9e5d81a33470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:13.684333 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5acbb71-9557-4428-bd74-9e5d81a33470 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:13.688605 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745404f-869a-4a6b-954c-c7343cd47a2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:13.689301 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745404f-869a-4a6b-954c-c7343cd47a2a service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:13.689583 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745404f-869a-4a6b-954c-c7343cd47a2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:13.689852 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745404f-869a-4a6b-954c-c7343cd47a2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:13.703277 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745404f-869a-4a6b-954c-c7343cd47a2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:13.705296 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745404f-869a-4a6b-954c-c7343cd47a2a service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:13.732055 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1016/2059] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:00:14.099041 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207360fd-d145-4b0c-88ef-cbd23b088cc2 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:14.100521 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-207360fd-d145-4b0c-88ef-cbd23b088cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:14.119213 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207360fd-d145-4b0c-88ef-cbd23b088cc2 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:14.126532 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c76eaf-f9d9-434e-be8b-bdb958bdba8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:14.127187 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c76eaf-f9d9-434e-be8b-bdb958bdba8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:14.127470 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c76eaf-f9d9-434e-be8b-bdb958bdba8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:14.127739 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c76eaf-f9d9-434e-be8b-bdb958bdba8d admin admin] PATH_INFO: `/v3/projects/0db08288f86049dfb141960ab254c205` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:14.129020 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c76eaf-f9d9-434e-be8b-bdb958bdba8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0db08288f86049dfb141960ab254c205)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:14.131079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c76eaf-f9d9-434e-be8b-bdb958bdba8d admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:14.184802 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-78c76eaf-f9d9-434e-be8b-bdb958bdba8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0db08288f86049dfb141960ab254c205', 'request_id': 'req-78c76eaf-f9d9-434e-be8b-bdb958bdba8d'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:14.192699 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-78c76eaf-f9d9-434e-be8b-bdb958bdba8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0db08288f86049dfb141960ab254c205', 'request_id': 'req-78c76eaf-f9d9-434e-be8b-bdb958bdba8d'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:14.202593 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-78c76eaf-f9d9-434e-be8b-bdb958bdba8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0db08288f86049dfb141960ab254c205', 'request_id': 'req-78c76eaf-f9d9-434e-be8b-bdb958bdba8d'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:14.224977 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-78c76eaf-f9d9-434e-be8b-bdb958bdba8d admin admin] The token cache is being invalidate because project 0db08288f86049dfb141960ab254c205 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:00:14.225285 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-78c76eaf-f9d9-434e-be8b-bdb958bdba8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:14.230414 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-78c76eaf-f9d9-434e-be8b-bdb958bdba8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:14.235942 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1044/2060] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:00:14 2022] DELETE /identity/v3/projects/0db08288f86049dfb141960ab254c205 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:14.237151 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745404f-869a-4a6b-954c-c7343cd47a2a service neutron] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:14.250517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745404f-869a-4a6b-954c-c7343cd47a2a service neutron] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:14.279633 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:14.364381 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08328b-5fbb-4ca1-93f1-8a6fbdc16108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:14.365308 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08328b-5fbb-4ca1-93f1-8a6fbdc16108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:14.365697 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08328b-5fbb-4ca1-93f1-8a6fbdc16108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:14.367429 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08328b-5fbb-4ca1-93f1-8a6fbdc16108 admin admin] PATH_INFO: `/v3/users/ab1ba4131c354599869e59ab8e65a8bd` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:14.368899 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf08328b-5fbb-4ca1-93f1-8a6fbdc16108 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab1ba4131c354599869e59ab8e65a8bd)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:14.371081 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf08328b-5fbb-4ca1-93f1-8a6fbdc16108 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:14.441821 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-cf08328b-5fbb-4ca1-93f1-8a6fbdc16108 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab1ba4131c354599869e59ab8e65a8bd'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:14.461170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-cf08328b-5fbb-4ca1-93f1-8a6fbdc16108 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab1ba4131c354599869e59ab8e65a8bd'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:14.462143 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-cf08328b-5fbb-4ca1-93f1-8a6fbdc16108 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab1ba4131c354599869e59ab8e65a8bd'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:14.462926 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-cf08328b-5fbb-4ca1-93f1-8a6fbdc16108 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab1ba4131c354599869e59ab8e65a8bd'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:14.478452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-cf08328b-5fbb-4ca1-93f1-8a6fbdc16108 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab1ba4131c354599869e59ab8e65a8bd'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:14.493088 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1017/2061] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:00:14 2022] DELETE /identity/v3/users/ab1ba4131c354599869e59ab8e65a8bd => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:00:14.824677 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c76eaf-f9d9-434e-be8b-bdb958bdba8d admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:14.828604 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-78c76eaf-f9d9-434e-be8b-bdb958bdba8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:14.875812 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c76eaf-f9d9-434e-be8b-bdb958bdba8d admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:15.013683 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d78d54-ac97-47d1-9f18-4312ea52b915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:15.014611 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d78d54-ac97-47d1-9f18-4312ea52b915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:15.015067 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d78d54-ac97-47d1-9f18-4312ea52b915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:15.015592 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d78d54-ac97-47d1-9f18-4312ea52b915 admin admin] PATH_INFO: `/v3/projects/b53101d46f33422bb49532a74bb7576b` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:15.017222 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d78d54-ac97-47d1-9f18-4312ea52b915 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b53101d46f33422bb49532a74bb7576b)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:15.019845 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d78d54-ac97-47d1-9f18-4312ea52b915 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:15.063511 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:15.072227 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b5d78d54-ac97-47d1-9f18-4312ea52b915 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b53101d46f33422bb49532a74bb7576b', 'request_id': 'req-b5d78d54-ac97-47d1-9f18-4312ea52b915'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:15.079493 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b5d78d54-ac97-47d1-9f18-4312ea52b915 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b53101d46f33422bb49532a74bb7576b', 'request_id': 'req-b5d78d54-ac97-47d1-9f18-4312ea52b915'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:15.085696 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b5d78d54-ac97-47d1-9f18-4312ea52b915 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b53101d46f33422bb49532a74bb7576b', 'request_id': 'req-b5d78d54-ac97-47d1-9f18-4312ea52b915'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:15.096328 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b5d78d54-ac97-47d1-9f18-4312ea52b915 admin admin] The token cache is being invalidate because project b53101d46f33422bb49532a74bb7576b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:00:15.096618 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b5d78d54-ac97-47d1-9f18-4312ea52b915 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:15.097284 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b5d78d54-ac97-47d1-9f18-4312ea52b915 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:15.099174 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1045/2062] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:00:14 2022] DELETE /identity/v3/projects/b53101d46f33422bb49532a74bb7576b => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:15.103839 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77dd91-6814-422e-a41a-4ae8590e5d6f None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:15.104123 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77dd91-6814-422e-a41a-4ae8590e5d6f None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:15.104395 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77dd91-6814-422e-a41a-4ae8590e5d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:15.125332 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-6d77dd91-6814-422e-a41a-4ae8590e5d6f None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:15.126535 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-6d77dd91-6814-422e-a41a-4ae8590e5d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:15.190699 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1018/2063] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:15.198436 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fd7f5-1381-4663-9905-c308c4fe7397 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:15.198720 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fd7f5-1381-4663-9905-c308c4fe7397 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:15.199016 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fd7f5-1381-4663-9905-c308c4fe7397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:15.219924 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-112fd7f5-1381-4663-9905-c308c4fe7397 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:15.221468 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-112fd7f5-1381-4663-9905-c308c4fe7397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:15.229528 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1046/2064] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:15.235389 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77dd91-6814-422e-a41a-4ae8590e5d6f None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:15.245516 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77dd91-6814-422e-a41a-4ae8590e5d6f None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:15.250235 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36be57f-354a-4f26-8ed7-a905f38ba60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:15.250848 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36be57f-354a-4f26-8ed7-a905f38ba60b admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:15.251124 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36be57f-354a-4f26-8ed7-a905f38ba60b admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:15.251395 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36be57f-354a-4f26-8ed7-a905f38ba60b admin admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:15.252045 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36be57f-354a-4f26-8ed7-a905f38ba60b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:00:15.252341 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36be57f-354a-4f26-8ed7-a905f38ba60b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:15.254130 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36be57f-354a-4f26-8ed7-a905f38ba60b admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:15.266964 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1019/2065] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 16:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:00:15.271446 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fd7f5-1381-4663-9905-c308c4fe7397 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:15.281759 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fd7f5-1381-4663-9905-c308c4fe7397 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:15.286741 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fbef0-c346-4894-a464-507a1f2d4895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:15.287340 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fbef0-c346-4894-a464-507a1f2d4895 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:15.287618 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fbef0-c346-4894-a464-507a1f2d4895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:15.287888 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fbef0-c346-4894-a464-507a1f2d4895 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:15.289900 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4fbef0-c346-4894-a464-507a1f2d4895 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:15.290640 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4fbef0-c346-4894-a464-507a1f2d4895 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:15.323560 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1047/2066] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:00:15 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:15.325006 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36be57f-354a-4f26-8ed7-a905f38ba60b admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:15.336267 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36be57f-354a-4f26-8ed7-a905f38ba60b admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:15.368578 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:15.410428 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce551f-a990-4f21-a32c-808b6ebc4380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:15.411377 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce551f-a990-4f21-a32c-808b6ebc4380 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:15.411655 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce551f-a990-4f21-a32c-808b6ebc4380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:15.411919 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce551f-a990-4f21-a32c-808b6ebc4380 admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:15.412571 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce551f-a990-4f21-a32c-808b6ebc4380 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:15.414588 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce551f-a990-4f21-a32c-808b6ebc4380 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:15.442142 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1020/2067] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:00:15 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:15.446877 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fbef0-c346-4894-a464-507a1f2d4895 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:15.461989 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fbef0-c346-4894-a464-507a1f2d4895 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:15.469000 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c49a3f-aac9-4680-a603-f8f4989f2359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:15.469666 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c49a3f-aac9-4680-a603-f8f4989f2359 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:15.469936 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c49a3f-aac9-4680-a603-f8f4989f2359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:15.470211 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c49a3f-aac9-4680-a603-f8f4989f2359 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:15.470928 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c49a3f-aac9-4680-a603-f8f4989f2359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:15.472529 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c49a3f-aac9-4680-a603-f8f4989f2359 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:15.488450 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1048/2068] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:15.490801 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce551f-a990-4f21-a32c-808b6ebc4380 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:15.501751 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce551f-a990-4f21-a32c-808b6ebc4380 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:15.506701 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae67d3d-ac67-4ab8-a98c-4e0c5568551d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:15.507350 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae67d3d-ac67-4ab8-a98c-4e0c5568551d admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:15.507665 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae67d3d-ac67-4ab8-a98c-4e0c5568551d admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:15.507948 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae67d3d-ac67-4ab8-a98c-4e0c5568551d admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:15.509061 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae67d3d-ac67-4ab8-a98c-4e0c5568551d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:15.510812 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae67d3d-ac67-4ab8-a98c-4e0c5568551d admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:15.523921 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1021/2069] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:15.528093 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c49a3f-aac9-4680-a603-f8f4989f2359 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:15.539535 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c49a3f-aac9-4680-a603-f8f4989f2359 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:15.546217 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8dbb94-2bc8-4c23-a271-c9aec9691a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:15.547293 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8dbb94-2bc8-4c23-a271-c9aec9691a96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:15.547577 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8dbb94-2bc8-4c23-a271-c9aec9691a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:15.547852 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8dbb94-2bc8-4c23-a271-c9aec9691a96 admin admin] PATH_INFO: `/v3/projects/0025ea952ba7409f88ce6100839ced76/users/827c04f0810141ce83d4af6a4f18c783/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:15.564700 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8dbb94-2bc8-4c23-a271-c9aec9691a96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0025ea952ba7409f88ce6100839ced76, user_id=827c04f0810141ce83d4af6a4f18c783, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:15.567417 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8dbb94-2bc8-4c23-a271-c9aec9691a96 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:15.581684 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1049/2070] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:00:15 2022] PUT /identity/v3/projects/0025ea952ba7409f88ce6100839ced76/users/827c04f0810141ce83d4af6a4f18c783/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:15.592601 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832509cb-e5d2-4280-a41f-1e15314eb9ec None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:15.592928 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832509cb-e5d2-4280-a41f-1e15314eb9ec None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:15.593205 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832509cb-e5d2-4280-a41f-1e15314eb9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:15.622765 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-832509cb-e5d2-4280-a41f-1e15314eb9ec None None] MFA Rules not processed for user `827c04f0810141ce83d4af6a4f18c783`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:15.623988 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-832509cb-e5d2-4280-a41f-1e15314eb9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:15.689495 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1022/2071] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:15.700168 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8dbb94-2bc8-4c23-a271-c9aec9691a96 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:15.702636 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-bc8dbb94-2bc8-4c23-a271-c9aec9691a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:15.763004 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8dbb94-2bc8-4c23-a271-c9aec9691a96 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:15.767424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f266c-b074-40ca-af27-a21ed8fa8230 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:15.768004 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f266c-b074-40ca-af27-a21ed8fa8230 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:15.768281 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f266c-b074-40ca-af27-a21ed8fa8230 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:15.768561 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f266c-b074-40ca-af27-a21ed8fa8230 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:15.776964 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f266c-b074-40ca-af27-a21ed8fa8230 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:15.778378 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f266c-b074-40ca-af27-a21ed8fa8230 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:15.787524 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1050/2072] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:00:15.973745 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832509cb-e5d2-4280-a41f-1e15314eb9ec None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:15.975246 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-832509cb-e5d2-4280-a41f-1e15314eb9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:15.990074 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832509cb-e5d2-4280-a41f-1e15314eb9ec None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:15.996416 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c374a-988b-43b6-8986-a312ec132234 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:15.997466 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c374a-988b-43b6-8986-a312ec132234 service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:15.999477 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c374a-988b-43b6-8986-a312ec132234 service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:15.999809 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c374a-988b-43b6-8986-a312ec132234 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:16.001890 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-884c374a-988b-43b6-8986-a312ec132234 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:16.098787 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c374a-988b-43b6-8986-a312ec132234 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:16.099090 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c374a-988b-43b6-8986-a312ec132234 service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:16.110141 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1023/2073] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:15 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:00:16.829168 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f266c-b074-40ca-af27-a21ed8fa8230 service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:16.830619 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-000f266c-b074-40ca-af27-a21ed8fa8230 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:16.898559 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f266c-b074-40ca-af27-a21ed8fa8230 service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:16.903218 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2c6c4-6e9c-4928-80ba-f9bff0bd8cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:16.904685 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2c6c4-6e9c-4928-80ba-f9bff0bd8cfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:16.905184 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2c6c4-6e9c-4928-80ba-f9bff0bd8cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:16.905658 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2c6c4-6e9c-4928-80ba-f9bff0bd8cfd admin admin] PATH_INFO: `/v3/users/d9ff58e414254db0826b86de0e201ef0` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:16.906981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2c6c4-6e9c-4928-80ba-f9bff0bd8cfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9ff58e414254db0826b86de0e201ef0)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:16.908955 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2c6c4-6e9c-4928-80ba-f9bff0bd8cfd admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:16.914595 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:16.962197 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-84b2c6c4-6e9c-4928-80ba-f9bff0bd8cfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9ff58e414254db0826b86de0e201ef0'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:16.962872 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-84b2c6c4-6e9c-4928-80ba-f9bff0bd8cfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9ff58e414254db0826b86de0e201ef0'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:16.971691 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-84b2c6c4-6e9c-4928-80ba-f9bff0bd8cfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9ff58e414254db0826b86de0e201ef0'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:16.985235 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-84b2c6c4-6e9c-4928-80ba-f9bff0bd8cfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9ff58e414254db0826b86de0e201ef0'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:16.992773 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-84b2c6c4-6e9c-4928-80ba-f9bff0bd8cfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9ff58e414254db0826b86de0e201ef0'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:17.000547 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1051/2074] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:00:16 2022] DELETE /identity/v3/users/d9ff58e414254db0826b86de0e201ef0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:17.004849 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80f292-62cd-42f1-8298-1ce8fb08acd4 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:17.005376 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80f292-62cd-42f1-8298-1ce8fb08acd4 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:17.005503 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80f292-62cd-42f1-8298-1ce8fb08acd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:17.025348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-5b80f292-62cd-42f1-8298-1ce8fb08acd4 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:17.026589 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-5b80f292-62cd-42f1-8298-1ce8fb08acd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:17.052087 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:17.091149 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1024/2075] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:17.101988 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2c6c4-6e9c-4928-80ba-f9bff0bd8cfd admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:17.103472 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-84b2c6c4-6e9c-4928-80ba-f9bff0bd8cfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:17.176406 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2c6c4-6e9c-4928-80ba-f9bff0bd8cfd admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:17.182283 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8177340b-bf9b-4a26-a166-c695fb404311 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:17.186312 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177340b-bf9b-4a26-a166-c695fb404311 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:17.186664 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177340b-bf9b-4a26-a166-c695fb404311 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:17.186974 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177340b-bf9b-4a26-a166-c695fb404311 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:17.200140 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8177340b-bf9b-4a26-a166-c695fb404311 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:17.202760 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8177340b-bf9b-4a26-a166-c695fb404311 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:17.214114 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1052/2076] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:00:17.593383 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80f292-62cd-42f1-8298-1ce8fb08acd4 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:17.596007 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-5b80f292-62cd-42f1-8298-1ce8fb08acd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:17.629235 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80f292-62cd-42f1-8298-1ce8fb08acd4 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:17.638927 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197235f0-a77b-4bac-ac59-d1e2f9e95e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:17.640043 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197235f0-a77b-4bac-ac59-d1e2f9e95e18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:17.640331 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197235f0-a77b-4bac-ac59-d1e2f9e95e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:17.640607 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197235f0-a77b-4bac-ac59-d1e2f9e95e18 admin admin] PATH_INFO: `/v3/projects/7692db5f23a347a793193f1c2acdabe1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:17.641870 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197235f0-a77b-4bac-ac59-d1e2f9e95e18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7692db5f23a347a793193f1c2acdabe1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:17.644515 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197235f0-a77b-4bac-ac59-d1e2f9e95e18 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:17.711634 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-197235f0-a77b-4bac-ac59-d1e2f9e95e18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7692db5f23a347a793193f1c2acdabe1', 'request_id': 'req-197235f0-a77b-4bac-ac59-d1e2f9e95e18'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:17.717960 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-197235f0-a77b-4bac-ac59-d1e2f9e95e18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7692db5f23a347a793193f1c2acdabe1', 'request_id': 'req-197235f0-a77b-4bac-ac59-d1e2f9e95e18'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:17.739984 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-197235f0-a77b-4bac-ac59-d1e2f9e95e18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7692db5f23a347a793193f1c2acdabe1', 'request_id': 'req-197235f0-a77b-4bac-ac59-d1e2f9e95e18'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:17.754155 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-197235f0-a77b-4bac-ac59-d1e2f9e95e18 admin admin] The token cache is being invalidate because project 7692db5f23a347a793193f1c2acdabe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:00:17.754472 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-197235f0-a77b-4bac-ac59-d1e2f9e95e18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:17.755325 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-197235f0-a77b-4bac-ac59-d1e2f9e95e18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:17.757083 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1025/2077] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:00:17 2022] DELETE /identity/v3/projects/7692db5f23a347a793193f1c2acdabe1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:17.761842 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8177340b-bf9b-4a26-a166-c695fb404311 service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:17.773906 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8177340b-bf9b-4a26-a166-c695fb404311 service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:17.848456 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27c8a0-0c7e-4aeb-96dd-eecc6bee647f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:17.851482 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27c8a0-0c7e-4aeb-96dd-eecc6bee647f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:17.851869 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27c8a0-0c7e-4aeb-96dd-eecc6bee647f admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:17.852353 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27c8a0-0c7e-4aeb-96dd-eecc6bee647f admin admin] PATH_INFO: `/v3/users/10bcc15d9d8448dab02ed36b51590dff` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:17.858041 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a27c8a0-0c7e-4aeb-96dd-eecc6bee647f admin admin] RBAC: Authorizing `identity:delete_user(user_id=10bcc15d9d8448dab02ed36b51590dff)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:17.860899 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a27c8a0-0c7e-4aeb-96dd-eecc6bee647f admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:17.919256 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:17.944135 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-5a27c8a0-0c7e-4aeb-96dd-eecc6bee647f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10bcc15d9d8448dab02ed36b51590dff'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:17.944719 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-5a27c8a0-0c7e-4aeb-96dd-eecc6bee647f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10bcc15d9d8448dab02ed36b51590dff'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:17.954665 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-5a27c8a0-0c7e-4aeb-96dd-eecc6bee647f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10bcc15d9d8448dab02ed36b51590dff'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:17.969720 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-5a27c8a0-0c7e-4aeb-96dd-eecc6bee647f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10bcc15d9d8448dab02ed36b51590dff'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:17.981702 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-5a27c8a0-0c7e-4aeb-96dd-eecc6bee647f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10bcc15d9d8448dab02ed36b51590dff'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:17.989426 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1053/2078] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:00:17 2022] DELETE /identity/v3/users/10bcc15d9d8448dab02ed36b51590dff => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:18.299051 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197235f0-a77b-4bac-ac59-d1e2f9e95e18 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:18.301443 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-197235f0-a77b-4bac-ac59-d1e2f9e95e18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:18.319290 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197235f0-a77b-4bac-ac59-d1e2f9e95e18 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:18.387942 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670499d-1711-4f4b-bd36-9420233d6b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:18.388887 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670499d-1711-4f4b-bd36-9420233d6b83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:18.389158 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670499d-1711-4f4b-bd36-9420233d6b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:18.389556 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670499d-1711-4f4b-bd36-9420233d6b83 admin admin] PATH_INFO: `/v3/projects/c37ee0e3074a401fa16bbf8f52ceb603` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:18.390722 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670499d-1711-4f4b-bd36-9420233d6b83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c37ee0e3074a401fa16bbf8f52ceb603)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:18.392832 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670499d-1711-4f4b-bd36-9420233d6b83 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:18.448686 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-7670499d-1711-4f4b-bd36-9420233d6b83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c37ee0e3074a401fa16bbf8f52ceb603', 'request_id': 'req-7670499d-1711-4f4b-bd36-9420233d6b83'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:18.452995 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:18.456817 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-7670499d-1711-4f4b-bd36-9420233d6b83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c37ee0e3074a401fa16bbf8f52ceb603', 'request_id': 'req-7670499d-1711-4f4b-bd36-9420233d6b83'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:18.478728 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-7670499d-1711-4f4b-bd36-9420233d6b83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c37ee0e3074a401fa16bbf8f52ceb603', 'request_id': 'req-7670499d-1711-4f4b-bd36-9420233d6b83'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:18.494268 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-7670499d-1711-4f4b-bd36-9420233d6b83 admin admin] The token cache is being invalidate because project c37ee0e3074a401fa16bbf8f52ceb603 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:00:18.494567 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-7670499d-1711-4f4b-bd36-9420233d6b83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:18.495280 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-7670499d-1711-4f4b-bd36-9420233d6b83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:18.496962 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1026/2079] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:00:18 2022] DELETE /identity/v3/projects/c37ee0e3074a401fa16bbf8f52ceb603 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:18.502248 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81e12e-842f-4971-a625-d6ec5d056838 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:18.502543 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81e12e-842f-4971-a625-d6ec5d056838 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:18.502825 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81e12e-842f-4971-a625-d6ec5d056838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:18.525814 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-2b81e12e-842f-4971-a625-d6ec5d056838 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:18.527177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-2b81e12e-842f-4971-a625-d6ec5d056838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:18.603323 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1054/2080] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:18.612332 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0410f-242b-438c-bd88-e6aa89f8f7a8 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:18.613041 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0410f-242b-438c-bd88-e6aa89f8f7a8 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:18.613552 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0410f-242b-438c-bd88-e6aa89f8f7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:18.641650 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-d7c0410f-242b-438c-bd88-e6aa89f8f7a8 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:18.642865 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-d7c0410f-242b-438c-bd88-e6aa89f8f7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:18.656397 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1027/2081] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:00:18.662242 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81e12e-842f-4971-a625-d6ec5d056838 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:18.679730 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81e12e-842f-4971-a625-d6ec5d056838 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:18.685786 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c697de-6e39-4177-8314-a7cbfda8eeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:18.685937 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c697de-6e39-4177-8314-a7cbfda8eeb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:18.686592 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c697de-6e39-4177-8314-a7cbfda8eeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:18.686874 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c697de-6e39-4177-8314-a7cbfda8eeb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:18.687585 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c697de-6e39-4177-8314-a7cbfda8eeb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:00:18.687892 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c697de-6e39-4177-8314-a7cbfda8eeb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:18.689533 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c697de-6e39-4177-8314-a7cbfda8eeb6 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:18.706592 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1055/2082] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 16:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:00:18.711132 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0410f-242b-438c-bd88-e6aa89f8f7a8 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:18.724900 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0410f-242b-438c-bd88-e6aa89f8f7a8 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:18.736604 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cc747-f223-4154-b71c-4961e097eabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:18.737390 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cc747-f223-4154-b71c-4961e097eabd admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:18.737668 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cc747-f223-4154-b71c-4961e097eabd admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:18.737937 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cc747-f223-4154-b71c-4961e097eabd admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:18.740983 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cc747-f223-4154-b71c-4961e097eabd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:18.743022 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cc747-f223-4154-b71c-4961e097eabd admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:18.811755 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1028/2083] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:00:18 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:00:18.812503 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c697de-6e39-4177-8314-a7cbfda8eeb6 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:18.823392 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c697de-6e39-4177-8314-a7cbfda8eeb6 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:18.896977 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaccdc47-4e42-46ff-ae6e-dec0e31e734c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:18.898250 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccdc47-4e42-46ff-ae6e-dec0e31e734c admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:18.898606 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccdc47-4e42-46ff-ae6e-dec0e31e734c admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:18.899106 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccdc47-4e42-46ff-ae6e-dec0e31e734c admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:18.900892 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaccdc47-4e42-46ff-ae6e-dec0e31e734c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:18.903276 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaccdc47-4e42-46ff-ae6e-dec0e31e734c admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:18.930409 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1056/2084] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:00:18 2022] POST /identity/v3/users => generated 290 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:00:18.937294 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cc747-f223-4154-b71c-4961e097eabd admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:18.951977 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cc747-f223-4154-b71c-4961e097eabd admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:18.957630 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f89e3-67af-40bf-816a-0433fef4af4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:18.959702 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f89e3-67af-40bf-816a-0433fef4af4a admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:18.959980 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f89e3-67af-40bf-816a-0433fef4af4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:18.960251 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f89e3-67af-40bf-816a-0433fef4af4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:18.960956 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f89e3-67af-40bf-816a-0433fef4af4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:18.962666 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f89e3-67af-40bf-816a-0433fef4af4a admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:18.975683 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1029/2085] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:18.979978 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaccdc47-4e42-46ff-ae6e-dec0e31e734c admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:18.991656 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaccdc47-4e42-46ff-ae6e-dec0e31e734c admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:18.996613 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464736fd-3997-409b-ad4e-a6a5572678ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:18.997275 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464736fd-3997-409b-ad4e-a6a5572678ad admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:18.997759 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464736fd-3997-409b-ad4e-a6a5572678ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:18.998035 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464736fd-3997-409b-ad4e-a6a5572678ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:18.998817 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464736fd-3997-409b-ad4e-a6a5572678ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:19.000452 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464736fd-3997-409b-ad4e-a6a5572678ad admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:19.022447 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1057/2086] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:00:19.026591 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f89e3-67af-40bf-816a-0433fef4af4a admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:19.038957 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f89e3-67af-40bf-816a-0433fef4af4a admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:19.046170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedcc64-0387-4ed1-8e46-4f453d5b4e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:19.047109 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedcc64-0387-4ed1-8e46-4f453d5b4e59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:19.047258 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedcc64-0387-4ed1-8e46-4f453d5b4e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:19.047575 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedcc64-0387-4ed1-8e46-4f453d5b4e59 admin admin] PATH_INFO: `/v3/projects/f36146b53e784779a1c617c562cf97b3/users/4205ea6e798d4c51b391042a02cf6430/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:19.071320 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baedcc64-0387-4ed1-8e46-4f453d5b4e59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f36146b53e784779a1c617c562cf97b3, user_id=4205ea6e798d4c51b391042a02cf6430, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:19.080517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baedcc64-0387-4ed1-8e46-4f453d5b4e59 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:19.115666 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1030/2087] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:00:19 2022] PUT /identity/v3/projects/f36146b53e784779a1c617c562cf97b3/users/4205ea6e798d4c51b391042a02cf6430/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:00:19.117127 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64105625-62b0-4e22-a178-622381783590 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:19.117481 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64105625-62b0-4e22-a178-622381783590 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:19.117847 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64105625-62b0-4e22-a178-622381783590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:19.164574 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:19.169190 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-64105625-62b0-4e22-a178-622381783590 None None] MFA Rules not processed for user `4205ea6e798d4c51b391042a02cf6430`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:19.170692 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-64105625-62b0-4e22-a178-622381783590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:19.302753 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedcc64-0387-4ed1-8e46-4f453d5b4e59 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:19.303249 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1058/2088] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:00:19.401229 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedcc64-0387-4ed1-8e46-4f453d5b4e59 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:19.406714 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386c5ef-da0c-4479-b5c7-365f889d9a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:19.407343 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386c5ef-da0c-4479-b5c7-365f889d9a97 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:19.407623 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386c5ef-da0c-4479-b5c7-365f889d9a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:19.407896 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386c5ef-da0c-4479-b5c7-365f889d9a97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:19.408839 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386c5ef-da0c-4479-b5c7-365f889d9a97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:19.410837 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386c5ef-da0c-4479-b5c7-365f889d9a97 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:19.446959 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1031/2089] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:00:19 2022] POST /identity/v3/projects => generated 377 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:19.448185 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64105625-62b0-4e22-a178-622381783590 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:19.461480 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64105625-62b0-4e22-a178-622381783590 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:19.546333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec7ef2-d26e-4627-b3a3-60e23d76b286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:19.547022 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec7ef2-d26e-4627-b3a3-60e23d76b286 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:19.547305 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec7ef2-d26e-4627-b3a3-60e23d76b286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:19.547584 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec7ef2-d26e-4627-b3a3-60e23d76b286 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:19.548244 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec7ef2-d26e-4627-b3a3-60e23d76b286 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:19.550372 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec7ef2-d26e-4627-b3a3-60e23d76b286 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:19.583704 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1059/2090] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:00:19 2022] POST /identity/v3/users => generated 289 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:00:19.587962 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386c5ef-da0c-4479-b5c7-365f889d9a97 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:19.608546 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386c5ef-da0c-4479-b5c7-365f889d9a97 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:19.617288 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694bd6f-b2be-40ff-a006-360f88463b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:19.617915 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694bd6f-b2be-40ff-a006-360f88463b99 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:19.618598 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694bd6f-b2be-40ff-a006-360f88463b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:19.618869 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694bd6f-b2be-40ff-a006-360f88463b99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:19.619665 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d694bd6f-b2be-40ff-a006-360f88463b99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:19.621531 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d694bd6f-b2be-40ff-a006-360f88463b99 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:19.642192 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1032/2091] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:19.643760 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec7ef2-d26e-4627-b3a3-60e23d76b286 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:19.661858 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec7ef2-d26e-4627-b3a3-60e23d76b286 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:19.676374 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c094ea1-1c1c-4e9f-85bc-65c7a2b73ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:19.677044 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c094ea1-1c1c-4e9f-85bc-65c7a2b73ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:19.677372 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c094ea1-1c1c-4e9f-85bc-65c7a2b73ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:19.677652 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c094ea1-1c1c-4e9f-85bc-65c7a2b73ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:19.678487 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c094ea1-1c1c-4e9f-85bc-65c7a2b73ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:19.681020 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c094ea1-1c1c-4e9f-85bc-65c7a2b73ef1 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:19.698518 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1060/2092] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:19.700609 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694bd6f-b2be-40ff-a006-360f88463b99 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:19.729345 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694bd6f-b2be-40ff-a006-360f88463b99 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:19.738053 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378005ab-8a32-403d-8c06-6c0ed51f17be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:19.738731 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378005ab-8a32-403d-8c06-6c0ed51f17be admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:19.739013 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378005ab-8a32-403d-8c06-6c0ed51f17be admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:19.739288 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378005ab-8a32-403d-8c06-6c0ed51f17be admin admin] PATH_INFO: `/v3/projects/48dacf3a85fe4d7095715b17bf12350d/users/e86eb6764ca844458283cce7097060b1/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:19.756906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378005ab-8a32-403d-8c06-6c0ed51f17be admin admin] RBAC: Authorizing `identity:create_grant(project_id=48dacf3a85fe4d7095715b17bf12350d, user_id=e86eb6764ca844458283cce7097060b1, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:19.760599 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378005ab-8a32-403d-8c06-6c0ed51f17be admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:19.777415 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1033/2093] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:00:19 2022] PUT /identity/v3/projects/48dacf3a85fe4d7095715b17bf12350d/users/e86eb6764ca844458283cce7097060b1/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:19.788298 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ccc35-e9dd-4d1a-8a10-db272b6c4a83 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:19.788626 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ccc35-e9dd-4d1a-8a10-db272b6c4a83 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:19.789733 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ccc35-e9dd-4d1a-8a10-db272b6c4a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:19.821855 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-df8ccc35-e9dd-4d1a-8a10-db272b6c4a83 None None] MFA Rules not processed for user `e86eb6764ca844458283cce7097060b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:19.823093 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-df8ccc35-e9dd-4d1a-8a10-db272b6c4a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:19.891814 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1061/2094] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:19.896677 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378005ab-8a32-403d-8c06-6c0ed51f17be admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:19.937123 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:DELETE=2,keystone:SELECT=93,keystone:INSERT=5 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:19.970986 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378005ab-8a32-403d-8c06-6c0ed51f17be admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:19.975594 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3a35a-5769-4571-adae-1357a402b070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:19.976201 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3a35a-5769-4571-adae-1357a402b070 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:19.976479 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3a35a-5769-4571-adae-1357a402b070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:19.976749 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3a35a-5769-4571-adae-1357a402b070 admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:19.977413 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c3a35a-5769-4571-adae-1357a402b070 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:19.979308 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c3a35a-5769-4571-adae-1357a402b070 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:20.006369 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1034/2095] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:00:19 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:00:20.010704 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ccc35-e9dd-4d1a-8a10-db272b6c4a83 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:20.023136 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ccc35-e9dd-4d1a-8a10-db272b6c4a83 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:20.031468 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:20.081362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946f00c-fcfb-44ff-8a9a-36f6b7468c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:20.081978 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946f00c-fcfb-44ff-8a9a-36f6b7468c1e admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:20.082257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946f00c-fcfb-44ff-8a9a-36f6b7468c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:20.082532 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946f00c-fcfb-44ff-8a9a-36f6b7468c1e admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:20.083176 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a946f00c-fcfb-44ff-8a9a-36f6b7468c1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:20.085120 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a946f00c-fcfb-44ff-8a9a-36f6b7468c1e admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:20.111272 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1062/2096] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:00:20 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:00:20.112914 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3a35a-5769-4571-adae-1357a402b070 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:20.124105 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3a35a-5769-4571-adae-1357a402b070 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:20.136052 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b79cd9-52ce-431e-90df-f7851ccead4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:20.136760 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b79cd9-52ce-431e-90df-f7851ccead4f admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:20.137073 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b79cd9-52ce-431e-90df-f7851ccead4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:20.137529 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b79cd9-52ce-431e-90df-f7851ccead4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:20.138767 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b79cd9-52ce-431e-90df-f7851ccead4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:20.141934 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b79cd9-52ce-431e-90df-f7851ccead4f admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:20.159607 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1035/2097] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:20.161885 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946f00c-fcfb-44ff-8a9a-36f6b7468c1e admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:20.172984 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946f00c-fcfb-44ff-8a9a-36f6b7468c1e admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:20.181323 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741759ed-dea1-4298-b135-d067bc8f21fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:20.182314 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741759ed-dea1-4298-b135-d067bc8f21fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:20.182606 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741759ed-dea1-4298-b135-d067bc8f21fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:20.182883 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741759ed-dea1-4298-b135-d067bc8f21fc admin admin] PATH_INFO: `/v3/projects/697dccacaa174167be28d649a6e2710a/users/cedcb2bfee184a7a82b6f50a25cbbd57/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:20.204096 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741759ed-dea1-4298-b135-d067bc8f21fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=697dccacaa174167be28d649a6e2710a, user_id=cedcb2bfee184a7a82b6f50a25cbbd57, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:20.207017 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741759ed-dea1-4298-b135-d067bc8f21fc admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:20.232839 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1063/2098] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:00:20 2022] PUT /identity/v3/projects/697dccacaa174167be28d649a6e2710a/users/cedcb2bfee184a7a82b6f50a25cbbd57/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:20.236407 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b79cd9-52ce-431e-90df-f7851ccead4f admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:20.248525 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b79cd9-52ce-431e-90df-f7851ccead4f admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:20.339355 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c1dab-769d-4431-bb80-396e9aa5ba8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:20.340058 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c1dab-769d-4431-bb80-396e9aa5ba8e admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:20.340311 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c1dab-769d-4431-bb80-396e9aa5ba8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:20.340705 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c1dab-769d-4431-bb80-396e9aa5ba8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:20.342064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c1dab-769d-4431-bb80-396e9aa5ba8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:20.343956 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c1dab-769d-4431-bb80-396e9aa5ba8e admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:20.360969 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1036/2099] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:20.362651 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741759ed-dea1-4298-b135-d067bc8f21fc admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:20.375795 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741759ed-dea1-4298-b135-d067bc8f21fc admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:20.381731 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb5e1f-04a8-4e30-bad6-aa6bec283066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:20.382431 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb5e1f-04a8-4e30-bad6-aa6bec283066 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:20.382708 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb5e1f-04a8-4e30-bad6-aa6bec283066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:20.383015 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb5e1f-04a8-4e30-bad6-aa6bec283066 admin admin] PATH_INFO: `/v3/projects/697dccacaa174167be28d649a6e2710a/users/cedcb2bfee184a7a82b6f50a25cbbd57/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:20.397174 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb5e1f-04a8-4e30-bad6-aa6bec283066 admin admin] RBAC: Authorizing `identity:create_grant(project_id=697dccacaa174167be28d649a6e2710a, user_id=cedcb2bfee184a7a82b6f50a25cbbd57, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:20.402437 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb5e1f-04a8-4e30-bad6-aa6bec283066 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:20.444913 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1064/2100] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:00:20 2022] PUT /identity/v3/projects/697dccacaa174167be28d649a6e2710a/users/cedcb2bfee184a7a82b6f50a25cbbd57/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:20.458700 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0ccbe-83e8-4972-afaf-4a417c68f04b None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:20.459203 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0ccbe-83e8-4972-afaf-4a417c68f04b None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:20.459421 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0ccbe-83e8-4972-afaf-4a417c68f04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:20.496642 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-d7e0ccbe-83e8-4972-afaf-4a417c68f04b None None] MFA Rules not processed for user `cedcb2bfee184a7a82b6f50a25cbbd57`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:20.498439 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-d7e0ccbe-83e8-4972-afaf-4a417c68f04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:20.621724 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1037/2101] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:20 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:20.633985 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb5e1f-04a8-4e30-bad6-aa6bec283066 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:20.636315 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-bddb5e1f-04a8-4e30-bad6-aa6bec283066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:20.712988 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb5e1f-04a8-4e30-bad6-aa6bec283066 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:20.722201 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d5c93-f2f1-44d3-98d1-373cfe11ac19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:20.723203 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d5c93-f2f1-44d3-98d1-373cfe11ac19 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:20.723721 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d5c93-f2f1-44d3-98d1-373cfe11ac19 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:20.724333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d5c93-f2f1-44d3-98d1-373cfe11ac19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:20.736922 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d5c93-f2f1-44d3-98d1-373cfe11ac19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:20.738971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d5c93-f2f1-44d3-98d1-373cfe11ac19 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:20.752262 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1065/2102] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:20 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:00:20.826004 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0ccbe-83e8-4972-afaf-4a417c68f04b None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:20.843535 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0ccbe-83e8-4972-afaf-4a417c68f04b None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:20.848304 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ccc641-2df6-429f-bd2e-51ea29fe4d8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:20.849350 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ccc641-2df6-429f-bd2e-51ea29fe4d8d service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:20.850049 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ccc641-2df6-429f-bd2e-51ea29fe4d8d service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:20.850049 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ccc641-2df6-429f-bd2e-51ea29fe4d8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:20.893311 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:20.940976 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ccc641-2df6-429f-bd2e-51ea29fe4d8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:20.943182 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ccc641-2df6-429f-bd2e-51ea29fe4d8d service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:20.956609 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1038/2103] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:00:21.396639 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d5c93-f2f1-44d3-98d1-373cfe11ac19 service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:21.398116 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-f19d5c93-f2f1-44d3-98d1-373cfe11ac19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:21.478555 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d5c93-f2f1-44d3-98d1-373cfe11ac19 service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:21.484175 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f55f5-af54-417b-ad84-c663af93d7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:21.485024 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f55f5-af54-417b-ad84-c663af93d7a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:21.485456 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f55f5-af54-417b-ad84-c663af93d7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:21.485859 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f55f5-af54-417b-ad84-c663af93d7a9 admin admin] PATH_INFO: `/v3/users/a7191d35b7544b85aa99fe379407e92a` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:21.487157 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f55f5-af54-417b-ad84-c663af93d7a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7191d35b7544b85aa99fe379407e92a)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:21.489432 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f55f5-af54-417b-ad84-c663af93d7a9 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:21.495173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:21.541423 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2f9f55f5-af54-417b-ad84-c663af93d7a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7191d35b7544b85aa99fe379407e92a'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:21.542140 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2f9f55f5-af54-417b-ad84-c663af93d7a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7191d35b7544b85aa99fe379407e92a'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:21.550768 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2f9f55f5-af54-417b-ad84-c663af93d7a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7191d35b7544b85aa99fe379407e92a'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:21.563506 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2f9f55f5-af54-417b-ad84-c663af93d7a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7191d35b7544b85aa99fe379407e92a'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:21.572812 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2f9f55f5-af54-417b-ad84-c663af93d7a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7191d35b7544b85aa99fe379407e92a'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:21.582124 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1066/2104] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:00:21 2022] DELETE /identity/v3/users/a7191d35b7544b85aa99fe379407e92a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:21.583886 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329028fe-5d01-4f09-a5f0-098d5caeaa9e None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:21.584306 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329028fe-5d01-4f09-a5f0-098d5caeaa9e None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:21.584465 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329028fe-5d01-4f09-a5f0-098d5caeaa9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:21.640764 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-329028fe-5d01-4f09-a5f0-098d5caeaa9e None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:21.642007 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-329028fe-5d01-4f09-a5f0-098d5caeaa9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:21.662678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f55f5-af54-417b-ad84-c663af93d7a9 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:21.664131 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-2f9f55f5-af54-417b-ad84-c663af93d7a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:21.781524 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f55f5-af54-417b-ad84-c663af93d7a9 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:21.788049 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d03f63-b355-4d45-9ea0-05d65ae9b09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:21.789217 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d03f63-b355-4d45-9ea0-05d65ae9b09b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:21.789501 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d03f63-b355-4d45-9ea0-05d65ae9b09b admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:21.789805 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d03f63-b355-4d45-9ea0-05d65ae9b09b admin admin] PATH_INFO: `/v3/users/827c04f0810141ce83d4af6a4f18c783` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:21.791561 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d03f63-b355-4d45-9ea0-05d65ae9b09b admin admin] RBAC: Authorizing `identity:delete_user(user_id=827c04f0810141ce83d4af6a4f18c783)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:21.794029 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d03f63-b355-4d45-9ea0-05d65ae9b09b admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:21.804085 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1039/2105] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:21.817101 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329028fe-5d01-4f09-a5f0-098d5caeaa9e None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:21.819151 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-329028fe-5d01-4f09-a5f0-098d5caeaa9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:21.855032 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a6d03f63-b355-4d45-9ea0-05d65ae9b09b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '827c04f0810141ce83d4af6a4f18c783'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:21.855751 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a6d03f63-b355-4d45-9ea0-05d65ae9b09b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '827c04f0810141ce83d4af6a4f18c783'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:21.868840 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a6d03f63-b355-4d45-9ea0-05d65ae9b09b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '827c04f0810141ce83d4af6a4f18c783'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:21.902598 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a6d03f63-b355-4d45-9ea0-05d65ae9b09b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '827c04f0810141ce83d4af6a4f18c783'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:21.904247 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329028fe-5d01-4f09-a5f0-098d5caeaa9e None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:21.909288 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b719af8-9f07-4f93-b532-ed6965f6d662 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:21.909958 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b719af8-9f07-4f93-b532-ed6965f6d662 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:21.910337 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b719af8-9f07-4f93-b532-ed6965f6d662 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:21.910723 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b719af8-9f07-4f93-b532-ed6965f6d662 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:21.914591 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-3b719af8-9f07-4f93-b532-ed6965f6d662 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:21.930324 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a6d03f63-b355-4d45-9ea0-05d65ae9b09b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '827c04f0810141ce83d4af6a4f18c783'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:21.932493 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b719af8-9f07-4f93-b532-ed6965f6d662 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:21.936326 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b719af8-9f07-4f93-b532-ed6965f6d662 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:21.941007 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1067/2106] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:00:21 2022] DELETE /identity/v3/users/827c04f0810141ce83d4af6a4f18c783 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:21.946553 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588a550-db28-4ad0-890a-3fde50fd5eaa None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:21.946859 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588a550-db28-4ad0-890a-3fde50fd5eaa None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:21.947313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588a550-db28-4ad0-890a-3fde50fd5eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:21.968092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:21.968744 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1040/2107] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:00:22.014552 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-4588a550-db28-4ad0-890a-3fde50fd5eaa None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:22.018207 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-4588a550-db28-4ad0-890a-3fde50fd5eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:22.160634 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1068/2108] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:00:22.248926 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b719af8-9f07-4f93-b532-ed6965f6d662 service neutron] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:22.250493 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-3b719af8-9f07-4f93-b532-ed6965f6d662 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:22.275019 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b719af8-9f07-4f93-b532-ed6965f6d662 service neutron] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:22.383080 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4112dc8-2a4e-401c-8e52-6943fae254b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:22.384071 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4112dc8-2a4e-401c-8e52-6943fae254b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:22.394896 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4112dc8-2a4e-401c-8e52-6943fae254b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:22.395358 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4112dc8-2a4e-401c-8e52-6943fae254b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:22.436871 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4112dc8-2a4e-401c-8e52-6943fae254b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:22.438459 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4112dc8-2a4e-401c-8e52-6943fae254b0 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:22.455401 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1041/2109] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:00:22.593044 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588a550-db28-4ad0-890a-3fde50fd5eaa None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:22.594309 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-4588a550-db28-4ad0-890a-3fde50fd5eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:22.615008 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588a550-db28-4ad0-890a-3fde50fd5eaa None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:22.621217 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6abf86-8914-40ad-86e0-290cc4b8b7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:22.622094 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6abf86-8914-40ad-86e0-290cc4b8b7c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:22.622431 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6abf86-8914-40ad-86e0-290cc4b8b7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:22.623065 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6abf86-8914-40ad-86e0-290cc4b8b7c3 admin admin] PATH_INFO: `/v3/projects/da8c2368ee4842ecb470b0c715c585a5` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:22.624309 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6abf86-8914-40ad-86e0-290cc4b8b7c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da8c2368ee4842ecb470b0c715c585a5)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:22.626308 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6abf86-8914-40ad-86e0-290cc4b8b7c3 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:22.693715 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2b6abf86-8914-40ad-86e0-290cc4b8b7c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da8c2368ee4842ecb470b0c715c585a5', 'request_id': 'req-2b6abf86-8914-40ad-86e0-290cc4b8b7c3'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:22.706572 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2b6abf86-8914-40ad-86e0-290cc4b8b7c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da8c2368ee4842ecb470b0c715c585a5', 'request_id': 'req-2b6abf86-8914-40ad-86e0-290cc4b8b7c3'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:22.713761 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2b6abf86-8914-40ad-86e0-290cc4b8b7c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da8c2368ee4842ecb470b0c715c585a5', 'request_id': 'req-2b6abf86-8914-40ad-86e0-290cc4b8b7c3'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:22.732468 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2b6abf86-8914-40ad-86e0-290cc4b8b7c3 admin admin] The token cache is being invalidate because project da8c2368ee4842ecb470b0c715c585a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:00:22.732767 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2b6abf86-8914-40ad-86e0-290cc4b8b7c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:22.733844 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2b6abf86-8914-40ad-86e0-290cc4b8b7c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:22.735753 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1069/2110] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:00:22 2022] DELETE /identity/v3/projects/da8c2368ee4842ecb470b0c715c585a5 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:22.746101 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4112dc8-2a4e-401c-8e52-6943fae254b0 service neutron] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:22.761099 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4112dc8-2a4e-401c-8e52-6943fae254b0 service neutron] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:22.771729 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:22.843441 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80496d1d-0038-4e7d-8671-eda621272682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:22.844198 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80496d1d-0038-4e7d-8671-eda621272682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:22.844563 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80496d1d-0038-4e7d-8671-eda621272682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:22.844936 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80496d1d-0038-4e7d-8671-eda621272682 admin admin] PATH_INFO: `/v3/users/b039bf4ffa5f4798aae869de5f5aaf1d` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:22.846149 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80496d1d-0038-4e7d-8671-eda621272682 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b039bf4ffa5f4798aae869de5f5aaf1d)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:22.848183 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80496d1d-0038-4e7d-8671-eda621272682 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:22.917531 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-80496d1d-0038-4e7d-8671-eda621272682 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b039bf4ffa5f4798aae869de5f5aaf1d'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:22.931580 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-80496d1d-0038-4e7d-8671-eda621272682 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b039bf4ffa5f4798aae869de5f5aaf1d'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:22.932534 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-80496d1d-0038-4e7d-8671-eda621272682 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b039bf4ffa5f4798aae869de5f5aaf1d'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:22.933394 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-80496d1d-0038-4e7d-8671-eda621272682 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b039bf4ffa5f4798aae869de5f5aaf1d'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:22.942002 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-80496d1d-0038-4e7d-8671-eda621272682 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b039bf4ffa5f4798aae869de5f5aaf1d'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:22.958546 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1042/2111] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:00:22 2022] DELETE /identity/v3/users/b039bf4ffa5f4798aae869de5f5aaf1d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:23.367187 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6abf86-8914-40ad-86e0-290cc4b8b7c3 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:23.370346 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-2b6abf86-8914-40ad-86e0-290cc4b8b7c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:23.392884 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80496d1d-0038-4e7d-8671-eda621272682 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:23.394707 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-80496d1d-0038-4e7d-8671-eda621272682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:23.400974 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6abf86-8914-40ad-86e0-290cc4b8b7c3 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:23.490553 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaac7db-dc47-4b0b-aa2c-54fef5215be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:23.491255 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaac7db-dc47-4b0b-aa2c-54fef5215be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:23.491668 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaac7db-dc47-4b0b-aa2c-54fef5215be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:23.491950 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaac7db-dc47-4b0b-aa2c-54fef5215be6 admin admin] PATH_INFO: `/v3/projects/0025ea952ba7409f88ce6100839ced76` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:23.493241 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaac7db-dc47-4b0b-aa2c-54fef5215be6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0025ea952ba7409f88ce6100839ced76)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:23.495450 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaac7db-dc47-4b0b-aa2c-54fef5215be6 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:23.526406 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80496d1d-0038-4e7d-8671-eda621272682 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:23.536021 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d4415-b581-46fb-a412-3b1f872072ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:23.536543 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d4415-b581-46fb-a412-3b1f872072ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:23.536841 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d4415-b581-46fb-a412-3b1f872072ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:23.537226 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d4415-b581-46fb-a412-3b1f872072ff admin admin] PATH_INFO: `/v3/users/07922cc9c51e434db741e966a34f767c` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:23.538593 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:23.539418 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d4415-b581-46fb-a412-3b1f872072ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=07922cc9c51e434db741e966a34f767c)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:23.542878 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d4415-b581-46fb-a412-3b1f872072ff admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:23.559187 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-8eaac7db-dc47-4b0b-aa2c-54fef5215be6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0025ea952ba7409f88ce6100839ced76', 'request_id': 'req-8eaac7db-dc47-4b0b-aa2c-54fef5215be6'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:23.571085 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-8eaac7db-dc47-4b0b-aa2c-54fef5215be6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0025ea952ba7409f88ce6100839ced76', 'request_id': 'req-8eaac7db-dc47-4b0b-aa2c-54fef5215be6'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:23.579187 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-8eaac7db-dc47-4b0b-aa2c-54fef5215be6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0025ea952ba7409f88ce6100839ced76', 'request_id': 'req-8eaac7db-dc47-4b0b-aa2c-54fef5215be6'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:23.596773 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-8eaac7db-dc47-4b0b-aa2c-54fef5215be6 admin admin] The token cache is being invalidate because project 0025ea952ba7409f88ce6100839ced76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:00:23.597625 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:23.598174 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-8eaac7db-dc47-4b0b-aa2c-54fef5215be6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:23.599062 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-8eaac7db-dc47-4b0b-aa2c-54fef5215be6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:23.601047 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1070/2112] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:00:23 2022] DELETE /identity/v3/projects/0025ea952ba7409f88ce6100839ced76 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:23.601987 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaac7db-dc47-4b0b-aa2c-54fef5215be6 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:23.605579 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-8eaac7db-dc47-4b0b-aa2c-54fef5215be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:23.628213 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-e09d4415-b581-46fb-a412-3b1f872072ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07922cc9c51e434db741e966a34f767c'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:23.653319 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-e09d4415-b581-46fb-a412-3b1f872072ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07922cc9c51e434db741e966a34f767c'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:23.654773 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-e09d4415-b581-46fb-a412-3b1f872072ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07922cc9c51e434db741e966a34f767c'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:23.655662 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-e09d4415-b581-46fb-a412-3b1f872072ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07922cc9c51e434db741e966a34f767c'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:23.671607 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-e09d4415-b581-46fb-a412-3b1f872072ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07922cc9c51e434db741e966a34f767c'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:23.692380 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1043/2113] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:00:23 2022] DELETE /identity/v3/users/07922cc9c51e434db741e966a34f767c => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:00:23.697414 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cd50f-5546-400f-abce-85a6c10b11f1 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:23.697802 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cd50f-5546-400f-abce-85a6c10b11f1 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:23.698440 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cd50f-5546-400f-abce-85a6c10b11f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:23.708058 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaac7db-dc47-4b0b-aa2c-54fef5215be6 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:23.729519 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-a39cd50f-5546-400f-abce-85a6c10b11f1 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:23.731316 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-a39cd50f-5546-400f-abce-85a6c10b11f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:23.798396 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd23d3-5c44-4b4c-a7cf-a8d5c53e8841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:23.799032 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd23d3-5c44-4b4c-a7cf-a8d5c53e8841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:23.799720 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd23d3-5c44-4b4c-a7cf-a8d5c53e8841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:23.799720 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd23d3-5c44-4b4c-a7cf-a8d5c53e8841 admin admin] PATH_INFO: `/v3/projects/de77a86877f943a19c6c1bd72a77d9f2` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:23.800693 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd23d3-5c44-4b4c-a7cf-a8d5c53e8841 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de77a86877f943a19c6c1bd72a77d9f2)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:23.802844 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd23d3-5c44-4b4c-a7cf-a8d5c53e8841 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:23.824085 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1044/2114] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:23.824085 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39cd50f-5546-400f-abce-85a6c10b11f1 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:23.824085 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-a39cd50f-5546-400f-abce-85a6c10b11f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:23.834817 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39cd50f-5546-400f-abce-85a6c10b11f1 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:23.840410 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c853430-5634-4d3f-af59-76807addc4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:23.841313 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c853430-5634-4d3f-af59-76807addc4de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:23.842005 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c853430-5634-4d3f-af59-76807addc4de admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:23.842005 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c853430-5634-4d3f-af59-76807addc4de admin admin] PATH_INFO: `/v3/users/da9f3be19b6b404ebe071680fbce164f` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:23.843225 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c853430-5634-4d3f-af59-76807addc4de admin admin] RBAC: Authorizing `identity:delete_user(user_id=da9f3be19b6b404ebe071680fbce164f)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:23.845215 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c853430-5634-4d3f-af59-76807addc4de admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:23.882229 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-bdfd23d3-5c44-4b4c-a7cf-a8d5c53e8841 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de77a86877f943a19c6c1bd72a77d9f2', 'request_id': 'req-bdfd23d3-5c44-4b4c-a7cf-a8d5c53e8841'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:23.892821 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-bdfd23d3-5c44-4b4c-a7cf-a8d5c53e8841 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de77a86877f943a19c6c1bd72a77d9f2', 'request_id': 'req-bdfd23d3-5c44-4b4c-a7cf-a8d5c53e8841'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:23.901471 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-bdfd23d3-5c44-4b4c-a7cf-a8d5c53e8841 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de77a86877f943a19c6c1bd72a77d9f2', 'request_id': 'req-bdfd23d3-5c44-4b4c-a7cf-a8d5c53e8841'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:23.909004 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:23.924291 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-bdfd23d3-5c44-4b4c-a7cf-a8d5c53e8841 admin admin] The token cache is being invalidate because project de77a86877f943a19c6c1bd72a77d9f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:00:23.927144 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-bdfd23d3-5c44-4b4c-a7cf-a8d5c53e8841 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:23.933491 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-bdfd23d3-5c44-4b4c-a7cf-a8d5c53e8841 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:23.937186 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1071/2115] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:00:23 2022] DELETE /identity/v3/projects/de77a86877f943a19c6c1bd72a77d9f2 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:23.938559 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99fbec-a662-4ee2-aa98-c818b02ee78d None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:23.938843 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99fbec-a662-4ee2-aa98-c818b02ee78d None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:23.939291 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99fbec-a662-4ee2-aa98-c818b02ee78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:23.939477 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-5c853430-5634-4d3f-af59-76807addc4de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da9f3be19b6b404ebe071680fbce164f'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:23.963296 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-5c853430-5634-4d3f-af59-76807addc4de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da9f3be19b6b404ebe071680fbce164f'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:23.963949 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-5c853430-5634-4d3f-af59-76807addc4de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da9f3be19b6b404ebe071680fbce164f'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:23.964594 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-5c853430-5634-4d3f-af59-76807addc4de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da9f3be19b6b404ebe071680fbce164f'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:23.968404 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-bb99fbec-a662-4ee2-aa98-c818b02ee78d None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:23.969952 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-bb99fbec-a662-4ee2-aa98-c818b02ee78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:23.972668 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-5c853430-5634-4d3f-af59-76807addc4de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da9f3be19b6b404ebe071680fbce164f'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:23.988105 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1045/2116] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:00:23 2022] DELETE /identity/v3/users/da9f3be19b6b404ebe071680fbce164f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:23.992128 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c853430-5634-4d3f-af59-76807addc4de admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:23.993719 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-5c853430-5634-4d3f-af59-76807addc4de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:24.019438 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:24.050437 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1072/2117] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:24.051575 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc90b6-46f0-4227-aa48-2c1cca9dee2f None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:24.051862 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc90b6-46f0-4227-aa48-2c1cca9dee2f None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:24.052271 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc90b6-46f0-4227-aa48-2c1cca9dee2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:24.073373 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-12dc90b6-46f0-4227-aa48-2c1cca9dee2f None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:24.074587 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-12dc90b6-46f0-4227-aa48-2c1cca9dee2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:24.077288 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c853430-5634-4d3f-af59-76807addc4de admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:24.082675 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9fba3-948d-481e-8564-6f154f60f5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:24.083318 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9fba3-948d-481e-8564-6f154f60f5aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:24.083591 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9fba3-948d-481e-8564-6f154f60f5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:24.083866 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9fba3-948d-481e-8564-6f154f60f5aa admin admin] PATH_INFO: `/v3/projects/b554cb6b0296443b82cfbdc03cc96a21` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:24.084848 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1073/2118] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:24.086048 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090023b2-a962-4880-9323-de9f7173551b None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:24.086337 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090023b2-a962-4880-9323-de9f7173551b None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:24.086614 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090023b2-a962-4880-9323-de9f7173551b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:24.089859 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc9fba3-948d-481e-8564-6f154f60f5aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b554cb6b0296443b82cfbdc03cc96a21)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:24.094726 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc9fba3-948d-481e-8564-6f154f60f5aa admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:24.109723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-090023b2-a962-4880-9323-de9f7173551b None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:24.111207 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-090023b2-a962-4880-9323-de9f7173551b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:24.126816 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1074/2119] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:24.126816 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090023b2-a962-4880-9323-de9f7173551b None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:24.139624 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090023b2-a962-4880-9323-de9f7173551b None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:24.144563 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db109a0-f476-4260-a939-bcd89d565371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:24.145272 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db109a0-f476-4260-a939-bcd89d565371 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:24.145557 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db109a0-f476-4260-a939-bcd89d565371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:24.145831 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db109a0-f476-4260-a939-bcd89d565371 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:24.146488 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db109a0-f476-4260-a939-bcd89d565371 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:00:24.146844 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db109a0-f476-4260-a939-bcd89d565371 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:24.148451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db109a0-f476-4260-a939-bcd89d565371 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:24.162656 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1075/2120] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 16:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:00:24.165635 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4fc9fba3-948d-481e-8564-6f154f60f5aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b554cb6b0296443b82cfbdc03cc96a21', 'request_id': 'req-4fc9fba3-948d-481e-8564-6f154f60f5aa'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:24.167281 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca784ae-0186-4d22-b568-ae7666f8b36b None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:24.167577 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca784ae-0186-4d22-b568-ae7666f8b36b None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:24.167857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca784ae-0186-4d22-b568-ae7666f8b36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:24.171808 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4fc9fba3-948d-481e-8564-6f154f60f5aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b554cb6b0296443b82cfbdc03cc96a21', 'request_id': 'req-4fc9fba3-948d-481e-8564-6f154f60f5aa'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:24.181511 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4fc9fba3-948d-481e-8564-6f154f60f5aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b554cb6b0296443b82cfbdc03cc96a21', 'request_id': 'req-4fc9fba3-948d-481e-8564-6f154f60f5aa'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:24.189803 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-aca784ae-0186-4d22-b568-ae7666f8b36b None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:24.191007 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-aca784ae-0186-4d22-b568-ae7666f8b36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:24.193791 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4fc9fba3-948d-481e-8564-6f154f60f5aa admin admin] The token cache is being invalidate because project b554cb6b0296443b82cfbdc03cc96a21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:00:24.194081 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4fc9fba3-948d-481e-8564-6f154f60f5aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:24.194716 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4fc9fba3-948d-481e-8564-6f154f60f5aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:24.196213 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1046/2121] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:00:23 2022] DELETE /identity/v3/projects/b554cb6b0296443b82cfbdc03cc96a21 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:24.199822 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9fba3-948d-481e-8564-6f154f60f5aa admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:24.199822 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-4fc9fba3-948d-481e-8564-6f154f60f5aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:24.262374 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1076/2122] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:24.262741 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca784ae-0186-4d22-b568-ae7666f8b36b None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:24.264730 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-aca784ae-0186-4d22-b568-ae7666f8b36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:24.274921 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9fba3-948d-481e-8564-6f154f60f5aa admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:24.280963 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c47a8-afc9-41c2-aed0-3fc1c9571ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:24.281637 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c47a8-afc9-41c2-aed0-3fc1c9571ec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:24.281936 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c47a8-afc9-41c2-aed0-3fc1c9571ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:24.282214 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c47a8-afc9-41c2-aed0-3fc1c9571ec1 admin admin] PATH_INFO: `/v3/users/4205ea6e798d4c51b391042a02cf6430` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:24.283370 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c47a8-afc9-41c2-aed0-3fc1c9571ec1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4205ea6e798d4c51b391042a02cf6430)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:24.285407 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c47a8-afc9-41c2-aed0-3fc1c9571ec1 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:24.330608 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca784ae-0186-4d22-b568-ae7666f8b36b None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:24.334889 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d9bfe-1c67-426d-b53c-816a3f62572e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:24.335554 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d9bfe-1c67-426d-b53c-816a3f62572e service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:24.335800 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d9bfe-1c67-426d-b53c-816a3f62572e service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:24.336039 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d9bfe-1c67-426d-b53c-816a3f62572e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:24.337810 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c90d9bfe-1c67-426d-b53c-816a3f62572e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:24.346496 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-e03c47a8-afc9-41c2-aed0-3fc1c9571ec1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4205ea6e798d4c51b391042a02cf6430'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:24.349554 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90d9bfe-1c67-426d-b53c-816a3f62572e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:24.350973 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90d9bfe-1c67-426d-b53c-816a3f62572e service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:24.351335 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:24.361715 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1077/2123] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:00:24.362751 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d9bfe-1c67-426d-b53c-816a3f62572e service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:24.364123 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c90d9bfe-1c67-426d-b53c-816a3f62572e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:24.365343 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-e03c47a8-afc9-41c2-aed0-3fc1c9571ec1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4205ea6e798d4c51b391042a02cf6430'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:24.366057 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-e03c47a8-afc9-41c2-aed0-3fc1c9571ec1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4205ea6e798d4c51b391042a02cf6430'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:24.366720 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-e03c47a8-afc9-41c2-aed0-3fc1c9571ec1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4205ea6e798d4c51b391042a02cf6430'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:24.379405 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d9bfe-1c67-426d-b53c-816a3f62572e service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:24.381189 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-e03c47a8-afc9-41c2-aed0-3fc1c9571ec1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4205ea6e798d4c51b391042a02cf6430'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:24.389535 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a64ec-c9d5-4c3d-98b3-66ffca11de6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:24.390158 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a64ec-c9d5-4c3d-98b3-66ffca11de6b admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:24.390436 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a64ec-c9d5-4c3d-98b3-66ffca11de6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:24.390710 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a64ec-c9d5-4c3d-98b3-66ffca11de6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:24.391371 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a64ec-c9d5-4c3d-98b3-66ffca11de6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:24.393336 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a64ec-c9d5-4c3d-98b3-66ffca11de6b admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:24.407983 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1047/2124] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:00:24 2022] DELETE /identity/v3/users/4205ea6e798d4c51b391042a02cf6430 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:24.408241 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:24.408336 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb261ba-2ac6-4e72-b41c-9b81392d6dbd None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:24.408336 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb261ba-2ac6-4e72-b41c-9b81392d6dbd None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:24.408336 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb261ba-2ac6-4e72-b41c-9b81392d6dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:24.430409 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1078/2125] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:00:24 2022] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:24.431449 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a64ec-c9d5-4c3d-98b3-66ffca11de6b admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:24.434823 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-ccb261ba-2ac6-4e72-b41c-9b81392d6dbd None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:24.435020 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-b36a64ec-c9d5-4c3d-98b3-66ffca11de6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:24.436708 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-ccb261ba-2ac6-4e72-b41c-9b81392d6dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:24.524988 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1048/2126] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:24.541061 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a64ec-c9d5-4c3d-98b3-66ffca11de6b admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:24.541172 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cb80b-407c-42d6-918e-28912a2b3ba7 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:24.541172 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cb80b-407c-42d6-918e-28912a2b3ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:24.541172 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cb80b-407c-42d6-918e-28912a2b3ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:24.541369 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b28db1-e7f3-4243-812c-57a8c87fee28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:24.541369 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b28db1-e7f3-4243-812c-57a8c87fee28 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:24.541369 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b28db1-e7f3-4243-812c-57a8c87fee28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:24.541369 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b28db1-e7f3-4243-812c-57a8c87fee28 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:24.541649 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b28db1-e7f3-4243-812c-57a8c87fee28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:00:24.541649 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b28db1-e7f3-4243-812c-57a8c87fee28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:24.541649 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b28db1-e7f3-4243-812c-57a8c87fee28 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:24.556881 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-9c8cb80b-407c-42d6-918e-28912a2b3ba7 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:24.557093 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1079/2127] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 16:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:00:24.557093 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b28db1-e7f3-4243-812c-57a8c87fee28 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:24.557241 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-9c8cb80b-407c-42d6-918e-28912a2b3ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:24.558907 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-59b28db1-e7f3-4243-812c-57a8c87fee28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:24.564455 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1049/2128] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:24.570184 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7dd31e-181b-4fa2-bc98-a3bcc9193212 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:24.570476 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7dd31e-181b-4fa2-bc98-a3bcc9193212 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:24.570907 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7dd31e-181b-4fa2-bc98-a3bcc9193212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:24.574810 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b28db1-e7f3-4243-812c-57a8c87fee28 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:24.580926 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe7f69-a4df-4855-8f11-6275cb0717e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:24.582280 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe7f69-a4df-4855-8f11-6275cb0717e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:24.582725 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe7f69-a4df-4855-8f11-6275cb0717e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:24.583152 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe7f69-a4df-4855-8f11-6275cb0717e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:24.583948 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe7f69-a4df-4855-8f11-6275cb0717e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:24.586092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe7f69-a4df-4855-8f11-6275cb0717e2 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:24.609152 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-bd7dd31e-181b-4fa2-bc98-a3bcc9193212 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:24.611086 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-bd7dd31e-181b-4fa2-bc98-a3bcc9193212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:24.620251 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1080/2129] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:00:24 2022] POST /identity/v3/users => generated 292 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:24.621762 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe7f69-a4df-4855-8f11-6275cb0717e2 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:24.624359 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1050/2130] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:24.625458 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7dd31e-181b-4fa2-bc98-a3bcc9193212 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:24.630012 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-bd7dd31e-181b-4fa2-bc98-a3bcc9193212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:24.635113 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe7f69-a4df-4855-8f11-6275cb0717e2 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:24.641815 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f87faa4-91b4-4904-91e0-3d2866a60287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:24.642773 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87faa4-91b4-4904-91e0-3d2866a60287 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:24.643071 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87faa4-91b4-4904-91e0-3d2866a60287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:24.643356 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87faa4-91b4-4904-91e0-3d2866a60287 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:24.644004 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f87faa4-91b4-4904-91e0-3d2866a60287 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:24.646368 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f87faa4-91b4-4904-91e0-3d2866a60287 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:24.697203 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1081/2131] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:00:24 2022] POST /identity/v3/projects => generated 381 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:24.697203 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f87faa4-91b4-4904-91e0-3d2866a60287 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:24.723387 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7dd31e-181b-4fa2-bc98-a3bcc9193212 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:24.786187 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb983907-50b2-418b-98b2-d7e8b1f5f3e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:24.786804 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb983907-50b2-418b-98b2-d7e8b1f5f3e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:24.787090 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb983907-50b2-418b-98b2-d7e8b1f5f3e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:24.787364 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb983907-50b2-418b-98b2-d7e8b1f5f3e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:24.798407 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb983907-50b2-418b-98b2-d7e8b1f5f3e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:24.798917 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f87faa4-91b4-4904-91e0-3d2866a60287 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:24.800158 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb983907-50b2-418b-98b2-d7e8b1f5f3e5 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:24.808331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e709e88-c068-4a6c-92bb-f70212bc1afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:24.809478 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e709e88-c068-4a6c-92bb-f70212bc1afe admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:24.811058 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e709e88-c068-4a6c-92bb-f70212bc1afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:24.811566 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e709e88-c068-4a6c-92bb-f70212bc1afe admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:24.812812 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1051/2132] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:00:24.812943 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e709e88-c068-4a6c-92bb-f70212bc1afe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:24.816338 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb983907-50b2-418b-98b2-d7e8b1f5f3e5 service neutron] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:24.816508 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e709e88-c068-4a6c-92bb-f70212bc1afe admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:24.823625 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb983907-50b2-418b-98b2-d7e8b1f5f3e5 service neutron] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:24.827161 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1082/2133] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:24.828055 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e709e88-c068-4a6c-92bb-f70212bc1afe admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:24.829294 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ad76f-183c-4351-8d3c-512d6f4e32ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:24.830307 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ad76f-183c-4351-8d3c-512d6f4e32ed admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:24.830606 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ad76f-183c-4351-8d3c-512d6f4e32ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:24.830887 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ad76f-183c-4351-8d3c-512d6f4e32ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:24.831544 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ad76f-183c-4351-8d3c-512d6f4e32ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:00:24.831846 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ad76f-183c-4351-8d3c-512d6f4e32ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:24.833583 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ad76f-183c-4351-8d3c-512d6f4e32ed admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:24.839240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e709e88-c068-4a6c-92bb-f70212bc1afe admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:24.844418 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a7c39-1772-4a2d-a4b1-53b2dd2a7725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:24.845138 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a7c39-1772-4a2d-a4b1-53b2dd2a7725 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:24.845475 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a7c39-1772-4a2d-a4b1-53b2dd2a7725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:24.845813 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a7c39-1772-4a2d-a4b1-53b2dd2a7725 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:24.846787 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507a7c39-1772-4a2d-a4b1-53b2dd2a7725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:24.847336 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1052/2134] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 16:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:00:24.848558 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ad76f-183c-4351-8d3c-512d6f4e32ed admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:24.849505 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507a7c39-1772-4a2d-a4b1-53b2dd2a7725 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:24.858103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:24.865602 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ad76f-183c-4351-8d3c-512d6f4e32ed admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:24.872902 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0aff8d-ccd9-4d4a-af92-3252e7aa5c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:24.873679 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0aff8d-ccd9-4d4a-af92-3252e7aa5c6b admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:24.874224 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0aff8d-ccd9-4d4a-af92-3252e7aa5c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:24.875285 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0aff8d-ccd9-4d4a-af92-3252e7aa5c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:24.875863 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0aff8d-ccd9-4d4a-af92-3252e7aa5c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:24.879610 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0aff8d-ccd9-4d4a-af92-3252e7aa5c6b admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:24.883873 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1083/2135] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:00:24 2022] POST /identity/v3/users => generated 291 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:24.887778 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a7c39-1772-4a2d-a4b1-53b2dd2a7725 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:24.896282 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1053/2136] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:24.896282 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0aff8d-ccd9-4d4a-af92-3252e7aa5c6b admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:24.900834 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a7c39-1772-4a2d-a4b1-53b2dd2a7725 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:24.904487 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0aff8d-ccd9-4d4a-af92-3252e7aa5c6b admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:24.907750 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60b71f-8354-4fac-869f-e96c64d479c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:24.908657 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60b71f-8354-4fac-869f-e96c64d479c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:24.909032 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60b71f-8354-4fac-869f-e96c64d479c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:24.909382 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60b71f-8354-4fac-869f-e96c64d479c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:24.909957 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e60b71f-8354-4fac-869f-e96c64d479c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:24.910880 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696326b-3a9a-4c69-b4e3-4273a1a16ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:24.911694 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696326b-3a9a-4c69-b4e3-4273a1a16ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:24.911937 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696326b-3a9a-4c69-b4e3-4273a1a16ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:24.912031 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696326b-3a9a-4c69-b4e3-4273a1a16ff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:24.912672 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7696326b-3a9a-4c69-b4e3-4273a1a16ff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:24.914389 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7696326b-3a9a-4c69-b4e3-4273a1a16ff7 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:24.916818 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e60b71f-8354-4fac-869f-e96c64d479c2 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:24.928000 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1054/2137] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:24.928769 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696326b-3a9a-4c69-b4e3-4273a1a16ff7 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:24.946559 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696326b-3a9a-4c69-b4e3-4273a1a16ff7 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:24.954823 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b17ba-898c-40c1-aafc-fbdb9a49d1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:24.955726 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b17ba-898c-40c1-aafc-fbdb9a49d1c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:24.956082 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b17ba-898c-40c1-aafc-fbdb9a49d1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:24.956439 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b17ba-898c-40c1-aafc-fbdb9a49d1c6 admin admin] PATH_INFO: `/v3/projects/bdd8b08e9eac449ba23ea170fc6202c3/users/be76686ee9dc43d1a7410b91c9c067e8/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:24.967204 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1084/2138] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:00:24 2022] POST /identity/v3/projects => generated 373 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:24.971706 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60b71f-8354-4fac-869f-e96c64d479c2 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:24.974214 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-1e60b71f-8354-4fac-869f-e96c64d479c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:24.976641 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0b17ba-898c-40c1-aafc-fbdb9a49d1c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdd8b08e9eac449ba23ea170fc6202c3, user_id=be76686ee9dc43d1a7410b91c9c067e8, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:24.979284 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:24.980117 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0b17ba-898c-40c1-aafc-fbdb9a49d1c6 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:24.996122 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1055/2139] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:00:24 2022] PUT /identity/v3/projects/bdd8b08e9eac449ba23ea170fc6202c3/users/be76686ee9dc43d1a7410b91c9c067e8/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:25.005148 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b17ba-898c-40c1-aafc-fbdb9a49d1c6 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:25.065686 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60b71f-8354-4fac-869f-e96c64d479c2 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:25.088084 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b17ba-898c-40c1-aafc-fbdb9a49d1c6 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:25.094053 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98992c0f-2574-403b-a785-0a01151063ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:25.094685 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98992c0f-2574-403b-a785-0a01151063ca admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:25.094967 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98992c0f-2574-403b-a785-0a01151063ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:25.095241 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98992c0f-2574-403b-a785-0a01151063ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:25.095906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98992c0f-2574-403b-a785-0a01151063ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:25.097547 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98992c0f-2574-403b-a785-0a01151063ca admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:25.108596 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1056/2140] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:25.109650 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98992c0f-2574-403b-a785-0a01151063ca admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:25.119788 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98992c0f-2574-403b-a785-0a01151063ca admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:25.124998 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf74ec-2317-4c20-ae8b-892daa8b6b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:25.125637 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf74ec-2317-4c20-ae8b-892daa8b6b85 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:25.125901 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf74ec-2317-4c20-ae8b-892daa8b6b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:25.126174 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf74ec-2317-4c20-ae8b-892daa8b6b85 admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:25.126815 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf74ec-2317-4c20-ae8b-892daa8b6b85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:25.129491 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf74ec-2317-4c20-ae8b-892daa8b6b85 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:25.146285 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2812ead-f9a6-45f6-bf9a-56d839ded1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:25.146948 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2812ead-f9a6-45f6-bf9a-56d839ded1f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:25.147259 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2812ead-f9a6-45f6-bf9a-56d839ded1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:25.147482 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2812ead-f9a6-45f6-bf9a-56d839ded1f5 admin admin] PATH_INFO: `/v3/projects/9ba3122e31034079a6d0727b60a1de4b` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:25.149086 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2812ead-f9a6-45f6-bf9a-56d839ded1f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ba3122e31034079a6d0727b60a1de4b)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:25.150652 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2812ead-f9a6-45f6-bf9a-56d839ded1f5 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:25.161165 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1057/2141] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:00:25 2022] POST /identity/v3/users => generated 287 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:25.161165 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31851b-d2dd-4a6e-8ed8-e56182b5fb6f None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:25.161165 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31851b-d2dd-4a6e-8ed8-e56182b5fb6f None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:25.161165 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31851b-d2dd-4a6e-8ed8-e56182b5fb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:25.197472 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-6d31851b-d2dd-4a6e-8ed8-e56182b5fb6f None None] MFA Rules not processed for user `be76686ee9dc43d1a7410b91c9c067e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:25.198780 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-6d31851b-d2dd-4a6e-8ed8-e56182b5fb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:25.232870 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f2812ead-f9a6-45f6-bf9a-56d839ded1f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ba3122e31034079a6d0727b60a1de4b', 'request_id': 'req-f2812ead-f9a6-45f6-bf9a-56d839ded1f5'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:25.242766 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f2812ead-f9a6-45f6-bf9a-56d839ded1f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ba3122e31034079a6d0727b60a1de4b', 'request_id': 'req-f2812ead-f9a6-45f6-bf9a-56d839ded1f5'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:25.254724 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f2812ead-f9a6-45f6-bf9a-56d839ded1f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ba3122e31034079a6d0727b60a1de4b', 'request_id': 'req-f2812ead-f9a6-45f6-bf9a-56d839ded1f5'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:25.267786 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f2812ead-f9a6-45f6-bf9a-56d839ded1f5 admin admin] The token cache is being invalidate because project 9ba3122e31034079a6d0727b60a1de4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:00:25.268157 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f2812ead-f9a6-45f6-bf9a-56d839ded1f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:25.268872 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f2812ead-f9a6-45f6-bf9a-56d839ded1f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:25.270380 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1085/2142] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:00:24 2022] DELETE /identity/v3/projects/9ba3122e31034079a6d0727b60a1de4b => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:25.271106 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2812ead-f9a6-45f6-bf9a-56d839ded1f5 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:25.272360 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-f2812ead-f9a6-45f6-bf9a-56d839ded1f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:25.289317 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1058/2143] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:25.290280 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31851b-d2dd-4a6e-8ed8-e56182b5fb6f None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:25.291808 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-6d31851b-d2dd-4a6e-8ed8-e56182b5fb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:25.305233 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31851b-d2dd-4a6e-8ed8-e56182b5fb6f None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:25.322697 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:25.331602 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:25.355127 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2812ead-f9a6-45f6-bf9a-56d839ded1f5 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:25.360786 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbaadaf-c169-465b-abcc-f738f2a6d34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:25.361566 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbaadaf-c169-465b-abcc-f738f2a6d34d admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:25.361786 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbaadaf-c169-465b-abcc-f738f2a6d34d admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:25.362055 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbaadaf-c169-465b-abcc-f738f2a6d34d admin admin] PATH_INFO: `/v3/projects/87206a5aa6bd4a99bc04e5ccab964def/users/8391c80e8c5445838e6a979244727c6e/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:25.377836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbaadaf-c169-465b-abcc-f738f2a6d34d admin admin] RBAC: Authorizing `identity:create_grant(project_id=87206a5aa6bd4a99bc04e5ccab964def, user_id=8391c80e8c5445838e6a979244727c6e, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:25.380688 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbaadaf-c169-465b-abcc-f738f2a6d34d admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:25.380838 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c0636-4bf0-4938-9ec7-75642bee4ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:25.381344 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c0636-4bf0-4938-9ec7-75642bee4ccc admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:25.381620 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c0636-4bf0-4938-9ec7-75642bee4ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:25.381919 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c0636-4bf0-4938-9ec7-75642bee4ccc admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:25.382557 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65c0636-4bf0-4938-9ec7-75642bee4ccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:25.384388 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65c0636-4bf0-4938-9ec7-75642bee4ccc admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:25.395276 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1086/2144] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:00:25 2022] PUT /identity/v3/projects/87206a5aa6bd4a99bc04e5ccab964def/users/8391c80e8c5445838e6a979244727c6e/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:25.395871 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1059/2145] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:25.396164 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbaadaf-c169-465b-abcc-f738f2a6d34d admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:25.398218 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559aa2ad-7514-4732-b573-dbc88e92b2df None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:25.398737 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559aa2ad-7514-4732-b573-dbc88e92b2df None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:25.398899 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559aa2ad-7514-4732-b573-dbc88e92b2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:25.405728 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-cbbaadaf-c169-465b-abcc-f738f2a6d34d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:25.422355 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-559aa2ad-7514-4732-b573-dbc88e92b2df None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:25.423555 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-559aa2ad-7514-4732-b573-dbc88e92b2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:25.473023 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbaadaf-c169-465b-abcc-f738f2a6d34d admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:25.477719 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa998b05-0c10-4b65-8f91-1e86000f42af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:25.478349 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa998b05-0c10-4b65-8f91-1e86000f42af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:25.478625 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa998b05-0c10-4b65-8f91-1e86000f42af admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:25.478896 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa998b05-0c10-4b65-8f91-1e86000f42af admin admin] PATH_INFO: `/v3/projects/f36146b53e784779a1c617c562cf97b3` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:25.480026 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa998b05-0c10-4b65-8f91-1e86000f42af admin admin] RBAC: Authorizing `identity:delete_project(project_id=f36146b53e784779a1c617c562cf97b3)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:25.482168 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa998b05-0c10-4b65-8f91-1e86000f42af admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:25.492530 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1060/2146] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:25.499396 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559aa2ad-7514-4732-b573-dbc88e92b2df None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:25.499396 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-559aa2ad-7514-4732-b573-dbc88e92b2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:25.507222 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559aa2ad-7514-4732-b573-dbc88e92b2df None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:25.512466 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345e35b-d922-4a4f-8a32-e59d45fb1873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:25.513849 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345e35b-d922-4a4f-8a32-e59d45fb1873 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:25.514186 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345e35b-d922-4a4f-8a32-e59d45fb1873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:25.514485 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345e35b-d922-4a4f-8a32-e59d45fb1873 admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:25.515273 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b345e35b-d922-4a4f-8a32-e59d45fb1873 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:25.517206 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b345e35b-d922-4a4f-8a32-e59d45fb1873 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:25.541160 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-fa998b05-0c10-4b65-8f91-1e86000f42af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f36146b53e784779a1c617c562cf97b3', 'request_id': 'req-fa998b05-0c10-4b65-8f91-1e86000f42af'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:25.551623 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1061/2147] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:00:25 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:25.551795 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-fa998b05-0c10-4b65-8f91-1e86000f42af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f36146b53e784779a1c617c562cf97b3', 'request_id': 'req-fa998b05-0c10-4b65-8f91-1e86000f42af'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:25.551877 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345e35b-d922-4a4f-8a32-e59d45fb1873 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:25.556364 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-fa998b05-0c10-4b65-8f91-1e86000f42af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f36146b53e784779a1c617c562cf97b3', 'request_id': 'req-fa998b05-0c10-4b65-8f91-1e86000f42af'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:25.566810 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-fa998b05-0c10-4b65-8f91-1e86000f42af admin admin] The token cache is being invalidate because project f36146b53e784779a1c617c562cf97b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:00:25.567113 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-fa998b05-0c10-4b65-8f91-1e86000f42af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:25.567775 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-fa998b05-0c10-4b65-8f91-1e86000f42af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:25.569305 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1087/2148] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:00:25 2022] DELETE /identity/v3/projects/f36146b53e784779a1c617c562cf97b3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:25.570479 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6683a0-daa2-487b-b996-e21b2b18fade None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:25.570770 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6683a0-daa2-487b-b996-e21b2b18fade None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:25.571021 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6683a0-daa2-487b-b996-e21b2b18fade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:25.599144 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-7d6683a0-daa2-487b-b996-e21b2b18fade None None] MFA Rules not processed for user `8391c80e8c5445838e6a979244727c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:25.600371 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7d6683a0-daa2-487b-b996-e21b2b18fade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:25.614044 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345e35b-d922-4a4f-8a32-e59d45fb1873 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:25.619229 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1dcf57-34be-4cd6-83f4-6d57676eb4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:25.619898 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1dcf57-34be-4cd6-83f4-6d57676eb4ff admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:25.620172 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1dcf57-34be-4cd6-83f4-6d57676eb4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:25.620467 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1dcf57-34be-4cd6-83f4-6d57676eb4ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:25.621142 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1dcf57-34be-4cd6-83f4-6d57676eb4ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:25.622779 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1dcf57-34be-4cd6-83f4-6d57676eb4ff admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:25.639132 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1062/2149] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:25.641520 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be30b4-f7ac-4697-8664-2cbc895a7022 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:25.641805 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be30b4-f7ac-4697-8664-2cbc895a7022 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:25.642075 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be30b4-f7ac-4697-8664-2cbc895a7022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:25.646272 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:25.662669 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-b3be30b4-f7ac-4697-8664-2cbc895a7022 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:25.663857 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-b3be30b4-f7ac-4697-8664-2cbc895a7022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:25.671744 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1088/2150] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:25.671981 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1063/2151] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:25.673111 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6683a0-daa2-487b-b996-e21b2b18fade None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:25.674404 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7d6683a0-daa2-487b-b996-e21b2b18fade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:25.676055 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be30b4-f7ac-4697-8664-2cbc895a7022 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:25.677393 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-b3be30b4-f7ac-4697-8664-2cbc895a7022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:25.688547 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6683a0-daa2-487b-b996-e21b2b18fade None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:25.689535 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be30b4-f7ac-4697-8664-2cbc895a7022 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:25.693439 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454bbca9-19d8-4470-a58b-a936d4f5c58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:25.694326 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bbca9-19d8-4470-a58b-a936d4f5c58f admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:25.694605 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bbca9-19d8-4470-a58b-a936d4f5c58f admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:25.694876 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bbca9-19d8-4470-a58b-a936d4f5c58f admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:25.695250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb92b4a-4b8d-48f2-9aae-06984394eacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:25.695519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454bbca9-19d8-4470-a58b-a936d4f5c58f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:25.695872 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb92b4a-4b8d-48f2-9aae-06984394eacb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:25.696152 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb92b4a-4b8d-48f2-9aae-06984394eacb admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:25.696428 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb92b4a-4b8d-48f2-9aae-06984394eacb admin admin] PATH_INFO: `/v3/users/e86eb6764ca844458283cce7097060b1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:25.697433 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454bbca9-19d8-4470-a58b-a936d4f5c58f admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:25.697600 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb92b4a-4b8d-48f2-9aae-06984394eacb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e86eb6764ca844458283cce7097060b1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:25.699543 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb92b4a-4b8d-48f2-9aae-06984394eacb admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:25.720746 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1089/2152] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:00:25 2022] POST /identity/v3/users => generated 292 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:25.721539 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454bbca9-19d8-4470-a58b-a936d4f5c58f admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:25.723351 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-454bbca9-19d8-4470-a58b-a936d4f5c58f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:25.734196 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:25.744074 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454bbca9-19d8-4470-a58b-a936d4f5c58f admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:25.750417 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b533851-cedb-474b-962d-cecf14318740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:25.751236 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b533851-cedb-474b-962d-cecf14318740 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:25.751625 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b533851-cedb-474b-962d-cecf14318740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:25.752003 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b533851-cedb-474b-962d-cecf14318740 admin admin] PATH_INFO: `/v3/projects/5aef1ed4921e44c3a379397c10afa55f/users/9ec6168f0d544ae4899437ea6bc7b05b/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:25.768379 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-bbb92b4a-4b8d-48f2-9aae-06984394eacb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e86eb6764ca844458283cce7097060b1'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:25.769044 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b533851-cedb-474b-962d-cecf14318740 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aef1ed4921e44c3a379397c10afa55f, user_id=9ec6168f0d544ae4899437ea6bc7b05b, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:25.771842 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b533851-cedb-474b-962d-cecf14318740 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:25.784224 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-bbb92b4a-4b8d-48f2-9aae-06984394eacb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e86eb6764ca844458283cce7097060b1'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:25.785358 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-bbb92b4a-4b8d-48f2-9aae-06984394eacb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e86eb6764ca844458283cce7097060b1'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:25.786124 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-bbb92b4a-4b8d-48f2-9aae-06984394eacb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e86eb6764ca844458283cce7097060b1'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:25.786498 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1090/2153] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:00:25 2022] PUT /identity/v3/projects/5aef1ed4921e44c3a379397c10afa55f/users/9ec6168f0d544ae4899437ea6bc7b05b/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:25.787430 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b533851-cedb-474b-962d-cecf14318740 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:25.790553 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-1b533851-cedb-474b-962d-cecf14318740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:25.803901 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-bbb92b4a-4b8d-48f2-9aae-06984394eacb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e86eb6764ca844458283cce7097060b1'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:25.819782 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1064/2154] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:00:25 2022] DELETE /identity/v3/users/e86eb6764ca844458283cce7097060b1 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:25.821068 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb92b4a-4b8d-48f2-9aae-06984394eacb admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:25.823056 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-bbb92b4a-4b8d-48f2-9aae-06984394eacb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:25.893363 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b533851-cedb-474b-962d-cecf14318740 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:25.917635 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb92b4a-4b8d-48f2-9aae-06984394eacb admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:25.924859 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77719797-7587-418f-b2b9-7279768e0a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:25.925565 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77719797-7587-418f-b2b9-7279768e0a31 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:25.926485 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77719797-7587-418f-b2b9-7279768e0a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:25.926763 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77719797-7587-418f-b2b9-7279768e0a31 admin admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:25.927430 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77719797-7587-418f-b2b9-7279768e0a31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:00:25.927885 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77719797-7587-418f-b2b9-7279768e0a31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:25.929570 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77719797-7587-418f-b2b9-7279768e0a31 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:25.945044 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1065/2155] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 16:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:00:25.948595 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77719797-7587-418f-b2b9-7279768e0a31 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:25.951293 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-77719797-7587-418f-b2b9-7279768e0a31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:25.968671 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77719797-7587-418f-b2b9-7279768e0a31 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:25.973839 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0526a9d-f859-4dd8-9836-5ba7f4d5d3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:25.974534 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0526a9d-f859-4dd8-9836-5ba7f4d5d3ea admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:25.974761 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0526a9d-f859-4dd8-9836-5ba7f4d5d3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:25.975037 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0526a9d-f859-4dd8-9836-5ba7f4d5d3ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:25.976109 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0526a9d-f859-4dd8-9836-5ba7f4d5d3ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:25.977369 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0526a9d-f859-4dd8-9836-5ba7f4d5d3ea admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:25.978195 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4387a-c9a0-4099-a7b9-8099dc669463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:25.978987 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4387a-c9a0-4099-a7b9-8099dc669463 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:25.979264 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4387a-c9a0-4099-a7b9-8099dc669463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:25.979879 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4387a-c9a0-4099-a7b9-8099dc669463 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:25.981013 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b4387a-c9a0-4099-a7b9-8099dc669463 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:25.983998 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b4387a-c9a0-4099-a7b9-8099dc669463 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:25.989957 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1066/2156] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:25.991027 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ad295-69cc-4568-9558-22b39a6dd7fe None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:25.991309 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ad295-69cc-4568-9558-22b39a6dd7fe None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:25.991588 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ad295-69cc-4568-9558-22b39a6dd7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:26.021468 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1091/2157] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:00:25 2022] POST /identity/v3/projects => generated 385 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:26.022317 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4387a-c9a0-4099-a7b9-8099dc669463 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:26.027791 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-531ad295-69cc-4568-9558-22b39a6dd7fe None None] MFA Rules not processed for user `9ec6168f0d544ae4899437ea6bc7b05b`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:26.029213 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-531ad295-69cc-4568-9558-22b39a6dd7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:26.072085 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:26.103265 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4387a-c9a0-4099-a7b9-8099dc669463 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:26.110855 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1067/2158] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:26.110855 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ad295-69cc-4568-9558-22b39a6dd7fe None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:26.113214 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a1417-06e4-4214-812b-0db829b0d813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:26.114018 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a1417-06e4-4214-812b-0db829b0d813 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:26.114530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a1417-06e4-4214-812b-0db829b0d813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:26.114875 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a1417-06e4-4214-812b-0db829b0d813 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:26.115628 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a1417-06e4-4214-812b-0db829b0d813 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:26.117708 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a1417-06e4-4214-812b-0db829b0d813 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:26.121638 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ad295-69cc-4568-9558-22b39a6dd7fe None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:26.128088 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa2686-a770-44b1-b173-75a7749a39e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:26.128824 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa2686-a770-44b1-b173-75a7749a39e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:26.129142 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa2686-a770-44b1-b173-75a7749a39e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:26.129709 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa2686-a770-44b1-b173-75a7749a39e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:26.130696 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa2686-a770-44b1-b173-75a7749a39e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:26.132937 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa2686-a770-44b1-b173-75a7749a39e7 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:26.146647 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1068/2159] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:26.147529 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa2686-a770-44b1-b173-75a7749a39e7 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:26.154730 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1092/2160] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:00:26 2022] POST /identity/v3/projects => generated 375 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:26.156125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a1417-06e4-4214-812b-0db829b0d813 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:26.158654 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-db9a1417-06e4-4214-812b-0db829b0d813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:26.161421 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:26.175394 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa2686-a770-44b1-b173-75a7749a39e7 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:26.231877 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a1417-06e4-4214-812b-0db829b0d813 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:26.237036 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf9bb45-8139-46cb-8dd4-c1a8fbcb166d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:26.237725 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9bb45-8139-46cb-8dd4-c1a8fbcb166d admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:26.237991 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9bb45-8139-46cb-8dd4-c1a8fbcb166d admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:26.238277 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9bb45-8139-46cb-8dd4-c1a8fbcb166d admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:26.238924 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf9bb45-8139-46cb-8dd4-c1a8fbcb166d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:26.239939 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345232c-9d98-421c-9a91-6ff59d671796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:26.240641 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345232c-9d98-421c-9a91-6ff59d671796 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:26.240926 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345232c-9d98-421c-9a91-6ff59d671796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:26.241028 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf9bb45-8139-46cb-8dd4-c1a8fbcb166d admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:26.241291 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345232c-9d98-421c-9a91-6ff59d671796 admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:26.242032 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a345232c-9d98-421c-9a91-6ff59d671796 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:26.244213 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a345232c-9d98-421c-9a91-6ff59d671796 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:26.272237 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1093/2161] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:00:26 2022] POST /identity/v3/projects => generated 371 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:26.273188 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf9bb45-8139-46cb-8dd4-c1a8fbcb166d admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:26.275458 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1069/2162] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:00:26 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:26.276085 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345232c-9d98-421c-9a91-6ff59d671796 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:26.277810 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-a345232c-9d98-421c-9a91-6ff59d671796 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:26.290365 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345232c-9d98-421c-9a91-6ff59d671796 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:26.344975 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf9bb45-8139-46cb-8dd4-c1a8fbcb166d admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:26.349729 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807c1a4-470c-4493-b689-fcc76ecdbe80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:26.351393 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807c1a4-470c-4493-b689-fcc76ecdbe80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:26.351393 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807c1a4-470c-4493-b689-fcc76ecdbe80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:26.351393 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807c1a4-470c-4493-b689-fcc76ecdbe80 admin admin] PATH_INFO: `/v3/projects/3b724904f06643dc8eb32a35b16e9ffb/users/181f3f8cd3084b6b9ceb5d9db65fdff4/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:26.351694 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19caad1-d312-43dc-aaa6-b5eeee25b1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:26.351894 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19caad1-d312-43dc-aaa6-b5eeee25b1c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:26.352246 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19caad1-d312-43dc-aaa6-b5eeee25b1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:26.352527 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19caad1-d312-43dc-aaa6-b5eeee25b1c2 admin admin] PATH_INFO: `/v3/projects/48dacf3a85fe4d7095715b17bf12350d` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:26.353867 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19caad1-d312-43dc-aaa6-b5eeee25b1c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48dacf3a85fe4d7095715b17bf12350d)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:26.356760 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19caad1-d312-43dc-aaa6-b5eeee25b1c2 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:26.367102 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4807c1a4-470c-4493-b689-fcc76ecdbe80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b724904f06643dc8eb32a35b16e9ffb, user_id=181f3f8cd3084b6b9ceb5d9db65fdff4, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:26.369902 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4807c1a4-470c-4493-b689-fcc76ecdbe80 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:26.390061 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1094/2163] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:00:26 2022] PUT /identity/v3/projects/3b724904f06643dc8eb32a35b16e9ffb/users/181f3f8cd3084b6b9ceb5d9db65fdff4/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:26.390658 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807c1a4-470c-4493-b689-fcc76ecdbe80 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:26.420647 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-a19caad1-d312-43dc-aaa6-b5eeee25b1c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48dacf3a85fe4d7095715b17bf12350d', 'request_id': 'req-a19caad1-d312-43dc-aaa6-b5eeee25b1c2'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:26.425821 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:26.426844 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-a19caad1-d312-43dc-aaa6-b5eeee25b1c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48dacf3a85fe4d7095715b17bf12350d', 'request_id': 'req-a19caad1-d312-43dc-aaa6-b5eeee25b1c2'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:26.435933 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-a19caad1-d312-43dc-aaa6-b5eeee25b1c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48dacf3a85fe4d7095715b17bf12350d', 'request_id': 'req-a19caad1-d312-43dc-aaa6-b5eeee25b1c2'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:26.447814 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-a19caad1-d312-43dc-aaa6-b5eeee25b1c2 admin admin] The token cache is being invalidate because project 48dacf3a85fe4d7095715b17bf12350d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:00:26.448105 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-a19caad1-d312-43dc-aaa6-b5eeee25b1c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:26.448750 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-a19caad1-d312-43dc-aaa6-b5eeee25b1c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:26.451276 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1070/2164] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:00:26 2022] DELETE /identity/v3/projects/48dacf3a85fe4d7095715b17bf12350d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:26.452086 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19caad1-d312-43dc-aaa6-b5eeee25b1c2 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:26.453847 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-a19caad1-d312-43dc-aaa6-b5eeee25b1c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:26.464630 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807c1a4-470c-4493-b689-fcc76ecdbe80 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:26.481569 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:26.522285 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19caad1-d312-43dc-aaa6-b5eeee25b1c2 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:26.524187 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1b642-7f39-4198-8c8b-28009693c440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:26.524878 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1b642-7f39-4198-8c8b-28009693c440 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:26.525166 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1b642-7f39-4198-8c8b-28009693c440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:26.525436 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1b642-7f39-4198-8c8b-28009693c440 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:26.526063 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d1b642-7f39-4198-8c8b-28009693c440 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:26.527144 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258cbc16-d0c2-4400-8062-405108207789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:26.527751 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cbc16-d0c2-4400-8062-405108207789 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:26.528011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d1b642-7f39-4198-8c8b-28009693c440 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:26.528120 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cbc16-d0c2-4400-8062-405108207789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:26.528313 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cbc16-d0c2-4400-8062-405108207789 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:26.529201 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258cbc16-d0c2-4400-8062-405108207789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:26.530865 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258cbc16-d0c2-4400-8062-405108207789 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:26.545572 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1071/2165] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:26.545572 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258cbc16-d0c2-4400-8062-405108207789 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:26.547141 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-258cbc16-d0c2-4400-8062-405108207789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:26.554743 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1095/2166] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:00:26 2022] POST /identity/v3/users => generated 288 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:26.555982 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c44dd-a943-414c-906d-acd4156608a6 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:26.556267 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c44dd-a943-414c-906d-acd4156608a6 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:26.556538 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c44dd-a943-414c-906d-acd4156608a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:26.563301 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258cbc16-d0c2-4400-8062-405108207789 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:26.568732 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65995f23-df98-48ab-bf85-01b7231e924b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:26.569363 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65995f23-df98-48ab-bf85-01b7231e924b admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:26.569640 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65995f23-df98-48ab-bf85-01b7231e924b admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:26.569912 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65995f23-df98-48ab-bf85-01b7231e924b admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:26.570546 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65995f23-df98-48ab-bf85-01b7231e924b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:26.572457 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65995f23-df98-48ab-bf85-01b7231e924b admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:26.585884 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-702c44dd-a943-414c-906d-acd4156608a6 None None] MFA Rules not processed for user `181f3f8cd3084b6b9ceb5d9db65fdff4`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:26.587097 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-702c44dd-a943-414c-906d-acd4156608a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:26.596458 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1072/2167] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:00:26 2022] POST /identity/v3/users => generated 292 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:26.597137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65995f23-df98-48ab-bf85-01b7231e924b admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:26.598744 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-65995f23-df98-48ab-bf85-01b7231e924b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:26.610302 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65995f23-df98-48ab-bf85-01b7231e924b admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:26.614904 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43822d2-aad9-46c1-aaa4-8a0410e667d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:26.615508 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43822d2-aad9-46c1-aaa4-8a0410e667d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:26.615788 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43822d2-aad9-46c1-aaa4-8a0410e667d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:26.616058 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43822d2-aad9-46c1-aaa4-8a0410e667d8 admin admin] PATH_INFO: `/v3/users/cedcb2bfee184a7a82b6f50a25cbbd57` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:26.617198 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43822d2-aad9-46c1-aaa4-8a0410e667d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cedcb2bfee184a7a82b6f50a25cbbd57)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:26.619247 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43822d2-aad9-46c1-aaa4-8a0410e667d8 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:26.659887 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1096/2168] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:26.660738 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c44dd-a943-414c-906d-acd4156608a6 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:26.672515 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c44dd-a943-414c-906d-acd4156608a6 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:26.674479 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-e43822d2-aad9-46c1-aaa4-8a0410e667d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cedcb2bfee184a7a82b6f50a25cbbd57'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:26.677129 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa78eb1-4ef7-424b-ada8-19b13bca8849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:26.677734 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa78eb1-4ef7-424b-ada8-19b13bca8849 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:26.678015 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa78eb1-4ef7-424b-ada8-19b13bca8849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:26.678285 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa78eb1-4ef7-424b-ada8-19b13bca8849 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:26.678952 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa78eb1-4ef7-424b-ada8-19b13bca8849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:26.680922 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa78eb1-4ef7-424b-ada8-19b13bca8849 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:26.688146 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-e43822d2-aad9-46c1-aaa4-8a0410e667d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cedcb2bfee184a7a82b6f50a25cbbd57'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:26.688882 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-e43822d2-aad9-46c1-aaa4-8a0410e667d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cedcb2bfee184a7a82b6f50a25cbbd57'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:26.689505 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-e43822d2-aad9-46c1-aaa4-8a0410e667d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cedcb2bfee184a7a82b6f50a25cbbd57'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:26.694740 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1097/2169] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:26.694740 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa78eb1-4ef7-424b-ada8-19b13bca8849 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:26.696083 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7fa78eb1-4ef7-424b-ada8-19b13bca8849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:26.701452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-e43822d2-aad9-46c1-aaa4-8a0410e667d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cedcb2bfee184a7a82b6f50a25cbbd57'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:26.709903 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa78eb1-4ef7-424b-ada8-19b13bca8849 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:26.714570 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fabe81-b797-404e-89eb-a7e66ccd65a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:26.714770 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1073/2170] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:00:26 2022] DELETE /identity/v3/users/cedcb2bfee184a7a82b6f50a25cbbd57 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:26.715162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fabe81-b797-404e-89eb-a7e66ccd65a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:26.715443 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fabe81-b797-404e-89eb-a7e66ccd65a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:26.715630 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43822d2-aad9-46c1-aaa4-8a0410e667d8 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:26.715736 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fabe81-b797-404e-89eb-a7e66ccd65a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:26.716969 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fabe81-b797-404e-89eb-a7e66ccd65a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:26.717947 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-e43822d2-aad9-46c1-aaa4-8a0410e667d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:26.718556 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fabe81-b797-404e-89eb-a7e66ccd65a7 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:26.738896 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1098/2171] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:26.739934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fabe81-b797-404e-89eb-a7e66ccd65a7 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:26.741995 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-05fabe81-b797-404e-89eb-a7e66ccd65a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:26.757519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fabe81-b797-404e-89eb-a7e66ccd65a7 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:26.806650 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:26.810854 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43822d2-aad9-46c1-aaa4-8a0410e667d8 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:26.815968 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc14a4e-8fb1-48f5-b8a5-2ab1a2e7caeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:26.816569 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc14a4e-8fb1-48f5-b8a5-2ab1a2e7caeb admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:26.816880 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc14a4e-8fb1-48f5-b8a5-2ab1a2e7caeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:26.817185 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc14a4e-8fb1-48f5-b8a5-2ab1a2e7caeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:26.817809 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc14a4e-8fb1-48f5-b8a5-2ab1a2e7caeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:26.819416 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc14a4e-8fb1-48f5-b8a5-2ab1a2e7caeb admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:26.834618 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1074/2172] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:26.838389 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc14a4e-8fb1-48f5-b8a5-2ab1a2e7caeb admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:26.839529 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-bfc14a4e-8fb1-48f5-b8a5-2ab1a2e7caeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:26.853542 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5a688-ce28-41d0-9e58-14eb783a12fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:26.853801 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc14a4e-8fb1-48f5-b8a5-2ab1a2e7caeb admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:26.854836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5a688-ce28-41d0-9e58-14eb783a12fe admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:26.855101 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5a688-ce28-41d0-9e58-14eb783a12fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:26.855433 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5a688-ce28-41d0-9e58-14eb783a12fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:26.856412 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce5a688-ce28-41d0-9e58-14eb783a12fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:26.859758 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce5a688-ce28-41d0-9e58-14eb783a12fe admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:26.860953 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be31fab-174b-49c4-8da5-669fe54dd328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:26.861712 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be31fab-174b-49c4-8da5-669fe54dd328 admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:26.861998 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be31fab-174b-49c4-8da5-669fe54dd328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:26.862279 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be31fab-174b-49c4-8da5-669fe54dd328 admin admin] PATH_INFO: `/v3/projects/dd8d8825b0dd4edc876d97ca6fafe269/users/3817e06620a74685a2db4b8d5ea79cfd/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:26.867124 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:26.882889 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be31fab-174b-49c4-8da5-669fe54dd328 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd8d8825b0dd4edc876d97ca6fafe269, user_id=3817e06620a74685a2db4b8d5ea79cfd, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:26.886188 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be31fab-174b-49c4-8da5-669fe54dd328 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:26.896174 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1099/2173] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:00:26 2022] POST /identity/v3/projects => generated 383 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:26.899682 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5a688-ce28-41d0-9e58-14eb783a12fe admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:26.909301 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1075/2174] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:00:26 2022] PUT /identity/v3/projects/dd8d8825b0dd4edc876d97ca6fafe269/users/3817e06620a74685a2db4b8d5ea79cfd/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:26.909301 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be31fab-174b-49c4-8da5-669fe54dd328 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:27.010213 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be31fab-174b-49c4-8da5-669fe54dd328 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:27.013973 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5a688-ce28-41d0-9e58-14eb783a12fe admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:27.015342 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702a03e-7631-457e-8d4b-f067cf06684f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:27.016076 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702a03e-7631-457e-8d4b-f067cf06684f admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:27.016426 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702a03e-7631-457e-8d4b-f067cf06684f admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:27.016775 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702a03e-7631-457e-8d4b-f067cf06684f admin admin] PATH_INFO: `/v3/projects/be79397582244a3c99b38904f2352acd/users/5254f4a8f8214b2ba772845ef98d4491/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:27.020527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727dfd2-4e7a-49df-bda2-0812316dc7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:27.020858 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727dfd2-4e7a-49df-bda2-0812316dc7a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:27.021206 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727dfd2-4e7a-49df-bda2-0812316dc7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:27.021552 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727dfd2-4e7a-49df-bda2-0812316dc7a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:27.022301 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5727dfd2-4e7a-49df-bda2-0812316dc7a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:27.024022 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5727dfd2-4e7a-49df-bda2-0812316dc7a3 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:27.036905 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1100/2175] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:27.037055 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702a03e-7631-457e-8d4b-f067cf06684f admin admin] RBAC: Authorizing `identity:create_grant(project_id=be79397582244a3c99b38904f2352acd, user_id=5254f4a8f8214b2ba772845ef98d4491, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:27.037156 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727dfd2-4e7a-49df-bda2-0812316dc7a3 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:27.039028 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702a03e-7631-457e-8d4b-f067cf06684f admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:27.049852 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727dfd2-4e7a-49df-bda2-0812316dc7a3 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:27.054809 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1076/2176] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:00:26 2022] PUT /identity/v3/projects/be79397582244a3c99b38904f2352acd/users/5254f4a8f8214b2ba772845ef98d4491/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:27.056298 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d46c1-47b7-434b-b3d5-ef17d52581f1 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:27.056748 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d46c1-47b7-434b-b3d5-ef17d52581f1 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:27.057078 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d46c1-47b7-434b-b3d5-ef17d52581f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:27.091420 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-571d46c1-47b7-434b-b3d5-ef17d52581f1 None None] MFA Rules not processed for user `3817e06620a74685a2db4b8d5ea79cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:27.092851 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-571d46c1-47b7-434b-b3d5-ef17d52581f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:27.131074 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c04d4-1bf5-469f-b05b-b6fb54d14cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:27.131731 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c04d4-1bf5-469f-b05b-b6fb54d14cb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:27.132029 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c04d4-1bf5-469f-b05b-b6fb54d14cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:27.132301 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c04d4-1bf5-469f-b05b-b6fb54d14cb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:27.133714 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c04d4-1bf5-469f-b05b-b6fb54d14cb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:27.136021 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c04d4-1bf5-469f-b05b-b6fb54d14cb9 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:27.166106 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1101/2177] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:00:27 2022] POST /identity/v3/users => generated 298 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:27.166923 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c04d4-1bf5-469f-b05b-b6fb54d14cb9 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:27.186225 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c04d4-1bf5-469f-b05b-b6fb54d14cb9 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:27.190901 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1077/2178] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:27.191766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d46c1-47b7-434b-b3d5-ef17d52581f1 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:27.195386 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c56b24-c58c-43f6-940b-b2e798dd56e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:27.196133 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c56b24-c58c-43f6-940b-b2e798dd56e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:27.196314 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c56b24-c58c-43f6-940b-b2e798dd56e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:27.196581 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c56b24-c58c-43f6-940b-b2e798dd56e5 admin admin] PATH_INFO: `/v3/projects/824acceb737a426ba2a53da1c10246b0/users/7dde321ee4324de8abb42ea73f486ea9/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:27.205068 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d46c1-47b7-434b-b3d5-ef17d52581f1 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:27.210295 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dec3a7-abd6-4415-a65b-7e39dca8e65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:27.211011 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dec3a7-abd6-4415-a65b-7e39dca8e65e admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:27.212564 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c56b24-c58c-43f6-940b-b2e798dd56e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=824acceb737a426ba2a53da1c10246b0, user_id=7dde321ee4324de8abb42ea73f486ea9, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:27.213393 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dec3a7-abd6-4415-a65b-7e39dca8e65e admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:27.213721 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dec3a7-abd6-4415-a65b-7e39dca8e65e admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:27.214470 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dec3a7-abd6-4415-a65b-7e39dca8e65e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:27.216875 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dec3a7-abd6-4415-a65b-7e39dca8e65e admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:27.217521 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c56b24-c58c-43f6-940b-b2e798dd56e5 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:27.228196 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1078/2179] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:27.229109 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dec3a7-abd6-4415-a65b-7e39dca8e65e admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:27.230845 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-30dec3a7-abd6-4415-a65b-7e39dca8e65e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:27.235346 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1102/2180] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:00:27 2022] PUT /identity/v3/projects/824acceb737a426ba2a53da1c10246b0/users/7dde321ee4324de8abb42ea73f486ea9/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:27.241640 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c56b24-c58c-43f6-940b-b2e798dd56e5 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:27.244679 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dec3a7-abd6-4415-a65b-7e39dca8e65e admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:27.260672 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:27.296663 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:27.309344 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c56b24-c58c-43f6-940b-b2e798dd56e5 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:27.311786 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a520620-b832-48f2-b027-afcf32ccb90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:27.312563 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a520620-b832-48f2-b027-afcf32ccb90f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:27.312942 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a520620-b832-48f2-b027-afcf32ccb90f admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:27.313217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a520620-b832-48f2-b027-afcf32ccb90f admin admin] PATH_INFO: `/v3/projects/697dccacaa174167be28d649a6e2710a` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:27.314018 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eafb33-5c24-4de7-a09d-3d90c61a9355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:27.314370 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a520620-b832-48f2-b027-afcf32ccb90f admin admin] RBAC: Authorizing `identity:delete_project(project_id=697dccacaa174167be28d649a6e2710a)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:27.314633 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eafb33-5c24-4de7-a09d-3d90c61a9355 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:27.314918 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eafb33-5c24-4de7-a09d-3d90c61a9355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:27.315192 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eafb33-5c24-4de7-a09d-3d90c61a9355 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:27.315863 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eafb33-5c24-4de7-a09d-3d90c61a9355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:27.316374 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a520620-b832-48f2-b027-afcf32ccb90f admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:27.317478 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eafb33-5c24-4de7-a09d-3d90c61a9355 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:27.327622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1103/2181] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:27.328423 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eafb33-5c24-4de7-a09d-3d90c61a9355 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:27.338323 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eafb33-5c24-4de7-a09d-3d90c61a9355 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:27.344208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881343d-12d6-4c12-9ede-277d26bb122b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:27.344859 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881343d-12d6-4c12-9ede-277d26bb122b admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:27.345150 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881343d-12d6-4c12-9ede-277d26bb122b admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:27.345476 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881343d-12d6-4c12-9ede-277d26bb122b admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:27.346146 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c881343d-12d6-4c12-9ede-277d26bb122b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:27.348347 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c881343d-12d6-4c12-9ede-277d26bb122b admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:27.367297 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-7a520620-b832-48f2-b027-afcf32ccb90f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '697dccacaa174167be28d649a6e2710a', 'request_id': 'req-7a520620-b832-48f2-b027-afcf32ccb90f'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:27.373867 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-7a520620-b832-48f2-b027-afcf32ccb90f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '697dccacaa174167be28d649a6e2710a', 'request_id': 'req-7a520620-b832-48f2-b027-afcf32ccb90f'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:27.377429 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1104/2182] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:00:27 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:27.378472 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881343d-12d6-4c12-9ede-277d26bb122b admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:27.384337 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-7a520620-b832-48f2-b027-afcf32ccb90f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '697dccacaa174167be28d649a6e2710a', 'request_id': 'req-7a520620-b832-48f2-b027-afcf32ccb90f'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:27.399315 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-7a520620-b832-48f2-b027-afcf32ccb90f admin admin] The token cache is being invalidate because project 697dccacaa174167be28d649a6e2710a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:00:27.399638 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-7a520620-b832-48f2-b027-afcf32ccb90f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:27.400341 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-7a520620-b832-48f2-b027-afcf32ccb90f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:27.402091 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1079/2183] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:00:27 2022] DELETE /identity/v3/projects/697dccacaa174167be28d649a6e2710a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:27.403452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7d78b-de9f-40d3-a6eb-d894b3e5fdbd None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:27.404170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7d78b-de9f-40d3-a6eb-d894b3e5fdbd None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:27.404170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7d78b-de9f-40d3-a6eb-d894b3e5fdbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:27.434069 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-49c7d78b-de9f-40d3-a6eb-d894b3e5fdbd None None] MFA Rules not processed for user `7dde321ee4324de8abb42ea73f486ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:27.435824 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-49c7d78b-de9f-40d3-a6eb-d894b3e5fdbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:27.450848 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881343d-12d6-4c12-9ede-277d26bb122b admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:27.456143 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ab098-dae3-4c74-ac16-d7f169e5d289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:27.456833 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ab098-dae3-4c74-ac16-d7f169e5d289 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:27.457176 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ab098-dae3-4c74-ac16-d7f169e5d289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:27.457465 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ab098-dae3-4c74-ac16-d7f169e5d289 admin admin] PATH_INFO: `/v3/projects/be79397582244a3c99b38904f2352acd/users/5254f4a8f8214b2ba772845ef98d4491/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:27.459361 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ab098-dae3-4c74-ac16-d7f169e5d289 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be79397582244a3c99b38904f2352acd, user_id=5254f4a8f8214b2ba772845ef98d4491, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:27.462088 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ab098-dae3-4c74-ac16-d7f169e5d289 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:27.488103 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1105/2184] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:00:27 2022] PUT /identity/v3/projects/be79397582244a3c99b38904f2352acd/users/5254f4a8f8214b2ba772845ef98d4491/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:27.489469 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ab098-dae3-4c74-ac16-d7f169e5d289 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:27.491076 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-702ab098-dae3-4c74-ac16-d7f169e5d289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:27.510266 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1080/2185] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:27.511097 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7d78b-de9f-40d3-a6eb-d894b3e5fdbd None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:27.512387 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-49c7d78b-de9f-40d3-a6eb-d894b3e5fdbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:27.526403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7d78b-de9f-40d3-a6eb-d894b3e5fdbd None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:27.557225 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ab098-dae3-4c74-ac16-d7f169e5d289 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:27.562545 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094e110-49d7-4a64-a1f7-7ed73335c3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:27.563205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094e110-49d7-4a64-a1f7-7ed73335c3b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:27.563489 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094e110-49d7-4a64-a1f7-7ed73335c3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:27.563757 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094e110-49d7-4a64-a1f7-7ed73335c3b6 admin admin] PATH_INFO: `/v3/projects/b78dadc981ab47c5a764ee7536dad2a0/users/fee5a67fb36e403f8b41364ead2b1b43/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:27.578090 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5094e110-49d7-4a64-a1f7-7ed73335c3b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b78dadc981ab47c5a764ee7536dad2a0, user_id=fee5a67fb36e403f8b41364ead2b1b43, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:27.580732 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5094e110-49d7-4a64-a1f7-7ed73335c3b6 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:27.583661 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c14822c-1396-414d-a4b3-40a47bcf8ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:27.584418 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14822c-1396-414d-a4b3-40a47bcf8ceb admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:27.584864 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14822c-1396-414d-a4b3-40a47bcf8ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:27.585239 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14822c-1396-414d-a4b3-40a47bcf8ceb admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:27.586268 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c14822c-1396-414d-a4b3-40a47bcf8ceb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:27.589301 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c14822c-1396-414d-a4b3-40a47bcf8ceb admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:27.595439 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1106/2186] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:00:27 2022] PUT /identity/v3/projects/b78dadc981ab47c5a764ee7536dad2a0/users/fee5a67fb36e403f8b41364ead2b1b43/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:27.596975 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddd87a-4f27-42da-8ce9-1b4da0dcabca None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:27.597269 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddd87a-4f27-42da-8ce9-1b4da0dcabca None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:27.597601 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddd87a-4f27-42da-8ce9-1b4da0dcabca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:27.603329 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:27.616751 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1081/2187] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:00:27 2022] POST /identity/v3/users => generated 299 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:27.618022 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422307b2-5db6-434d-a3ac-256e597a0927 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:27.618329 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422307b2-5db6-434d-a3ac-256e597a0927 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:27.619045 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422307b2-5db6-434d-a3ac-256e597a0927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:27.620773 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-2cddd87a-4f27-42da-8ce9-1b4da0dcabca None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:27.622104 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-2cddd87a-4f27-42da-8ce9-1b4da0dcabca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:27.627119 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:27.648718 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-422307b2-5db6-434d-a3ac-256e597a0927 None None] MFA Rules not processed for user `5254f4a8f8214b2ba772845ef98d4491`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:27.650035 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-422307b2-5db6-434d-a3ac-256e597a0927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:27.684483 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1107/2188] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:27.686301 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cddd87a-4f27-42da-8ce9-1b4da0dcabca None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:27.687711 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-2cddd87a-4f27-42da-8ce9-1b4da0dcabca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:27.699974 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cddd87a-4f27-42da-8ce9-1b4da0dcabca None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:27.704705 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082a3fe-97ec-41ba-9661-66b47ff0c6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:27.705345 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082a3fe-97ec-41ba-9661-66b47ff0c6b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:27.705620 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082a3fe-97ec-41ba-9661-66b47ff0c6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:27.705892 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082a3fe-97ec-41ba-9661-66b47ff0c6b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:27.706531 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082a3fe-97ec-41ba-9661-66b47ff0c6b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:27.708423 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082a3fe-97ec-41ba-9661-66b47ff0c6b6 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:27.736343 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1082/2189] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:27 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:27.737582 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422307b2-5db6-434d-a3ac-256e597a0927 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:27.743059 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1108/2190] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:00:27 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:27.743954 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082a3fe-97ec-41ba-9661-66b47ff0c6b6 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:27.752156 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422307b2-5db6-434d-a3ac-256e597a0927 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:27.809427 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082a3fe-97ec-41ba-9661-66b47ff0c6b6 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:27.811997 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59fd46-07f4-4f18-9586-6fd8b03ded88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:27.812664 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59fd46-07f4-4f18-9586-6fd8b03ded88 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:27.812924 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59fd46-07f4-4f18-9586-6fd8b03ded88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:27.813201 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59fd46-07f4-4f18-9586-6fd8b03ded88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:27.813847 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59fd46-07f4-4f18-9586-6fd8b03ded88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:27.815066 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be428a4-8591-4a86-ac06-80758efb344b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:27.815451 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59fd46-07f4-4f18-9586-6fd8b03ded88 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:27.815668 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be428a4-8591-4a86-ac06-80758efb344b admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:27.815949 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be428a4-8591-4a86-ac06-80758efb344b admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:27.816221 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be428a4-8591-4a86-ac06-80758efb344b admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:27.816897 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be428a4-8591-4a86-ac06-80758efb344b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:27.818515 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be428a4-8591-4a86-ac06-80758efb344b admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:27.828147 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1083/2191] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:27.828147 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9acb2-be4f-4156-9931-92128aa9017e None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:27.828147 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9acb2-be4f-4156-9931-92128aa9017e None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:27.828147 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9acb2-be4f-4156-9931-92128aa9017e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:27.831791 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1109/2192] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:27.831791 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be428a4-8591-4a86-ac06-80758efb344b admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:27.839518 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be428a4-8591-4a86-ac06-80758efb344b admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:27.844921 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba53bfd-4854-44b1-a065-31b7dc51f8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:27.845510 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba53bfd-4854-44b1-a065-31b7dc51f8bc admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:27.845785 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba53bfd-4854-44b1-a065-31b7dc51f8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:27.846057 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba53bfd-4854-44b1-a065-31b7dc51f8bc admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:27.846682 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba53bfd-4854-44b1-a065-31b7dc51f8bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:27.848343 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-80a9acb2-be4f-4156-9931-92128aa9017e None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:27.848565 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba53bfd-4854-44b1-a065-31b7dc51f8bc admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:27.849559 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-80a9acb2-be4f-4156-9931-92128aa9017e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:27.858027 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1084/2193] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:27.858819 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9acb2-be4f-4156-9931-92128aa9017e None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:27.859997 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-80a9acb2-be4f-4156-9931-92128aa9017e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:27.878206 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1110/2194] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:00:27 2022] POST /identity/v3/users => generated 289 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:27.878206 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba53bfd-4854-44b1-a065-31b7dc51f8bc admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:27.886084 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba53bfd-4854-44b1-a065-31b7dc51f8bc admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:27.891977 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce465e73-68a5-41c7-a44e-a32c3a3fdff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:27.892616 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce465e73-68a5-41c7-a44e-a32c3a3fdff4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:27.892934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce465e73-68a5-41c7-a44e-a32c3a3fdff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:27.893211 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce465e73-68a5-41c7-a44e-a32c3a3fdff4 admin admin] PATH_INFO: `/v3/projects/988d7a6119364038bbfb65425c048d48/users/6a13acffc4564b59b918a0dc5ea40809/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:27.909026 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce465e73-68a5-41c7-a44e-a32c3a3fdff4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=988d7a6119364038bbfb65425c048d48, user_id=6a13acffc4564b59b918a0dc5ea40809, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:27.911673 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce465e73-68a5-41c7-a44e-a32c3a3fdff4 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:27.922099 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9acb2-be4f-4156-9931-92128aa9017e None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:27.931766 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1111/2195] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:00:27 2022] PUT /identity/v3/projects/988d7a6119364038bbfb65425c048d48/users/6a13acffc4564b59b918a0dc5ea40809/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:27.931766 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce465e73-68a5-41c7-a44e-a32c3a3fdff4 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:27.947343 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:27.974785 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60f5c2-3c3a-4ecc-bf3b-b3026f2cb3e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:27.975399 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60f5c2-3c3a-4ecc-bf3b-b3026f2cb3e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:27.975676 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60f5c2-3c3a-4ecc-bf3b-b3026f2cb3e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:27.975947 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60f5c2-3c3a-4ecc-bf3b-b3026f2cb3e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:27.980005 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:27.998171 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce465e73-68a5-41c7-a44e-a32c3a3fdff4 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:28.002719 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33596a-c5e5-4367-85b7-e0baa64d0c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:28.003380 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33596a-c5e5-4367-85b7-e0baa64d0c27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:28.003655 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33596a-c5e5-4367-85b7-e0baa64d0c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:28.003923 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33596a-c5e5-4367-85b7-e0baa64d0c27 admin admin] PATH_INFO: `/v3/projects/b78dadc981ab47c5a764ee7536dad2a0/users/fee5a67fb36e403f8b41364ead2b1b43/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:28.005922 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33596a-c5e5-4367-85b7-e0baa64d0c27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b78dadc981ab47c5a764ee7536dad2a0, user_id=fee5a67fb36e403f8b41364ead2b1b43, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:28.008876 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33596a-c5e5-4367-85b7-e0baa64d0c27 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:28.020400 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1112/2196] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:00:27 2022] PUT /identity/v3/projects/b78dadc981ab47c5a764ee7536dad2a0/users/fee5a67fb36e403f8b41364ead2b1b43/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:28.021634 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33596a-c5e5-4367-85b7-e0baa64d0c27 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:28.041718 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60f5c2-3c3a-4ecc-bf3b-b3026f2cb3e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:28.043457 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60f5c2-3c3a-4ecc-bf3b-b3026f2cb3e2 service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:28.053329 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1085/2197] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:27 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:00:28.054202 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60f5c2-3c3a-4ecc-bf3b-b3026f2cb3e2 service cinder] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:28.065264 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60f5c2-3c3a-4ecc-bf3b-b3026f2cb3e2 service cinder] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:28.095562 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33596a-c5e5-4367-85b7-e0baa64d0c27 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:28.100772 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82287c-e60a-48bb-b443-9f7e3177ec94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:28.101407 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82287c-e60a-48bb-b443-9f7e3177ec94 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:28.101689 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82287c-e60a-48bb-b443-9f7e3177ec94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:28.101968 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82287c-e60a-48bb-b443-9f7e3177ec94 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:28.102625 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a82287c-e60a-48bb-b443-9f7e3177ec94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:00:28.103306 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a82287c-e60a-48bb-b443-9f7e3177ec94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:28.104528 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a82287c-e60a-48bb-b443-9f7e3177ec94 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:28.119593 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1113/2198] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 16:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:00:28.121044 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82287c-e60a-48bb-b443-9f7e3177ec94 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:28.133946 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82287c-e60a-48bb-b443-9f7e3177ec94 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:28.140773 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f412324-dc60-432a-80a4-dd9f98b169b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:28.141598 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f412324-dc60-432a-80a4-dd9f98b169b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:28.141999 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f412324-dc60-432a-80a4-dd9f98b169b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:28.142328 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f412324-dc60-432a-80a4-dd9f98b169b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:28.143053 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f412324-dc60-432a-80a4-dd9f98b169b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:28.144755 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f412324-dc60-432a-80a4-dd9f98b169b5 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:28.149828 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81efec-1bb7-49c0-af4b-74af3b8f5006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:28.150781 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81efec-1bb7-49c0-af4b-74af3b8f5006 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:28.151066 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81efec-1bb7-49c0-af4b-74af3b8f5006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:28.151336 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81efec-1bb7-49c0-af4b-74af3b8f5006 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:28.151998 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e81efec-1bb7-49c0-af4b-74af3b8f5006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:28.153916 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e81efec-1bb7-49c0-af4b-74af3b8f5006 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:28.160157 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1114/2199] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:28.160714 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0c1dc-b7a2-4378-99bf-17d2c4dd3258 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:28.161044 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0c1dc-b7a2-4378-99bf-17d2c4dd3258 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:28.161387 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0c1dc-b7a2-4378-99bf-17d2c4dd3258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:28.176031 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1086/2200] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:28.176603 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81efec-1bb7-49c0-af4b-74af3b8f5006 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:28.190424 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81efec-1bb7-49c0-af4b-74af3b8f5006 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:28.194566 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-b8e0c1dc-b7a2-4378-99bf-17d2c4dd3258 None None] MFA Rules not processed for user `fee5a67fb36e403f8b41364ead2b1b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:28.196365 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95bb1b-9d1d-4252-9edc-b4e1390115df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:28.196365 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95bb1b-9d1d-4252-9edc-b4e1390115df admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:28.196615 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-b8e0c1dc-b7a2-4378-99bf-17d2c4dd3258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:28.196833 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95bb1b-9d1d-4252-9edc-b4e1390115df admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:28.196833 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95bb1b-9d1d-4252-9edc-b4e1390115df admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:28.197501 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95bb1b-9d1d-4252-9edc-b4e1390115df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:28.199756 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95bb1b-9d1d-4252-9edc-b4e1390115df admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:28.233378 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1087/2201] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:00:28 2022] POST /identity/v3/projects => generated 367 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:28.234657 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95bb1b-9d1d-4252-9edc-b4e1390115df admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:28.285005 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1115/2202] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:28 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:28.286106 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0c1dc-b7a2-4378-99bf-17d2c4dd3258 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:28.303385 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0c1dc-b7a2-4378-99bf-17d2c4dd3258 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:28.305734 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95bb1b-9d1d-4252-9edc-b4e1390115df admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:28.311452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e46543-83fb-408d-9964-33199f21bee3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:28.312097 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e46543-83fb-408d-9964-33199f21bee3 service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:28.312381 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e46543-83fb-408d-9964-33199f21bee3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:28.312740 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e46543-83fb-408d-9964-33199f21bee3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:28.314725 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-e9e46543-83fb-408d-9964-33199f21bee3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:28.320899 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:28.353561 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:28.370036 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f3e97-27fc-482d-a42c-5125bd5adfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:28.370700 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f3e97-27fc-482d-a42c-5125bd5adfbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:28.370976 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f3e97-27fc-482d-a42c-5125bd5adfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:28.371244 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f3e97-27fc-482d-a42c-5125bd5adfbb admin admin] PATH_INFO: `/v3/projects/988d7a6119364038bbfb65425c048d48/users/6a13acffc4564b59b918a0dc5ea40809/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:28.373800 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f3e97-27fc-482d-a42c-5125bd5adfbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=988d7a6119364038bbfb65425c048d48, user_id=6a13acffc4564b59b918a0dc5ea40809, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:28.376451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f3e97-27fc-482d-a42c-5125bd5adfbb admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:28.387202 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1116/2203] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:00:28 2022] PUT /identity/v3/projects/988d7a6119364038bbfb65425c048d48/users/6a13acffc4564b59b918a0dc5ea40809/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:28.388031 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f3e97-27fc-482d-a42c-5125bd5adfbb admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:28.388395 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e46543-83fb-408d-9964-33199f21bee3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:28.389984 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e46543-83fb-408d-9964-33199f21bee3 service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:28.399768 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1088/2204] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:00:28.400549 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e46543-83fb-408d-9964-33199f21bee3 service cinder] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:28.411864 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e46543-83fb-408d-9964-33199f21bee3 service cinder] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:28.468220 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f3e97-27fc-482d-a42c-5125bd5adfbb admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:28.474021 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f929fee-738e-4e1b-9411-a1de08a7811e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:28.474679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f929fee-738e-4e1b-9411-a1de08a7811e admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:28.474969 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f929fee-738e-4e1b-9411-a1de08a7811e admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:28.475229 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f929fee-738e-4e1b-9411-a1de08a7811e admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:28.475919 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f929fee-738e-4e1b-9411-a1de08a7811e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:28.477553 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f929fee-738e-4e1b-9411-a1de08a7811e admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:28.478213 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc8453-313b-468b-9142-65735bd9aed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:28.478963 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc8453-313b-468b-9142-65735bd9aed7 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:28.479304 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc8453-313b-468b-9142-65735bd9aed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:28.479645 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc8453-313b-468b-9142-65735bd9aed7 admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:28.480387 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc8453-313b-468b-9142-65735bd9aed7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:28.482715 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc8453-313b-468b-9142-65735bd9aed7 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:28.489392 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1117/2205] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:28.490302 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f929fee-738e-4e1b-9411-a1de08a7811e admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:28.491960 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-5f929fee-738e-4e1b-9411-a1de08a7811e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:28.513177 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1089/2206] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:00:28 2022] POST /identity/v3/users => generated 284 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:28.513177 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe8bae-9208-4582-8f1c-75eb0f28797b None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:28.513177 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe8bae-9208-4582-8f1c-75eb0f28797b None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:28.517284 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe8bae-9208-4582-8f1c-75eb0f28797b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:28.560150 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f929fee-738e-4e1b-9411-a1de08a7811e admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:28.564048 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10677557-2c87-469a-b681-b1d83ad52a82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:28.564821 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10677557-2c87-469a-b681-b1d83ad52a82 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:28.565163 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10677557-2c87-469a-b681-b1d83ad52a82 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:28.565501 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10677557-2c87-469a-b681-b1d83ad52a82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:28.567369 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-10677557-2c87-469a-b681-b1d83ad52a82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:28.571983 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-7cfe8bae-9208-4582-8f1c-75eb0f28797b None None] MFA Rules not processed for user `6a13acffc4564b59b918a0dc5ea40809`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:28.573111 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-7cfe8bae-9208-4582-8f1c-75eb0f28797b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:28.647434 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10677557-2c87-469a-b681-b1d83ad52a82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:28.648972 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10677557-2c87-469a-b681-b1d83ad52a82 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:28.659897 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1118/2207] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:00:28.660887 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10677557-2c87-469a-b681-b1d83ad52a82 service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:28.662815 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1090/2208] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:28 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:28.663469 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe8bae-9208-4582-8f1c-75eb0f28797b None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:28.675404 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe8bae-9208-4582-8f1c-75eb0f28797b None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:28.676321 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10677557-2c87-469a-b681-b1d83ad52a82 service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:28.680822 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c5d0c-2aab-4963-89ca-e723f8b653cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:28.681043 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881271b-5085-4a4f-900f-d5eb37605ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:28.681424 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c5d0c-2aab-4963-89ca-e723f8b653cb admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:28.681704 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881271b-5085-4a4f-900f-d5eb37605ecc admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:28.681815 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c5d0c-2aab-4963-89ca-e723f8b653cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:28.681974 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c5d0c-2aab-4963-89ca-e723f8b653cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:28.682085 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881271b-5085-4a4f-900f-d5eb37605ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:28.682246 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881271b-5085-4a4f-900f-d5eb37605ecc admin admin] PATH_INFO: `/v3/projects/6e8bd8d8d1884f5ea6c0f0b8cf633b2c/users/f3b9a7a71cf246eb92a4393700bf8b05/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:28.682623 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c5d0c-2aab-4963-89ca-e723f8b653cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:28.684222 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c5d0c-2aab-4963-89ca-e723f8b653cb admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:28.699213 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1091/2209] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:28.699213 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c5d0c-2aab-4963-89ca-e723f8b653cb admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:28.699585 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d881271b-5085-4a4f-900f-d5eb37605ecc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e8bd8d8d1884f5ea6c0f0b8cf633b2c, user_id=f3b9a7a71cf246eb92a4393700bf8b05, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:28.702954 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d881271b-5085-4a4f-900f-d5eb37605ecc admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:28.714178 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c5d0c-2aab-4963-89ca-e723f8b653cb admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:28.720240 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:28.732854 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1119/2210] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:00:28 2022] PUT /identity/v3/projects/6e8bd8d8d1884f5ea6c0f0b8cf633b2c/users/f3b9a7a71cf246eb92a4393700bf8b05/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:28.732854 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881271b-5085-4a4f-900f-d5eb37605ecc admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:28.737592 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:28.786465 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc660f-343f-49f1-8d78-d6d804b7c264 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:28.787677 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc660f-343f-49f1-8d78-d6d804b7c264 service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:28.788110 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc660f-343f-49f1-8d78-d6d804b7c264 service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:28.788656 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc660f-343f-49f1-8d78-d6d804b7c264 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:28.790968 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-babc660f-343f-49f1-8d78-d6d804b7c264 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:28.805124 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881271b-5085-4a4f-900f-d5eb37605ecc admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:28.810676 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a37c5-c853-4b80-ae88-d2f670d3502f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:28.811548 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a37c5-c853-4b80-ae88-d2f670d3502f admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:28.811827 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a37c5-c853-4b80-ae88-d2f670d3502f admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:28.812097 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a37c5-c853-4b80-ae88-d2f670d3502f admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:28.812742 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a37c5-c853-4b80-ae88-d2f670d3502f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:28.814588 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a37c5-c853-4b80-ae88-d2f670d3502f admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:28.830536 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1120/2211] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:28.830536 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d55ed-6e8d-41be-9f06-77c09a843369 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:28.830536 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d55ed-6e8d-41be-9f06-77c09a843369 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:28.830536 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d55ed-6e8d-41be-9f06-77c09a843369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:28.864362 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-271d55ed-6e8d-41be-9f06-77c09a843369 None None] MFA Rules not processed for user `f3b9a7a71cf246eb92a4393700bf8b05`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:28.865717 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-271d55ed-6e8d-41be-9f06-77c09a843369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:28.867274 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babc660f-343f-49f1-8d78-d6d804b7c264 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:28.868817 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babc660f-343f-49f1-8d78-d6d804b7c264 service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:28.879126 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1092/2212] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:28 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:00:28.880293 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc660f-343f-49f1-8d78-d6d804b7c264 service cinder] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:28.892023 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc660f-343f-49f1-8d78-d6d804b7c264 service cinder] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:28.898511 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40c06f-1076-42c7-a8f0-4b11f60ce130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:28.899291 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40c06f-1076-42c7-a8f0-4b11f60ce130 admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:28.899702 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40c06f-1076-42c7-a8f0-4b11f60ce130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:28.900050 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40c06f-1076-42c7-a8f0-4b11f60ce130 admin admin] PATH_INFO: `/v3/projects/903eafa801064beca93415f995030db9/users/cec64878d27a45a296b451b5d9e32ab6/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:28.923420 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40c06f-1076-42c7-a8f0-4b11f60ce130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=903eafa801064beca93415f995030db9, user_id=cec64878d27a45a296b451b5d9e32ab6, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:28.928388 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40c06f-1076-42c7-a8f0-4b11f60ce130 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:28.946270 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1121/2213] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:28.946455 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1093/2214] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:00:28 2022] PUT /identity/v3/projects/903eafa801064beca93415f995030db9/users/cec64878d27a45a296b451b5d9e32ab6/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:28.953055 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d55ed-6e8d-41be-9f06-77c09a843369 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:28.961587 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31068028-632b-4097-8cdd-541960352301 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:28.961880 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31068028-632b-4097-8cdd-541960352301 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:28.962153 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31068028-632b-4097-8cdd-541960352301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:28.984136 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d55ed-6e8d-41be-9f06-77c09a843369 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:29.010941 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-31068028-632b-4097-8cdd-541960352301 None None] MFA Rules not processed for user `cec64878d27a45a296b451b5d9e32ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:29.012034 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-31068028-632b-4097-8cdd-541960352301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:29.083882 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4cd9f4-5902-4db9-9d83-b367cd565176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:29.084687 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4cd9f4-5902-4db9-9d83-b367cd565176 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:29.085110 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4cd9f4-5902-4db9-9d83-b367cd565176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:29.086402 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4cd9f4-5902-4db9-9d83-b367cd565176 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:29.087190 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4cd9f4-5902-4db9-9d83-b367cd565176 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:29.089890 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4cd9f4-5902-4db9-9d83-b367cd565176 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:29.126068 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1122/2215] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:00:28 2022] POST /identity/v3/projects => generated 377 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:29.132067 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1094/2216] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:00:29.132542 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4cd9f4-5902-4db9-9d83-b367cd565176 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:29.133309 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31068028-632b-4097-8cdd-541960352301 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:29.143914 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31068028-632b-4097-8cdd-541960352301 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:29.150166 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:29.177417 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:29.226070 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4cd9f4-5902-4db9-9d83-b367cd565176 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:29.226229 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4fd4b-00a3-4351-9c4e-bba5264198a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:29.226760 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4fd4b-00a3-4351-9c4e-bba5264198a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:29.227040 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4fd4b-00a3-4351-9c4e-bba5264198a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:29.227317 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4fd4b-00a3-4351-9c4e-bba5264198a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:29.227947 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad4fd4b-00a3-4351-9c4e-bba5264198a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:29.229958 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad4fd4b-00a3-4351-9c4e-bba5264198a2 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:29.235108 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e19ea3-3dc4-491e-be12-12795ef2ed1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:29.236022 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e19ea3-3dc4-491e-be12-12795ef2ed1f admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:29.236485 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e19ea3-3dc4-491e-be12-12795ef2ed1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:29.237076 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e19ea3-3dc4-491e-be12-12795ef2ed1f admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:29.238153 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e19ea3-3dc4-491e-be12-12795ef2ed1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:29.240320 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e19ea3-3dc4-491e-be12-12795ef2ed1f admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:29.268089 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1123/2217] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:00:29 2022] POST /identity/v3/users => generated 295 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:00:29.274813 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1095/2218] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:00:29 2022] POST /identity/v3/projects => generated 367 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:00:29.278178 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e19ea3-3dc4-491e-be12-12795ef2ed1f admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:29.278328 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4fd4b-00a3-4351-9c4e-bba5264198a2 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:29.291866 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e19ea3-3dc4-491e-be12-12795ef2ed1f admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:29.342501 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4fd4b-00a3-4351-9c4e-bba5264198a2 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:29.347797 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53916a6-f7ff-4ba3-929c-5f1f5770ecf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:29.348405 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53916a6-f7ff-4ba3-929c-5f1f5770ecf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:29.348843 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53916a6-f7ff-4ba3-929c-5f1f5770ecf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:29.349119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53916a6-f7ff-4ba3-929c-5f1f5770ecf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:29.349761 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53916a6-f7ff-4ba3-929c-5f1f5770ecf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:29.350980 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd4225-5b6f-4f2f-af6e-04a446a10e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:29.351351 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53916a6-f7ff-4ba3-929c-5f1f5770ecf1 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:29.351591 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd4225-5b6f-4f2f-af6e-04a446a10e82 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:29.351868 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd4225-5b6f-4f2f-af6e-04a446a10e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:29.352166 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd4225-5b6f-4f2f-af6e-04a446a10e82 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:29.352892 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd4225-5b6f-4f2f-af6e-04a446a10e82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:29.355006 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd4225-5b6f-4f2f-af6e-04a446a10e82 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:29.364938 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1096/2219] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:29.366110 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53916a6-f7ff-4ba3-929c-5f1f5770ecf1 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:29.377812 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53916a6-f7ff-4ba3-929c-5f1f5770ecf1 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:29.386159 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1124/2220] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:00:29 2022] POST /identity/v3/users => generated 290 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:29.386318 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e540421-244b-49f3-8d4b-5544750995cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:29.386318 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e540421-244b-49f3-8d4b-5544750995cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:29.386318 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e540421-244b-49f3-8d4b-5544750995cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:29.386318 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e540421-244b-49f3-8d4b-5544750995cc admin admin] PATH_INFO: `/v3/projects/e344a938bf314704a6613608afb04c25/users/268cced3ccab42dabb0ff527497ca9e3/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:29.387150 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd4225-5b6f-4f2f-af6e-04a446a10e82 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:29.400197 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd4225-5b6f-4f2f-af6e-04a446a10e82 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:29.400853 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e540421-244b-49f3-8d4b-5544750995cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e344a938bf314704a6613608afb04c25, user_id=268cced3ccab42dabb0ff527497ca9e3, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:29.403782 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e540421-244b-49f3-8d4b-5544750995cc admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:29.405354 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ab4d4-0790-4542-b096-5eab76d43ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:29.405961 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ab4d4-0790-4542-b096-5eab76d43ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:29.406273 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ab4d4-0790-4542-b096-5eab76d43ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:29.406735 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ab4d4-0790-4542-b096-5eab76d43ea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:29.407392 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ab4d4-0790-4542-b096-5eab76d43ea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:29.409117 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ab4d4-0790-4542-b096-5eab76d43ea3 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:29.422323 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1097/2221] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:00:29 2022] PUT /identity/v3/projects/e344a938bf314704a6613608afb04c25/users/268cced3ccab42dabb0ff527497ca9e3/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:00:29.422504 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1125/2222] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:29.425517 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ab4d4-0790-4542-b096-5eab76d43ea3 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:29.425628 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e540421-244b-49f3-8d4b-5544750995cc admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:29.436993 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ab4d4-0790-4542-b096-5eab76d43ea3 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:29.500420 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e540421-244b-49f3-8d4b-5544750995cc admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:29.505582 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857bd523-a176-49f7-a5a0-fab0d3f39531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:29.506197 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bd523-a176-49f7-a5a0-fab0d3f39531 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:29.506480 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bd523-a176-49f7-a5a0-fab0d3f39531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:29.506885 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bd523-a176-49f7-a5a0-fab0d3f39531 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:29.507551 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857bd523-a176-49f7-a5a0-fab0d3f39531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:29.508019 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1293f77-6c19-4a0c-a93a-78fa6d319bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:29.509011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1293f77-6c19-4a0c-a93a-78fa6d319bd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:29.509294 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1293f77-6c19-4a0c-a93a-78fa6d319bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:29.509571 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1293f77-6c19-4a0c-a93a-78fa6d319bd9 admin admin] PATH_INFO: `/v3/projects/3e6fdf08c87b432f9a65dc767fa06328/users/d3b5f4a3ef3c4ae9a31ae9124ea152cf/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:29.509675 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857bd523-a176-49f7-a5a0-fab0d3f39531 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:29.523260 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1098/2223] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:29.526035 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1293f77-6c19-4a0c-a93a-78fa6d319bd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e6fdf08c87b432f9a65dc767fa06328, user_id=d3b5f4a3ef3c4ae9a31ae9124ea152cf, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:29.527964 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857bd523-a176-49f7-a5a0-fab0d3f39531 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:29.529760 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1293f77-6c19-4a0c-a93a-78fa6d319bd9 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:29.542688 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857bd523-a176-49f7-a5a0-fab0d3f39531 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:29.553487 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1126/2224] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:00:29 2022] PUT /identity/v3/projects/3e6fdf08c87b432f9a65dc767fa06328/users/d3b5f4a3ef3c4ae9a31ae9124ea152cf/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:29.553487 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1293f77-6c19-4a0c-a93a-78fa6d319bd9 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:29.560126 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:29.567078 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:29.609746 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52b39c-8763-425f-9b6f-eca77367cc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:29.610524 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52b39c-8763-425f-9b6f-eca77367cc20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:29.610867 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52b39c-8763-425f-9b6f-eca77367cc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:29.611240 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52b39c-8763-425f-9b6f-eca77367cc20 admin admin] PATH_INFO: `/v3/projects/e344a938bf314704a6613608afb04c25/users/268cced3ccab42dabb0ff527497ca9e3/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:29.613256 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52b39c-8763-425f-9b6f-eca77367cc20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e344a938bf314704a6613608afb04c25, user_id=268cced3ccab42dabb0ff527497ca9e3, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:29.616373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52b39c-8763-425f-9b6f-eca77367cc20 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:29.620554 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1293f77-6c19-4a0c-a93a-78fa6d319bd9 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:29.634279 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1099/2225] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:00:29 2022] PUT /identity/v3/projects/e344a938bf314704a6613608afb04c25/users/268cced3ccab42dabb0ff527497ca9e3/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:29.644423 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cae91-a508-4eb0-b249-a3fe1b821c84 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:29.644709 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cae91-a508-4eb0-b249-a3fe1b821c84 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:29.645020 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cae91-a508-4eb0-b249-a3fe1b821c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:29.680690 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8630d-0b6c-4a88-82cd-ce21aaa92c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:29.681346 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8630d-0b6c-4a88-82cd-ce21aaa92c5c admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:29.681628 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8630d-0b6c-4a88-82cd-ce21aaa92c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:29.681901 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8630d-0b6c-4a88-82cd-ce21aaa92c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:29.682553 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a8630d-0b6c-4a88-82cd-ce21aaa92c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:29.683211 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-af1cae91-a508-4eb0-b249-a3fe1b821c84 None None] MFA Rules not processed for user `268cced3ccab42dabb0ff527497ca9e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:29.684149 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a8630d-0b6c-4a88-82cd-ce21aaa92c5c admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:29.684709 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-af1cae91-a508-4eb0-b249-a3fe1b821c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:29.695940 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1127/2226] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:00:29.700290 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8630d-0b6c-4a88-82cd-ce21aaa92c5c admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:29.711291 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8630d-0b6c-4a88-82cd-ce21aaa92c5c admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:29.716955 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c6897-cdc9-44e1-9a1e-5d8d4a7b7e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:29.717618 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c6897-cdc9-44e1-9a1e-5d8d4a7b7e8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:29.717900 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c6897-cdc9-44e1-9a1e-5d8d4a7b7e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:29.718169 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c6897-cdc9-44e1-9a1e-5d8d4a7b7e8d admin admin] PATH_INFO: `/v3/projects/3e6fdf08c87b432f9a65dc767fa06328/users/d3b5f4a3ef3c4ae9a31ae9124ea152cf/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:29.720094 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c6897-cdc9-44e1-9a1e-5d8d4a7b7e8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e6fdf08c87b432f9a65dc767fa06328, user_id=d3b5f4a3ef3c4ae9a31ae9124ea152cf, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:29.723032 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c6897-cdc9-44e1-9a1e-5d8d4a7b7e8d admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:29.738399 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1128/2227] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:00:29 2022] PUT /identity/v3/projects/3e6fdf08c87b432f9a65dc767fa06328/users/d3b5f4a3ef3c4ae9a31ae9124ea152cf/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:29.749318 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e09f4-ccf9-4359-8f75-baae7d2cee57 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:29.750102 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e09f4-ccf9-4359-8f75-baae7d2cee57 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:29.750382 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e09f4-ccf9-4359-8f75-baae7d2cee57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:29.779881 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1100/2228] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:29 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:00:29.784311 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-7c3e09f4-ccf9-4359-8f75-baae7d2cee57 None None] MFA Rules not processed for user `d3b5f4a3ef3c4ae9a31ae9124ea152cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:29.785876 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7c3e09f4-ccf9-4359-8f75-baae7d2cee57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:29.787543 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cae91-a508-4eb0-b249-a3fe1b821c84 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:29.851759 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cae91-a508-4eb0-b249-a3fe1b821c84 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:29.875029 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1129/2229] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:00:29.911758 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d1c3a-1784-4373-bb3f-7f6d98f3b3c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:29.912503 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d1c3a-1784-4373-bb3f-7f6d98f3b3c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:29.912908 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d1c3a-1784-4373-bb3f-7f6d98f3b3c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:29.913236 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d1c3a-1784-4373-bb3f-7f6d98f3b3c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:29.924492 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:29.985099 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e09f4-ccf9-4359-8f75-baae7d2cee57 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:29.985197 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d1c3a-1784-4373-bb3f-7f6d98f3b3c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:29.989268 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d1c3a-1784-4373-bb3f-7f6d98f3b3c2 service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:29.992662 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e09f4-ccf9-4359-8f75-baae7d2cee57 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:29.996828 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1101/2230] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:00:29.997033 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f5860-289c-467f-9aff-969b36cfed3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:29.997388 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f5860-289c-467f-9aff-969b36cfed3b service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:29.997671 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f5860-289c-467f-9aff-969b36cfed3b service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:29.998000 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f5860-289c-467f-9aff-969b36cfed3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:30.007654 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f5860-289c-467f-9aff-969b36cfed3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:30.009601 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f5860-289c-467f-9aff-969b36cfed3b service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:30.021726 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1130/2231] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:00:30.257549 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d1c3a-1784-4373-bb3f-7f6d98f3b3c2 service cinder] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:30.267125 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d1c3a-1784-4373-bb3f-7f6d98f3b3c2 service cinder] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:30.275686 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3f515-aaec-4a6a-a036-969136ec6f57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:30.276374 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3f515-aaec-4a6a-a036-969136ec6f57 service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:30.276718 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3f515-aaec-4a6a-a036-969136ec6f57 service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:30.277097 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3f515-aaec-4a6a-a036-969136ec6f57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:30.363500 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e3f515-aaec-4a6a-a036-969136ec6f57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:30.365760 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e3f515-aaec-4a6a-a036-969136ec6f57 service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:30.374574 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1102/2232] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:00:30.525100 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f5860-289c-467f-9aff-969b36cfed3b service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:30.535303 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f5860-289c-467f-9aff-969b36cfed3b service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:30.539038 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9beb18-6182-43fb-8da0-27942407ac0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:30.539646 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9beb18-6182-43fb-8da0-27942407ac0a service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:30.539928 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9beb18-6182-43fb-8da0-27942407ac0a service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:30.540201 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9beb18-6182-43fb-8da0-27942407ac0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:30.542077 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-1e9beb18-6182-43fb-8da0-27942407ac0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:30.549409 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:30.617066 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9beb18-6182-43fb-8da0-27942407ac0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:30.618545 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9beb18-6182-43fb-8da0-27942407ac0a service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:30.630126 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1131/2233] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:00:30.796870 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3f515-aaec-4a6a-a036-969136ec6f57 service cinder] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:30.807227 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3f515-aaec-4a6a-a036-969136ec6f57 service cinder] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:30.812124 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d172820-b611-4785-9470-a3850fc3832a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:30.812959 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d172820-b611-4785-9470-a3850fc3832a service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:30.813339 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d172820-b611-4785-9470-a3850fc3832a service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:30.813733 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d172820-b611-4785-9470-a3850fc3832a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:30.816426 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-4d172820-b611-4785-9470-a3850fc3832a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:30.881452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d172820-b611-4785-9470-a3850fc3832a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:30.883443 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d172820-b611-4785-9470-a3850fc3832a service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:30.894231 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1103/2234] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:00:31.573011 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9beb18-6182-43fb-8da0-27942407ac0a service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:31.582190 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9beb18-6182-43fb-8da0-27942407ac0a service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:31.587121 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3821f-9e51-4897-ae1f-d1b47354ede0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:31.587842 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3821f-9e51-4897-ae1f-d1b47354ede0 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:31.588226 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3821f-9e51-4897-ae1f-d1b47354ede0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:31.588574 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3821f-9e51-4897-ae1f-d1b47354ede0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:31.664567 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3821f-9e51-4897-ae1f-d1b47354ede0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:31.666511 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3821f-9e51-4897-ae1f-d1b47354ede0 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:31.677252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1132/2235] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:31 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:00:31.914092 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d172820-b611-4785-9470-a3850fc3832a service cinder] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:31.927586 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d172820-b611-4785-9470-a3850fc3832a service cinder] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:31.931569 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888dfd79-e625-442f-a40f-4322e2b7f9ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:31.932358 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dfd79-e625-442f-a40f-4322e2b7f9ca service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:31.932689 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dfd79-e625-442f-a40f-4322e2b7f9ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:31.933061 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dfd79-e625-442f-a40f-4322e2b7f9ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:31.984174 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:32.000669 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888dfd79-e625-442f-a40f-4322e2b7f9ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:32.003057 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888dfd79-e625-442f-a40f-4322e2b7f9ca service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:32.017368 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1104/2236] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:00:32.146770 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3821f-9e51-4897-ae1f-d1b47354ede0 service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:32.158630 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3821f-9e51-4897-ae1f-d1b47354ede0 service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:32.164644 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35b298-28da-4c1d-b990-d28e08778724 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:32.165703 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35b298-28da-4c1d-b990-d28e08778724 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:32.166145 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35b298-28da-4c1d-b990-d28e08778724 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:32.166567 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35b298-28da-4c1d-b990-d28e08778724 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:32.239781 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb35b298-28da-4c1d-b990-d28e08778724 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:32.241971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb35b298-28da-4c1d-b990-d28e08778724 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:32.252770 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1133/2237] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:32 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:00:32.678759 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888dfd79-e625-442f-a40f-4322e2b7f9ca service cinder] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:32.688632 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888dfd79-e625-442f-a40f-4322e2b7f9ca service cinder] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:32.693504 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c66642-8d52-49b9-ba09-ebb164f5e4e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:32.694130 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c66642-8d52-49b9-ba09-ebb164f5e4e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:32.694404 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c66642-8d52-49b9-ba09-ebb164f5e4e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:32.694677 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c66642-8d52-49b9-ba09-ebb164f5e4e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:32.765094 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c66642-8d52-49b9-ba09-ebb164f5e4e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:32.766536 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c66642-8d52-49b9-ba09-ebb164f5e4e3 service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:32.776299 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1105/2238] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:32 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:00:35.919272 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35b298-28da-4c1d-b990-d28e08778724 service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:35.962024 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:35.986563 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35b298-28da-4c1d-b990-d28e08778724 service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:35.992256 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fcb9a3-4ef9-45c9-a63f-37cb48548ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:35.992969 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcb9a3-4ef9-45c9-a63f-37cb48548ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:35.993194 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcb9a3-4ef9-45c9-a63f-37cb48548ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:35.993478 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcb9a3-4ef9-45c9-a63f-37cb48548ab6 admin admin] PATH_INFO: `/v3/users/be76686ee9dc43d1a7410b91c9c067e8` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:35.994747 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fcb9a3-4ef9-45c9-a63f-37cb48548ab6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be76686ee9dc43d1a7410b91c9c067e8)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:35.997008 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fcb9a3-4ef9-45c9-a63f-37cb48548ab6 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:36.055148 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-85fcb9a3-4ef9-45c9-a63f-37cb48548ab6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be76686ee9dc43d1a7410b91c9c067e8'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:36.055810 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-85fcb9a3-4ef9-45c9-a63f-37cb48548ab6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be76686ee9dc43d1a7410b91c9c067e8'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:36.064835 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-85fcb9a3-4ef9-45c9-a63f-37cb48548ab6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be76686ee9dc43d1a7410b91c9c067e8'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:36.078633 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-85fcb9a3-4ef9-45c9-a63f-37cb48548ab6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be76686ee9dc43d1a7410b91c9c067e8'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:36.087215 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-85fcb9a3-4ef9-45c9-a63f-37cb48548ab6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be76686ee9dc43d1a7410b91c9c067e8'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:36.094283 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1134/2239] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:00:35 2022] DELETE /identity/v3/users/be76686ee9dc43d1a7410b91c9c067e8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:36.099067 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8202fc-797b-41b7-a8cb-0860ab43f4ef None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:36.099548 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8202fc-797b-41b7-a8cb-0860ab43f4ef None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:36.099657 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8202fc-797b-41b7-a8cb-0860ab43f4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:36.123312 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-6d8202fc-797b-41b7-a8cb-0860ab43f4ef None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:36.124698 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-6d8202fc-797b-41b7-a8cb-0860ab43f4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:36.202955 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1106/2240] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:00:36.213918 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fcb9a3-4ef9-45c9-a63f-37cb48548ab6 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:36.218341 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-85fcb9a3-4ef9-45c9-a63f-37cb48548ab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:36.296553 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fcb9a3-4ef9-45c9-a63f-37cb48548ab6 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:36.303799 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c503438-139c-4edc-98ee-fcced0fbc3e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:36.304576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c503438-139c-4edc-98ee-fcced0fbc3e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:36.305006 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c503438-139c-4edc-98ee-fcced0fbc3e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:36.305285 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c503438-139c-4edc-98ee-fcced0fbc3e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:36.317323 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c503438-139c-4edc-98ee-fcced0fbc3e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:36.318758 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c503438-139c-4edc-98ee-fcced0fbc3e6 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:36.329251 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1135/2241] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:00:36.672028 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8202fc-797b-41b7-a8cb-0860ab43f4ef None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:36.673808 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-6d8202fc-797b-41b7-a8cb-0860ab43f4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:36.710729 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8202fc-797b-41b7-a8cb-0860ab43f4ef None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:36.733356 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b861b-b6a7-4e79-a601-7f483d86bd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:36.734008 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b861b-b6a7-4e79-a601-7f483d86bd29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:36.735089 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b861b-b6a7-4e79-a601-7f483d86bd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:36.735361 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b861b-b6a7-4e79-a601-7f483d86bd29 admin admin] PATH_INFO: `/v3/projects/bdd8b08e9eac449ba23ea170fc6202c3` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:36.736809 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b861b-b6a7-4e79-a601-7f483d86bd29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdd8b08e9eac449ba23ea170fc6202c3)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:36.739586 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b861b-b6a7-4e79-a601-7f483d86bd29 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:36.819210 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-825b861b-b6a7-4e79-a601-7f483d86bd29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdd8b08e9eac449ba23ea170fc6202c3', 'request_id': 'req-825b861b-b6a7-4e79-a601-7f483d86bd29'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:36.826834 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-825b861b-b6a7-4e79-a601-7f483d86bd29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdd8b08e9eac449ba23ea170fc6202c3', 'request_id': 'req-825b861b-b6a7-4e79-a601-7f483d86bd29'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:36.838717 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-825b861b-b6a7-4e79-a601-7f483d86bd29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdd8b08e9eac449ba23ea170fc6202c3', 'request_id': 'req-825b861b-b6a7-4e79-a601-7f483d86bd29'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:36.854770 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-825b861b-b6a7-4e79-a601-7f483d86bd29 admin admin] The token cache is being invalidate because project bdd8b08e9eac449ba23ea170fc6202c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:00:36.855221 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-825b861b-b6a7-4e79-a601-7f483d86bd29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:36.856609 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-825b861b-b6a7-4e79-a601-7f483d86bd29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:36.862452 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1107/2242] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:00:36 2022] DELETE /identity/v3/projects/bdd8b08e9eac449ba23ea170fc6202c3 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:36.863738 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c503438-139c-4edc-98ee-fcced0fbc3e6 service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:36.876882 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c503438-139c-4edc-98ee-fcced0fbc3e6 service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:36.941192 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:36.949933 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87aaaa3-7c1b-4134-971d-453b8cc6a367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:36.951003 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87aaaa3-7c1b-4134-971d-453b8cc6a367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:36.951690 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87aaaa3-7c1b-4134-971d-453b8cc6a367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:36.952274 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87aaaa3-7c1b-4134-971d-453b8cc6a367 admin admin] PATH_INFO: `/v3/users/181f3f8cd3084b6b9ceb5d9db65fdff4` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:36.955267 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87aaaa3-7c1b-4134-971d-453b8cc6a367 admin admin] RBAC: Authorizing `identity:delete_user(user_id=181f3f8cd3084b6b9ceb5d9db65fdff4)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:36.957813 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87aaaa3-7c1b-4134-971d-453b8cc6a367 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:36.998596 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b861b-b6a7-4e79-a601-7f483d86bd29 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:37.000251 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-825b861b-b6a7-4e79-a601-7f483d86bd29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:37.017306 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:37.017306 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b861b-b6a7-4e79-a601-7f483d86bd29 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:37.031134 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f87aaaa3-7c1b-4134-971d-453b8cc6a367 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '181f3f8cd3084b6b9ceb5d9db65fdff4'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:37.033163 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f87aaaa3-7c1b-4134-971d-453b8cc6a367 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '181f3f8cd3084b6b9ceb5d9db65fdff4'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:37.035850 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a159381-d606-47a0-9694-71b9849a4126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:37.037002 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a159381-d606-47a0-9694-71b9849a4126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:37.037489 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a159381-d606-47a0-9694-71b9849a4126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:37.037972 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a159381-d606-47a0-9694-71b9849a4126 admin admin] PATH_INFO: `/v3/users/cec64878d27a45a296b451b5d9e32ab6` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:37.040175 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a159381-d606-47a0-9694-71b9849a4126 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cec64878d27a45a296b451b5d9e32ab6)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:37.042542 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a159381-d606-47a0-9694-71b9849a4126 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:37.047189 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f87aaaa3-7c1b-4134-971d-453b8cc6a367 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '181f3f8cd3084b6b9ceb5d9db65fdff4'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:37.063159 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f87aaaa3-7c1b-4134-971d-453b8cc6a367 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '181f3f8cd3084b6b9ceb5d9db65fdff4'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:37.079328 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f87aaaa3-7c1b-4134-971d-453b8cc6a367 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '181f3f8cd3084b6b9ceb5d9db65fdff4'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:37.086365 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1136/2243] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:00:36 2022] DELETE /identity/v3/users/181f3f8cd3084b6b9ceb5d9db65fdff4 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:37.115706 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4a159381-d606-47a0-9694-71b9849a4126 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cec64878d27a45a296b451b5d9e32ab6'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:37.128986 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4a159381-d606-47a0-9694-71b9849a4126 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cec64878d27a45a296b451b5d9e32ab6'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:37.129721 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4a159381-d606-47a0-9694-71b9849a4126 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cec64878d27a45a296b451b5d9e32ab6'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:37.130533 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4a159381-d606-47a0-9694-71b9849a4126 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cec64878d27a45a296b451b5d9e32ab6'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:37.138512 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4a159381-d606-47a0-9694-71b9849a4126 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cec64878d27a45a296b451b5d9e32ab6'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:37.153816 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1108/2244] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:00:36 2022] DELETE /identity/v3/users/cec64878d27a45a296b451b5d9e32ab6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:37.158895 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda20e3-a332-44a5-bb01-e70ba4e43cdb None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:37.159130 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda20e3-a332-44a5-bb01-e70ba4e43cdb None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:37.159406 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda20e3-a332-44a5-bb01-e70ba4e43cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:37.181510 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-1fda20e3-a332-44a5-bb01-e70ba4e43cdb None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:37.182977 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-1fda20e3-a332-44a5-bb01-e70ba4e43cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:37.251038 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1137/2245] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:37.265886 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a159381-d606-47a0-9694-71b9849a4126 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:37.267352 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-4a159381-d606-47a0-9694-71b9849a4126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:37.345080 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a159381-d606-47a0-9694-71b9849a4126 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:37.352408 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912600b1-3342-489e-8449-bdaaf961f7d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:37.352408 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912600b1-3342-489e-8449-bdaaf961f7d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:37.352408 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912600b1-3342-489e-8449-bdaaf961f7d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:37.352408 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912600b1-3342-489e-8449-bdaaf961f7d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:37.356480 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda20e3-a332-44a5-bb01-e70ba4e43cdb None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:37.358258 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-1fda20e3-a332-44a5-bb01-e70ba4e43cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:37.365985 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912600b1-3342-489e-8449-bdaaf961f7d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:37.367977 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912600b1-3342-489e-8449-bdaaf961f7d0 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:37.372760 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda20e3-a332-44a5-bb01-e70ba4e43cdb None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:37.380518 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dadb63b-2ba2-40ff-9c41-9641d1b4e3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:37.381527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadb63b-2ba2-40ff-9c41-9641d1b4e3ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:37.382102 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadb63b-2ba2-40ff-9c41-9641d1b4e3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:37.382435 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadb63b-2ba2-40ff-9c41-9641d1b4e3ae admin admin] PATH_INFO: `/v3/users/8391c80e8c5445838e6a979244727c6e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:37.385672 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dadb63b-2ba2-40ff-9c41-9641d1b4e3ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=8391c80e8c5445838e6a979244727c6e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:37.389466 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1109/2246] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:00:37.391719 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dadb63b-2ba2-40ff-9c41-9641d1b4e3ae admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:37.428292 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912600b1-3342-489e-8449-bdaaf961f7d0 service neutron] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:37.430283 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-912600b1-3342-489e-8449-bdaaf961f7d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:37.453210 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912600b1-3342-489e-8449-bdaaf961f7d0 service neutron] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:37.460385 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f415439-d107-4cf4-a4ab-b2fe0842220d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:37.461393 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f415439-d107-4cf4-a4ab-b2fe0842220d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:37.461945 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f415439-d107-4cf4-a4ab-b2fe0842220d admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:37.462320 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f415439-d107-4cf4-a4ab-b2fe0842220d admin admin] PATH_INFO: `/v3/projects/3b724904f06643dc8eb32a35b16e9ffb` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:37.463756 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f415439-d107-4cf4-a4ab-b2fe0842220d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b724904f06643dc8eb32a35b16e9ffb)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:37.468137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f415439-d107-4cf4-a4ab-b2fe0842220d admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:37.475850 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-0dadb63b-2ba2-40ff-9c41-9641d1b4e3ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8391c80e8c5445838e6a979244727c6e'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:37.478430 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-0dadb63b-2ba2-40ff-9c41-9641d1b4e3ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8391c80e8c5445838e6a979244727c6e'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:37.490955 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-0dadb63b-2ba2-40ff-9c41-9641d1b4e3ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8391c80e8c5445838e6a979244727c6e'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:37.517534 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-0dadb63b-2ba2-40ff-9c41-9641d1b4e3ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8391c80e8c5445838e6a979244727c6e'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:37.519098 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:37.530763 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-0dadb63b-2ba2-40ff-9c41-9641d1b4e3ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8391c80e8c5445838e6a979244727c6e'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:37.539957 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1138/2247] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:00:37 2022] DELETE /identity/v3/users/8391c80e8c5445838e6a979244727c6e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:00:37.544665 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b5b64-1ce6-4a78-a69c-54e0ea6993f4 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:37.544971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b5b64-1ce6-4a78-a69c-54e0ea6993f4 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:37.545245 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b5b64-1ce6-4a78-a69c-54e0ea6993f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:37.547578 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4f415439-d107-4cf4-a4ab-b2fe0842220d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b724904f06643dc8eb32a35b16e9ffb', 'request_id': 'req-4f415439-d107-4cf4-a4ab-b2fe0842220d'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:37.557038 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4f415439-d107-4cf4-a4ab-b2fe0842220d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b724904f06643dc8eb32a35b16e9ffb', 'request_id': 'req-4f415439-d107-4cf4-a4ab-b2fe0842220d'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:37.569776 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-d35b5b64-1ce6-4a78-a69c-54e0ea6993f4 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:37.571117 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-d35b5b64-1ce6-4a78-a69c-54e0ea6993f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:37.573438 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4f415439-d107-4cf4-a4ab-b2fe0842220d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b724904f06643dc8eb32a35b16e9ffb', 'request_id': 'req-4f415439-d107-4cf4-a4ab-b2fe0842220d'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:37.590066 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4f415439-d107-4cf4-a4ab-b2fe0842220d admin admin] The token cache is being invalidate because project 3b724904f06643dc8eb32a35b16e9ffb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:00:37.591352 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4f415439-d107-4cf4-a4ab-b2fe0842220d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:37.592270 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4f415439-d107-4cf4-a4ab-b2fe0842220d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:37.594949 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1110/2248] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:00:37 2022] DELETE /identity/v3/projects/3b724904f06643dc8eb32a35b16e9ffb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:37.599355 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f415439-d107-4cf4-a4ab-b2fe0842220d admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:37.601208 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-4f415439-d107-4cf4-a4ab-b2fe0842220d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:37.614345 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:37.671974 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1139/2249] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:00:37.682978 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b5b64-1ce6-4a78-a69c-54e0ea6993f4 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:37.685237 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-d35b5b64-1ce6-4a78-a69c-54e0ea6993f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:37.721351 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f415439-d107-4cf4-a4ab-b2fe0842220d admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:37.743150 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6150ba-e99a-4aa0-9506-89aff3ea7500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:37.744046 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6150ba-e99a-4aa0-9506-89aff3ea7500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:37.744327 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6150ba-e99a-4aa0-9506-89aff3ea7500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:37.744703 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6150ba-e99a-4aa0-9506-89aff3ea7500 admin admin] PATH_INFO: `/v3/users/fee5a67fb36e403f8b41364ead2b1b43` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:37.745768 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6150ba-e99a-4aa0-9506-89aff3ea7500 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fee5a67fb36e403f8b41364ead2b1b43)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:37.748741 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6150ba-e99a-4aa0-9506-89aff3ea7500 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:37.793314 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b5b64-1ce6-4a78-a69c-54e0ea6993f4 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:37.798033 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f27278-0c48-47a3-8ee4-157dec3e9000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:37.798656 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f27278-0c48-47a3-8ee4-157dec3e9000 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:37.798931 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f27278-0c48-47a3-8ee4-157dec3e9000 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:37.799237 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f27278-0c48-47a3-8ee4-157dec3e9000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:37.811428 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f27278-0c48-47a3-8ee4-157dec3e9000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:37.812906 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f27278-0c48-47a3-8ee4-157dec3e9000 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:37.817263 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-ca6150ba-e99a-4aa0-9506-89aff3ea7500 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fee5a67fb36e403f8b41364ead2b1b43'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:37.832489 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1140/2250] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:00:37.834021 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f27278-0c48-47a3-8ee4-157dec3e9000 service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:37.835493 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-ca6150ba-e99a-4aa0-9506-89aff3ea7500 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fee5a67fb36e403f8b41364ead2b1b43'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:37.836274 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-ca6150ba-e99a-4aa0-9506-89aff3ea7500 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fee5a67fb36e403f8b41364ead2b1b43'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:37.836670 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-e1f27278-0c48-47a3-8ee4-157dec3e9000 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:37.837080 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-ca6150ba-e99a-4aa0-9506-89aff3ea7500 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fee5a67fb36e403f8b41364ead2b1b43'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:37.850456 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-ca6150ba-e99a-4aa0-9506-89aff3ea7500 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fee5a67fb36e403f8b41364ead2b1b43'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:37.854660 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f27278-0c48-47a3-8ee4-157dec3e9000 service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:37.866012 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3e372-d80f-4a0d-8501-915bfb51152d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:37.867121 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3e372-d80f-4a0d-8501-915bfb51152d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:37.867445 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3e372-d80f-4a0d-8501-915bfb51152d admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:37.867719 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3e372-d80f-4a0d-8501-915bfb51152d admin admin] PATH_INFO: `/v3/projects/903eafa801064beca93415f995030db9` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:37.872829 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1111/2251] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:00:37 2022] DELETE /identity/v3/users/fee5a67fb36e403f8b41364ead2b1b43 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:37.875860 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f3e372-d80f-4a0d-8501-915bfb51152d admin admin] RBAC: Authorizing `identity:delete_project(project_id=903eafa801064beca93415f995030db9)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:37.877897 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f3e372-d80f-4a0d-8501-915bfb51152d admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:37.945536 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6150ba-e99a-4aa0-9506-89aff3ea7500 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:37.947655 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-ca6150ba-e99a-4aa0-9506-89aff3ea7500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:37.962039 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-d1f3e372-d80f-4a0d-8501-915bfb51152d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '903eafa801064beca93415f995030db9', 'request_id': 'req-d1f3e372-d80f-4a0d-8501-915bfb51152d'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:37.971817 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-d1f3e372-d80f-4a0d-8501-915bfb51152d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '903eafa801064beca93415f995030db9', 'request_id': 'req-d1f3e372-d80f-4a0d-8501-915bfb51152d'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:37.982808 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-d1f3e372-d80f-4a0d-8501-915bfb51152d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '903eafa801064beca93415f995030db9', 'request_id': 'req-d1f3e372-d80f-4a0d-8501-915bfb51152d'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:38.005577 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-d1f3e372-d80f-4a0d-8501-915bfb51152d admin admin] The token cache is being invalidate because project 903eafa801064beca93415f995030db9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:00:38.006012 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-d1f3e372-d80f-4a0d-8501-915bfb51152d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:38.008453 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-d1f3e372-d80f-4a0d-8501-915bfb51152d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:38.015781 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1141/2252] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:00:37 2022] DELETE /identity/v3/projects/903eafa801064beca93415f995030db9 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:38.018544 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3e372-d80f-4a0d-8501-915bfb51152d admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:38.020716 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-d1f3e372-d80f-4a0d-8501-915bfb51152d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:38.054101 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:38.084730 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6150ba-e99a-4aa0-9506-89aff3ea7500 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:38.139587 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:38.147346 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3e372-d80f-4a0d-8501-915bfb51152d admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:38.162008 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343e1e1-f21e-48d2-9ed0-fc500d3b56bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:38.163351 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343e1e1-f21e-48d2-9ed0-fc500d3b56bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:38.163639 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343e1e1-f21e-48d2-9ed0-fc500d3b56bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:38.164277 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343e1e1-f21e-48d2-9ed0-fc500d3b56bb admin admin] PATH_INFO: `/v3/users/d3b5f4a3ef3c4ae9a31ae9124ea152cf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:38.171577 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343e1e1-f21e-48d2-9ed0-fc500d3b56bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3b5f4a3ef3c4ae9a31ae9124ea152cf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:38.177376 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343e1e1-f21e-48d2-9ed0-fc500d3b56bb admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:38.202725 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b8386-eddc-4432-8223-f65f33dade96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:38.203868 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b8386-eddc-4432-8223-f65f33dade96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:38.204305 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b8386-eddc-4432-8223-f65f33dade96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:38.204985 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b8386-eddc-4432-8223-f65f33dade96 admin admin] PATH_INFO: `/v3/users/7dde321ee4324de8abb42ea73f486ea9` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:38.206612 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b8386-eddc-4432-8223-f65f33dade96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dde321ee4324de8abb42ea73f486ea9)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:38.214526 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b8386-eddc-4432-8223-f65f33dade96 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:38.258856 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-0343e1e1-f21e-48d2-9ed0-fc500d3b56bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3b5f4a3ef3c4ae9a31ae9124ea152cf'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:38.260078 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-0343e1e1-f21e-48d2-9ed0-fc500d3b56bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3b5f4a3ef3c4ae9a31ae9124ea152cf'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:38.271839 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-0343e1e1-f21e-48d2-9ed0-fc500d3b56bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3b5f4a3ef3c4ae9a31ae9124ea152cf'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:38.290778 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-0343e1e1-f21e-48d2-9ed0-fc500d3b56bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3b5f4a3ef3c4ae9a31ae9124ea152cf'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:38.301650 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-0343e1e1-f21e-48d2-9ed0-fc500d3b56bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3b5f4a3ef3c4ae9a31ae9124ea152cf'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:38.305458 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-8a9b8386-eddc-4432-8223-f65f33dade96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dde321ee4324de8abb42ea73f486ea9'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:38.315767 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1142/2253] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:00:38 2022] DELETE /identity/v3/users/d3b5f4a3ef3c4ae9a31ae9124ea152cf => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:38.330918 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-8a9b8386-eddc-4432-8223-f65f33dade96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dde321ee4324de8abb42ea73f486ea9'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:38.331669 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-8a9b8386-eddc-4432-8223-f65f33dade96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dde321ee4324de8abb42ea73f486ea9'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:38.332279 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-8a9b8386-eddc-4432-8223-f65f33dade96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dde321ee4324de8abb42ea73f486ea9'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:38.345947 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-8a9b8386-eddc-4432-8223-f65f33dade96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dde321ee4324de8abb42ea73f486ea9'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:38.348247 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343e1e1-f21e-48d2-9ed0-fc500d3b56bb admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:38.351058 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-0343e1e1-f21e-48d2-9ed0-fc500d3b56bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:38.359239 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1112/2254] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:00:37 2022] DELETE /identity/v3/users/7dde321ee4324de8abb42ea73f486ea9 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:38.363550 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706fb61-9eb2-4346-89f5-9af11b3b8d4b None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:38.364071 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706fb61-9eb2-4346-89f5-9af11b3b8d4b None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:38.364530 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706fb61-9eb2-4346-89f5-9af11b3b8d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:38.406475 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-d706fb61-9eb2-4346-89f5-9af11b3b8d4b None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:38.408412 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-d706fb61-9eb2-4346-89f5-9af11b3b8d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:38.478233 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343e1e1-f21e-48d2-9ed0-fc500d3b56bb admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:38.536130 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1113/2255] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:00:38.537382 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706fb61-9eb2-4346-89f5-9af11b3b8d4b None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:38.548419 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-d706fb61-9eb2-4346-89f5-9af11b3b8d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:38.568997 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:38.572279 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706fb61-9eb2-4346-89f5-9af11b3b8d4b None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:38.580061 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e606e-b36d-4a45-9f25-6fe1903318f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:38.580992 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e606e-b36d-4a45-9f25-6fe1903318f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:38.581323 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e606e-b36d-4a45-9f25-6fe1903318f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:38.581656 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e606e-b36d-4a45-9f25-6fe1903318f2 admin admin] PATH_INFO: `/v3/projects/87206a5aa6bd4a99bc04e5ccab964def` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:38.584276 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e606e-b36d-4a45-9f25-6fe1903318f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87206a5aa6bd4a99bc04e5ccab964def)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:38.586719 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e606e-b36d-4a45-9f25-6fe1903318f2 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:38.598842 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b145ef3-8ce9-4ef6-97ef-ee05d200c17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:38.601239 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b145ef3-8ce9-4ef6-97ef-ee05d200c17e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:38.601715 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b145ef3-8ce9-4ef6-97ef-ee05d200c17e admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:38.602274 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b145ef3-8ce9-4ef6-97ef-ee05d200c17e admin admin] PATH_INFO: `/v3/projects/b78dadc981ab47c5a764ee7536dad2a0` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:38.604057 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b145ef3-8ce9-4ef6-97ef-ee05d200c17e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b78dadc981ab47c5a764ee7536dad2a0)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:38.606757 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b145ef3-8ce9-4ef6-97ef-ee05d200c17e admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:38.655254 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:38.660046 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-455e606e-b36d-4a45-9f25-6fe1903318f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87206a5aa6bd4a99bc04e5ccab964def', 'request_id': 'req-455e606e-b36d-4a45-9f25-6fe1903318f2'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:38.667852 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-455e606e-b36d-4a45-9f25-6fe1903318f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87206a5aa6bd4a99bc04e5ccab964def', 'request_id': 'req-455e606e-b36d-4a45-9f25-6fe1903318f2'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:38.679838 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-455e606e-b36d-4a45-9f25-6fe1903318f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87206a5aa6bd4a99bc04e5ccab964def', 'request_id': 'req-455e606e-b36d-4a45-9f25-6fe1903318f2'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:38.686508 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-8b145ef3-8ce9-4ef6-97ef-ee05d200c17e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b78dadc981ab47c5a764ee7536dad2a0', 'request_id': 'req-8b145ef3-8ce9-4ef6-97ef-ee05d200c17e'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:38.698600 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-8b145ef3-8ce9-4ef6-97ef-ee05d200c17e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b78dadc981ab47c5a764ee7536dad2a0', 'request_id': 'req-8b145ef3-8ce9-4ef6-97ef-ee05d200c17e'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:38.699864 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-455e606e-b36d-4a45-9f25-6fe1903318f2 admin admin] The token cache is being invalidate because project 87206a5aa6bd4a99bc04e5ccab964def was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:00:38.700813 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-455e606e-b36d-4a45-9f25-6fe1903318f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:38.701605 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-455e606e-b36d-4a45-9f25-6fe1903318f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:38.704183 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1114/2256] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:00:38 2022] DELETE /identity/v3/projects/87206a5aa6bd4a99bc04e5ccab964def => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:38.706502 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e606e-b36d-4a45-9f25-6fe1903318f2 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:38.708239 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-455e606e-b36d-4a45-9f25-6fe1903318f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:38.713365 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-8b145ef3-8ce9-4ef6-97ef-ee05d200c17e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b78dadc981ab47c5a764ee7536dad2a0', 'request_id': 'req-8b145ef3-8ce9-4ef6-97ef-ee05d200c17e'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:38.761381 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-8b145ef3-8ce9-4ef6-97ef-ee05d200c17e admin admin] The token cache is being invalidate because project b78dadc981ab47c5a764ee7536dad2a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:00:38.761579 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-8b145ef3-8ce9-4ef6-97ef-ee05d200c17e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:38.768475 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-8b145ef3-8ce9-4ef6-97ef-ee05d200c17e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:38.774215 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1143/2257] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:00:38 2022] DELETE /identity/v3/projects/b78dadc981ab47c5a764ee7536dad2a0 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:38.775148 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b145ef3-8ce9-4ef6-97ef-ee05d200c17e admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:38.776662 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-8b145ef3-8ce9-4ef6-97ef-ee05d200c17e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:38.836709 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e606e-b36d-4a45-9f25-6fe1903318f2 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:38.891681 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b145ef3-8ce9-4ef6-97ef-ee05d200c17e admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:38.897449 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac8ddc-6c63-46b8-af2a-90ba27ce5682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:38.898764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac8ddc-6c63-46b8-af2a-90ba27ce5682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:38.898764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac8ddc-6c63-46b8-af2a-90ba27ce5682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:38.898764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac8ddc-6c63-46b8-af2a-90ba27ce5682 admin admin] PATH_INFO: `/v3/users/3817e06620a74685a2db4b8d5ea79cfd` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:38.899945 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac8ddc-6c63-46b8-af2a-90ba27ce5682 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3817e06620a74685a2db4b8d5ea79cfd)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:38.902915 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac8ddc-6c63-46b8-af2a-90ba27ce5682 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:38.925592 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090c6c3-df64-4e92-ab26-fffbd33c1d20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:38.927776 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090c6c3-df64-4e92-ab26-fffbd33c1d20 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:38.927990 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090c6c3-df64-4e92-ab26-fffbd33c1d20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:38.928342 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090c6c3-df64-4e92-ab26-fffbd33c1d20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:38.930537 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-e090c6c3-df64-4e92-ab26-fffbd33c1d20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:38.954972 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090c6c3-df64-4e92-ab26-fffbd33c1d20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:38.956749 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090c6c3-df64-4e92-ab26-fffbd33c1d20 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:38.977191 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1115/2258] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:00:38.978355 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090c6c3-df64-4e92-ab26-fffbd33c1d20 service neutron] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:38.980732 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-e090c6c3-df64-4e92-ab26-fffbd33c1d20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:38.999517 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-3eac8ddc-6c63-46b8-af2a-90ba27ce5682 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3817e06620a74685a2db4b8d5ea79cfd'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:39.002635 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-3eac8ddc-6c63-46b8-af2a-90ba27ce5682 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3817e06620a74685a2db4b8d5ea79cfd'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:39.003947 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090c6c3-df64-4e92-ab26-fffbd33c1d20 service neutron] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:39.013035 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb1e94-ef2c-485d-b2cf-d763d067bc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:39.015491 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb1e94-ef2c-485d-b2cf-d763d067bc2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:39.016159 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb1e94-ef2c-485d-b2cf-d763d067bc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:39.016640 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb1e94-ef2c-485d-b2cf-d763d067bc2a admin admin] PATH_INFO: `/v3/projects/3e6fdf08c87b432f9a65dc767fa06328` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:39.018306 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb1e94-ef2c-485d-b2cf-d763d067bc2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e6fdf08c87b432f9a65dc767fa06328)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:39.019021 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-3eac8ddc-6c63-46b8-af2a-90ba27ce5682 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3817e06620a74685a2db4b8d5ea79cfd'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:39.020763 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb1e94-ef2c-485d-b2cf-d763d067bc2a admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:39.045199 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-3eac8ddc-6c63-46b8-af2a-90ba27ce5682 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3817e06620a74685a2db4b8d5ea79cfd'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:39.048524 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:39.067303 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-3eac8ddc-6c63-46b8-af2a-90ba27ce5682 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3817e06620a74685a2db4b8d5ea79cfd'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:39.078616 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1144/2259] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:00:38 2022] DELETE /identity/v3/users/3817e06620a74685a2db4b8d5ea79cfd => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:39.080060 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be70225-2022-4923-aa7c-bc29013f41e9 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:39.080348 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be70225-2022-4923-aa7c-bc29013f41e9 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:39.080618 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be70225-2022-4923-aa7c-bc29013f41e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:39.100485 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-8edb1e94-ef2c-485d-b2cf-d763d067bc2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e6fdf08c87b432f9a65dc767fa06328', 'request_id': 'req-8edb1e94-ef2c-485d-b2cf-d763d067bc2a'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:39.109087 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-8edb1e94-ef2c-485d-b2cf-d763d067bc2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e6fdf08c87b432f9a65dc767fa06328', 'request_id': 'req-8edb1e94-ef2c-485d-b2cf-d763d067bc2a'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:39.119527 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-8edb1e94-ef2c-485d-b2cf-d763d067bc2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e6fdf08c87b432f9a65dc767fa06328', 'request_id': 'req-8edb1e94-ef2c-485d-b2cf-d763d067bc2a'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:39.136234 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-8edb1e94-ef2c-485d-b2cf-d763d067bc2a admin admin] The token cache is being invalidate because project 3e6fdf08c87b432f9a65dc767fa06328 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:00:39.136623 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-8edb1e94-ef2c-485d-b2cf-d763d067bc2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:39.138160 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-8edb1e94-ef2c-485d-b2cf-d763d067bc2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:39.140590 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1116/2260] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:00:38 2022] DELETE /identity/v3/projects/3e6fdf08c87b432f9a65dc767fa06328 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:39.146151 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c6e95-764e-453f-b501-31a0fccfa487 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:39.146454 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c6e95-764e-453f-b501-31a0fccfa487 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:39.146703 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c6e95-764e-453f-b501-31a0fccfa487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:39.163215 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-6be70225-2022-4923-aa7c-bc29013f41e9 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:39.165034 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-6be70225-2022-4923-aa7c-bc29013f41e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:39.193672 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-775c6e95-764e-453f-b501-31a0fccfa487 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:39.194898 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-775c6e95-764e-453f-b501-31a0fccfa487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:39.219817 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:39.273933 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1145/2261] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:39.284772 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438cc4a5-d9fd-4ff5-a586-f6c75baea14e None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:39.285138 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438cc4a5-d9fd-4ff5-a586-f6c75baea14e None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:39.285514 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438cc4a5-d9fd-4ff5-a586-f6c75baea14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:39.311588 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-438cc4a5-d9fd-4ff5-a586-f6c75baea14e None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:39.313333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-438cc4a5-d9fd-4ff5-a586-f6c75baea14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:39.328273 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1146/2262] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:39.329125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438cc4a5-d9fd-4ff5-a586-f6c75baea14e None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:39.345658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1117/2263] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:39.346190 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438cc4a5-d9fd-4ff5-a586-f6c75baea14e None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:39.352951 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a9dd5-8353-467d-a692-7cc2698fac6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:39.353664 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea1df3-89a9-45d5-866d-11941a096c01 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:39.353780 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a9dd5-8353-467d-a692-7cc2698fac6b admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:39.353983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a9dd5-8353-467d-a692-7cc2698fac6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:39.354457 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea1df3-89a9-45d5-866d-11941a096c01 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:39.354630 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a9dd5-8353-467d-a692-7cc2698fac6b admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:39.355338 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a9dd5-8353-467d-a692-7cc2698fac6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:00:39.355634 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea1df3-89a9-45d5-866d-11941a096c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:39.355851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a9dd5-8353-467d-a692-7cc2698fac6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:39.357851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a9dd5-8353-467d-a692-7cc2698fac6b admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:39.376897 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1147/2264] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 16:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:00:39.377898 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a9dd5-8353-467d-a692-7cc2698fac6b admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:39.389476 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-cbea1df3-89a9-45d5-866d-11941a096c01 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:39.390992 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a9dd5-8353-467d-a692-7cc2698fac6b admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:39.391411 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-cbea1df3-89a9-45d5-866d-11941a096c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:39.397489 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd73214-5e99-43fa-86cc-defcd1112df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:39.398163 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd73214-5e99-43fa-86cc-defcd1112df6 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:39.398439 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd73214-5e99-43fa-86cc-defcd1112df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:39.398708 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd73214-5e99-43fa-86cc-defcd1112df6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:39.399440 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd73214-5e99-43fa-86cc-defcd1112df6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:39.401485 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd73214-5e99-43fa-86cc-defcd1112df6 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:39.405861 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1118/2265] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:39.406396 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea1df3-89a9-45d5-866d-11941a096c01 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:39.416324 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea1df3-89a9-45d5-866d-11941a096c01 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:39.421791 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6daa8fe-8737-4e99-b7a7-20a69a9acac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:39.422414 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6daa8fe-8737-4e99-b7a7-20a69a9acac3 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:39.423255 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6daa8fe-8737-4e99-b7a7-20a69a9acac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:39.423540 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6daa8fe-8737-4e99-b7a7-20a69a9acac3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:39.424211 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6daa8fe-8737-4e99-b7a7-20a69a9acac3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:00:39.424519 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6daa8fe-8737-4e99-b7a7-20a69a9acac3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:39.426174 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6daa8fe-8737-4e99-b7a7-20a69a9acac3 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:39.448745 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1119/2266] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 16:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:00:39.449760 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6daa8fe-8737-4e99-b7a7-20a69a9acac3 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:39.458890 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1148/2267] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:00:39 2022] POST /identity/v3/projects => generated 373 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:39.466859 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd73214-5e99-43fa-86cc-defcd1112df6 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:39.473945 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6daa8fe-8737-4e99-b7a7-20a69a9acac3 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:39.555493 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd73214-5e99-43fa-86cc-defcd1112df6 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:39.561175 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca1e53-2f97-4a48-945a-a30ace99d28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:39.561797 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca1e53-2f97-4a48-945a-a30ace99d28b admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:39.562077 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca1e53-2f97-4a48-945a-a30ace99d28b admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:39.562350 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca1e53-2f97-4a48-945a-a30ace99d28b admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:39.562987 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca1e53-2f97-4a48-945a-a30ace99d28b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:39.564937 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca1e53-2f97-4a48-945a-a30ace99d28b admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:39.585760 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09481125-26d8-420d-b56d-3e7b8c7ec6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:39.586472 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09481125-26d8-420d-b56d-3e7b8c7ec6ba admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:39.586821 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09481125-26d8-420d-b56d-3e7b8c7ec6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:39.586937 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1149/2268] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:00:39 2022] POST /identity/v3/users => generated 287 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:39.587147 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09481125-26d8-420d-b56d-3e7b8c7ec6ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:39.587866 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09481125-26d8-420d-b56d-3e7b8c7ec6ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:39.589898 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09481125-26d8-420d-b56d-3e7b8c7ec6ba admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:39.590888 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca1e53-2f97-4a48-945a-a30ace99d28b admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:39.592472 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-91ca1e53-2f97-4a48-945a-a30ace99d28b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:39.605132 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca1e53-2f97-4a48-945a-a30ace99d28b admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:39.610995 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511027dc-b52b-4f69-93c2-d37edf80cf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:39.611684 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511027dc-b52b-4f69-93c2-d37edf80cf9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:39.611964 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511027dc-b52b-4f69-93c2-d37edf80cf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:39.612232 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511027dc-b52b-4f69-93c2-d37edf80cf9f admin admin] PATH_INFO: `/v3/projects/824acceb737a426ba2a53da1c10246b0` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:39.613410 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511027dc-b52b-4f69-93c2-d37edf80cf9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=824acceb737a426ba2a53da1c10246b0)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:39.615540 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511027dc-b52b-4f69-93c2-d37edf80cf9f admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:39.619271 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1120/2269] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:00:39 2022] POST /identity/v3/projects => generated 371 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:39.620353 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09481125-26d8-420d-b56d-3e7b8c7ec6ba admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:39.622995 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-09481125-26d8-420d-b56d-3e7b8c7ec6ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:39.658102 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:39.670113 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-511027dc-b52b-4f69-93c2-d37edf80cf9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '824acceb737a426ba2a53da1c10246b0', 'request_id': 'req-511027dc-b52b-4f69-93c2-d37edf80cf9f'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:39.677551 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-511027dc-b52b-4f69-93c2-d37edf80cf9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '824acceb737a426ba2a53da1c10246b0', 'request_id': 'req-511027dc-b52b-4f69-93c2-d37edf80cf9f'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:39.684232 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-511027dc-b52b-4f69-93c2-d37edf80cf9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '824acceb737a426ba2a53da1c10246b0', 'request_id': 'req-511027dc-b52b-4f69-93c2-d37edf80cf9f'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:39.690750 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09481125-26d8-420d-b56d-3e7b8c7ec6ba admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:39.694534 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-511027dc-b52b-4f69-93c2-d37edf80cf9f admin admin] The token cache is being invalidate because project 824acceb737a426ba2a53da1c10246b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:00:39.694822 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-511027dc-b52b-4f69-93c2-d37edf80cf9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:39.695473 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-511027dc-b52b-4f69-93c2-d37edf80cf9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:39.696996 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1150/2270] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:00:39 2022] DELETE /identity/v3/projects/824acceb737a426ba2a53da1c10246b0 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:39.697749 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511027dc-b52b-4f69-93c2-d37edf80cf9f admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:39.699004 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-511027dc-b52b-4f69-93c2-d37edf80cf9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:39.715979 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:39.750621 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d83f8-a5bf-42b0-8ff8-6e4532d9ec1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:39.751271 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d83f8-a5bf-42b0-8ff8-6e4532d9ec1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:39.751548 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d83f8-a5bf-42b0-8ff8-6e4532d9ec1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:39.751824 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d83f8-a5bf-42b0-8ff8-6e4532d9ec1b admin admin] PATH_INFO: `/v3/projects/dd8d8825b0dd4edc876d97ca6fafe269` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:39.753000 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d83f8-a5bf-42b0-8ff8-6e4532d9ec1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd8d8825b0dd4edc876d97ca6fafe269)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:39.754937 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d83f8-a5bf-42b0-8ff8-6e4532d9ec1b admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:39.767660 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511027dc-b52b-4f69-93c2-d37edf80cf9f admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:39.772478 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf8508-1ed9-4cbb-88ea-78ba9b41314b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:39.773123 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf8508-1ed9-4cbb-88ea-78ba9b41314b admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:39.773403 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf8508-1ed9-4cbb-88ea-78ba9b41314b admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:39.773675 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf8508-1ed9-4cbb-88ea-78ba9b41314b admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:39.774323 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf8508-1ed9-4cbb-88ea-78ba9b41314b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:39.776044 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf8508-1ed9-4cbb-88ea-78ba9b41314b admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:39.787360 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1151/2271] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:39.788113 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf8508-1ed9-4cbb-88ea-78ba9b41314b admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:39.792197 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-edcf8508-1ed9-4cbb-88ea-78ba9b41314b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:39.806821 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf8508-1ed9-4cbb-88ea-78ba9b41314b admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:39.809911 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-af2d83f8-a5bf-42b0-8ff8-6e4532d9ec1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd8d8825b0dd4edc876d97ca6fafe269', 'request_id': 'req-af2d83f8-a5bf-42b0-8ff8-6e4532d9ec1b'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:39.816901 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-af2d83f8-a5bf-42b0-8ff8-6e4532d9ec1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd8d8825b0dd4edc876d97ca6fafe269', 'request_id': 'req-af2d83f8-a5bf-42b0-8ff8-6e4532d9ec1b'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:39.827654 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-af2d83f8-a5bf-42b0-8ff8-6e4532d9ec1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd8d8825b0dd4edc876d97ca6fafe269', 'request_id': 'req-af2d83f8-a5bf-42b0-8ff8-6e4532d9ec1b'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:39.843355 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-af2d83f8-a5bf-42b0-8ff8-6e4532d9ec1b admin admin] The token cache is being invalidate because project dd8d8825b0dd4edc876d97ca6fafe269 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:00:39.843539 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-af2d83f8-a5bf-42b0-8ff8-6e4532d9ec1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:39.844067 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-af2d83f8-a5bf-42b0-8ff8-6e4532d9ec1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:39.848655 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1121/2272] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:00:39 2022] DELETE /identity/v3/projects/dd8d8825b0dd4edc876d97ca6fafe269 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:39.848655 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d83f8-a5bf-42b0-8ff8-6e4532d9ec1b admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:39.848655 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-af2d83f8-a5bf-42b0-8ff8-6e4532d9ec1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:39.878533 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8685a-e304-44cf-9fa3-3c616ebc3f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:39.879182 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8685a-e304-44cf-9fa3-3c616ebc3f24 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:39.879611 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8685a-e304-44cf-9fa3-3c616ebc3f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:39.880190 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8685a-e304-44cf-9fa3-3c616ebc3f24 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:39.880868 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8685a-e304-44cf-9fa3-3c616ebc3f24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:39.883127 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8685a-e304-44cf-9fa3-3c616ebc3f24 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:39.912909 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1152/2273] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:00:39 2022] POST /identity/v3/users => generated 286 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:39.913794 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8685a-e304-44cf-9fa3-3c616ebc3f24 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:39.915476 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-0da8685a-e304-44cf-9fa3-3c616ebc3f24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:39.928444 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8685a-e304-44cf-9fa3-3c616ebc3f24 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:39.930772 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d83f8-a5bf-42b0-8ff8-6e4532d9ec1b admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:39.933591 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7108bec-df7e-4ad0-b62b-9a35982cc8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:39.934277 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7108bec-df7e-4ad0-b62b-9a35982cc8f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:39.934619 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7108bec-df7e-4ad0-b62b-9a35982cc8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:39.934818 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7108bec-df7e-4ad0-b62b-9a35982cc8f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:39.935494 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7108bec-df7e-4ad0-b62b-9a35982cc8f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:39.936517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d53c2-f32e-4a4e-b049-c9a6b58b6e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:39.937329 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7108bec-df7e-4ad0-b62b-9a35982cc8f5 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:39.937437 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d53c2-f32e-4a4e-b049-c9a6b58b6e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:39.937753 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d53c2-f32e-4a4e-b049-c9a6b58b6e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:39.938107 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d53c2-f32e-4a4e-b049-c9a6b58b6e93 admin admin] PATH_INFO: `/v3/users/f3b9a7a71cf246eb92a4393700bf8b05` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:39.939721 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d53c2-f32e-4a4e-b049-c9a6b58b6e93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3b9a7a71cf246eb92a4393700bf8b05)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:39.942389 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d53c2-f32e-4a4e-b049-c9a6b58b6e93 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:39.951775 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1153/2274] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:39.952537 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7108bec-df7e-4ad0-b62b-9a35982cc8f5 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:39.956626 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-d7108bec-df7e-4ad0-b62b-9a35982cc8f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:39.974558 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7108bec-df7e-4ad0-b62b-9a35982cc8f5 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:39.981684 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4549fbfe-256c-4d58-b3fd-aecf0951babc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:39.982900 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549fbfe-256c-4d58-b3fd-aecf0951babc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:39.983275 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549fbfe-256c-4d58-b3fd-aecf0951babc admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:39.983558 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549fbfe-256c-4d58-b3fd-aecf0951babc admin admin] PATH_INFO: `/v3/users/6a13acffc4564b59b918a0dc5ea40809` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:39.985166 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4549fbfe-256c-4d58-b3fd-aecf0951babc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a13acffc4564b59b918a0dc5ea40809)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:39.987968 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4549fbfe-256c-4d58-b3fd-aecf0951babc admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:40.003386 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-fa8d53c2-f32e-4a4e-b049-c9a6b58b6e93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3b9a7a71cf246eb92a4393700bf8b05'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:40.011671 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:40.017794 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-fa8d53c2-f32e-4a4e-b049-c9a6b58b6e93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3b9a7a71cf246eb92a4393700bf8b05'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:40.019183 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-fa8d53c2-f32e-4a4e-b049-c9a6b58b6e93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3b9a7a71cf246eb92a4393700bf8b05'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:40.021449 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-fa8d53c2-f32e-4a4e-b049-c9a6b58b6e93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3b9a7a71cf246eb92a4393700bf8b05'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:40.025617 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:40.030437 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-fa8d53c2-f32e-4a4e-b049-c9a6b58b6e93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3b9a7a71cf246eb92a4393700bf8b05'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:40.040547 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-4549fbfe-256c-4d58-b3fd-aecf0951babc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a13acffc4564b59b918a0dc5ea40809'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:40.041225 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-4549fbfe-256c-4d58-b3fd-aecf0951babc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a13acffc4564b59b918a0dc5ea40809'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:40.044531 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1122/2275] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:00:39 2022] DELETE /identity/v3/users/f3b9a7a71cf246eb92a4393700bf8b05 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:40.045449 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d53c2-f32e-4a4e-b049-c9a6b58b6e93 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:40.046813 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-fa8d53c2-f32e-4a4e-b049-c9a6b58b6e93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:40.051662 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-4549fbfe-256c-4d58-b3fd-aecf0951babc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a13acffc4564b59b918a0dc5ea40809'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:40.065343 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-4549fbfe-256c-4d58-b3fd-aecf0951babc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a13acffc4564b59b918a0dc5ea40809'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:40.073148 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-4549fbfe-256c-4d58-b3fd-aecf0951babc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a13acffc4564b59b918a0dc5ea40809'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:40.080019 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1154/2276] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:00:39 2022] DELETE /identity/v3/users/6a13acffc4564b59b918a0dc5ea40809 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:40.080845 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4549fbfe-256c-4d58-b3fd-aecf0951babc admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:40.082223 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-4549fbfe-256c-4d58-b3fd-aecf0951babc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:40.152012 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d53c2-f32e-4a4e-b049-c9a6b58b6e93 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:40.218877 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4549fbfe-256c-4d58-b3fd-aecf0951babc admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:40.229668 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5712faa-69ff-49e9-a035-33ceb3de7ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:40.230462 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5712faa-69ff-49e9-a035-33ceb3de7ee2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:40.230824 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5712faa-69ff-49e9-a035-33ceb3de7ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:40.244902 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5712faa-69ff-49e9-a035-33ceb3de7ee2 admin admin] PATH_INFO: `/v3/projects/a2542aac3db74869b7f011ee6a15309a/users/45d624c90b2b448595cf0f5eebbb2307/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:40.265772 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47027d4d-e27b-4ffd-b3d7-72fa3c8418ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:40.266411 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47027d4d-e27b-4ffd-b3d7-72fa3c8418ba admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:40.266955 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47027d4d-e27b-4ffd-b3d7-72fa3c8418ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:40.266955 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47027d4d-e27b-4ffd-b3d7-72fa3c8418ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:40.267771 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5712faa-69ff-49e9-a035-33ceb3de7ee2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2542aac3db74869b7f011ee6a15309a, user_id=45d624c90b2b448595cf0f5eebbb2307, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:40.272126 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5712faa-69ff-49e9-a035-33ceb3de7ee2 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:40.273345 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47027d4d-e27b-4ffd-b3d7-72fa3c8418ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:40.276102 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47027d4d-e27b-4ffd-b3d7-72fa3c8418ba admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:40.297585 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1123/2277] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:40.301489 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47027d4d-e27b-4ffd-b3d7-72fa3c8418ba admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:40.306852 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-47027d4d-e27b-4ffd-b3d7-72fa3c8418ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:40.308328 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1155/2278] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:00:40 2022] PUT /identity/v3/projects/a2542aac3db74869b7f011ee6a15309a/users/45d624c90b2b448595cf0f5eebbb2307/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:40.311646 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de9ba6-5988-460c-9887-8b257134879d None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:40.311939 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de9ba6-5988-460c-9887-8b257134879d None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:40.312291 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de9ba6-5988-460c-9887-8b257134879d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:40.334582 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47027d4d-e27b-4ffd-b3d7-72fa3c8418ba admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:40.344573 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-a9de9ba6-5988-460c-9887-8b257134879d None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:40.345997 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-a9de9ba6-5988-460c-9887-8b257134879d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:40.445119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306b1d2-5ad8-4109-af0c-f2e8c0257674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:40.446560 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306b1d2-5ad8-4109-af0c-f2e8c0257674 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:40.447036 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306b1d2-5ad8-4109-af0c-f2e8c0257674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:40.447413 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306b1d2-5ad8-4109-af0c-f2e8c0257674 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:40.448412 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306b1d2-5ad8-4109-af0c-f2e8c0257674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:40.452518 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306b1d2-5ad8-4109-af0c-f2e8c0257674 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:40.472168 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1156/2279] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:40.473853 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de9ba6-5988-460c-9887-8b257134879d None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:40.475341 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-a9de9ba6-5988-460c-9887-8b257134879d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:40.490693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1124/2280] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:00:40.491552 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306b1d2-5ad8-4109-af0c-f2e8c0257674 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:40.494547 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de9ba6-5988-460c-9887-8b257134879d None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:40.502520 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306b1d2-5ad8-4109-af0c-f2e8c0257674 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:40.509513 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84708e4-d3ed-4fcd-998e-34e74135f229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:40.510339 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84708e4-d3ed-4fcd-998e-34e74135f229 admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:40.510776 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84708e4-d3ed-4fcd-998e-34e74135f229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:40.511416 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84708e4-d3ed-4fcd-998e-34e74135f229 admin admin] PATH_INFO: `/v3/projects/2f70e24c3d9d4181be8a529d35e0a4c3/users/5d8a1e4ac4644274944267ab90d20eab/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:40.513591 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a55202-0019-4de5-b283-17b0d0331cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:40.514418 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a55202-0019-4de5-b283-17b0d0331cd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:40.514741 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a55202-0019-4de5-b283-17b0d0331cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:40.515020 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a55202-0019-4de5-b283-17b0d0331cd5 admin admin] PATH_INFO: `/v3/projects/6e8bd8d8d1884f5ea6c0f0b8cf633b2c` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:40.520043 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a55202-0019-4de5-b283-17b0d0331cd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e8bd8d8d1884f5ea6c0f0b8cf633b2c)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:40.522175 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a55202-0019-4de5-b283-17b0d0331cd5 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:40.548411 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:40.553643 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84708e4-d3ed-4fcd-998e-34e74135f229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f70e24c3d9d4181be8a529d35e0a4c3, user_id=5d8a1e4ac4644274944267ab90d20eab, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:40.561954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84708e4-d3ed-4fcd-998e-34e74135f229 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:40.579020 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:40.588455 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1125/2281] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:00:40 2022] PUT /identity/v3/projects/2f70e24c3d9d4181be8a529d35e0a4c3/users/5d8a1e4ac4644274944267ab90d20eab/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:40.591163 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84708e4-d3ed-4fcd-998e-34e74135f229 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:40.593450 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-a84708e4-d3ed-4fcd-998e-34e74135f229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:40.608308 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-d9a55202-0019-4de5-b283-17b0d0331cd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e8bd8d8d1884f5ea6c0f0b8cf633b2c', 'request_id': 'req-d9a55202-0019-4de5-b283-17b0d0331cd5'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:40.631114 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-d9a55202-0019-4de5-b283-17b0d0331cd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e8bd8d8d1884f5ea6c0f0b8cf633b2c', 'request_id': 'req-d9a55202-0019-4de5-b283-17b0d0331cd5'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:40.644280 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-d9a55202-0019-4de5-b283-17b0d0331cd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e8bd8d8d1884f5ea6c0f0b8cf633b2c', 'request_id': 'req-d9a55202-0019-4de5-b283-17b0d0331cd5'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:40.664609 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-d9a55202-0019-4de5-b283-17b0d0331cd5 admin admin] The token cache is being invalidate because project 6e8bd8d8d1884f5ea6c0f0b8cf633b2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:00:40.664970 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-d9a55202-0019-4de5-b283-17b0d0331cd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:40.667294 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-d9a55202-0019-4de5-b283-17b0d0331cd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:40.670464 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1157/2282] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:00:40 2022] DELETE /identity/v3/projects/6e8bd8d8d1884f5ea6c0f0b8cf633b2c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:40.671460 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a55202-0019-4de5-b283-17b0d0331cd5 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:40.675441 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-d9a55202-0019-4de5-b283-17b0d0331cd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:40.727391 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84708e4-d3ed-4fcd-998e-34e74135f229 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:40.785497 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a55202-0019-4de5-b283-17b0d0331cd5 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:40.791909 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba01559-33e5-4bb8-a968-33ab89b92f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:40.792583 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba01559-33e5-4bb8-a968-33ab89b92f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:40.792905 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba01559-33e5-4bb8-a968-33ab89b92f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:40.793290 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba01559-33e5-4bb8-a968-33ab89b92f25 admin admin] PATH_INFO: `/v3/projects/988d7a6119364038bbfb65425c048d48` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:40.794472 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba01559-33e5-4bb8-a968-33ab89b92f25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=988d7a6119364038bbfb65425c048d48)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:40.796442 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba01559-33e5-4bb8-a968-33ab89b92f25 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:40.820038 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead8ac2-d813-4989-b77d-83c84ddbf8d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:40.821312 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead8ac2-d813-4989-b77d-83c84ddbf8d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:40.821850 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead8ac2-d813-4989-b77d-83c84ddbf8d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:40.822605 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead8ac2-d813-4989-b77d-83c84ddbf8d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:40.826523 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-1ead8ac2-d813-4989-b77d-83c84ddbf8d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:40.840917 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead8ac2-d813-4989-b77d-83c84ddbf8d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:40.842545 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead8ac2-d813-4989-b77d-83c84ddbf8d6 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:40.852194 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1126/2283] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:00:40.853981 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e1f64-b786-454d-a9a8-ff840f193e41 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:40.854268 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e1f64-b786-454d-a9a8-ff840f193e41 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:40.854546 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e1f64-b786-454d-a9a8-ff840f193e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:40.859650 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-eba01559-33e5-4bb8-a968-33ab89b92f25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '988d7a6119364038bbfb65425c048d48', 'request_id': 'req-eba01559-33e5-4bb8-a968-33ab89b92f25'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:40.869818 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-eba01559-33e5-4bb8-a968-33ab89b92f25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '988d7a6119364038bbfb65425c048d48', 'request_id': 'req-eba01559-33e5-4bb8-a968-33ab89b92f25'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:40.875188 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-6f3e1f64-b786-454d-a9a8-ff840f193e41 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:40.876437 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-6f3e1f64-b786-454d-a9a8-ff840f193e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:40.878990 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-eba01559-33e5-4bb8-a968-33ab89b92f25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '988d7a6119364038bbfb65425c048d48', 'request_id': 'req-eba01559-33e5-4bb8-a968-33ab89b92f25'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:40.896229 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-eba01559-33e5-4bb8-a968-33ab89b92f25 admin admin] The token cache is being invalidate because project 988d7a6119364038bbfb65425c048d48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:00:40.896572 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-eba01559-33e5-4bb8-a968-33ab89b92f25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:40.897301 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-eba01559-33e5-4bb8-a968-33ab89b92f25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:40.899147 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1158/2284] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:00:40 2022] DELETE /identity/v3/projects/988d7a6119364038bbfb65425c048d48 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:40.904142 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba01559-33e5-4bb8-a968-33ab89b92f25 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:40.904142 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-eba01559-33e5-4bb8-a968-33ab89b92f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:40.960734 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1127/2285] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:40.962355 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237597f-9b97-4b1c-982e-6c93fae976c5 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:40.962982 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237597f-9b97-4b1c-982e-6c93fae976c5 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:40.963316 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237597f-9b97-4b1c-982e-6c93fae976c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:40.963610 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:40.988389 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-1237597f-9b97-4b1c-982e-6c93fae976c5 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:40.989756 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-1237597f-9b97-4b1c-982e-6c93fae976c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:40.993049 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba01559-33e5-4bb8-a968-33ab89b92f25 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:40.999209 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee683c5-083c-4625-bc47-a7b392b6a47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:41.006899 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1128/2286] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:41.007522 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee683c5-083c-4625-bc47-a7b392b6a47b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:41.007522 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee683c5-083c-4625-bc47-a7b392b6a47b admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:41.007522 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee683c5-083c-4625-bc47-a7b392b6a47b admin admin] PATH_INFO: `/v3/users/268cced3ccab42dabb0ff527497ca9e3` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:41.007745 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237597f-9b97-4b1c-982e-6c93fae976c5 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:41.007745 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-1237597f-9b97-4b1c-982e-6c93fae976c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:41.009382 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee683c5-083c-4625-bc47-a7b392b6a47b admin admin] RBAC: Authorizing `identity:delete_user(user_id=268cced3ccab42dabb0ff527497ca9e3)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:41.011655 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee683c5-083c-4625-bc47-a7b392b6a47b admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:41.086193 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:41.106095 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237597f-9b97-4b1c-982e-6c93fae976c5 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:41.108015 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-0ee683c5-083c-4625-bc47-a7b392b6a47b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '268cced3ccab42dabb0ff527497ca9e3'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:41.109340 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-0ee683c5-083c-4625-bc47-a7b392b6a47b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '268cced3ccab42dabb0ff527497ca9e3'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:41.117014 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e6044-60f8-40b3-b4db-af485fa3de19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:41.117665 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e6044-60f8-40b3-b4db-af485fa3de19 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:41.118117 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e6044-60f8-40b3-b4db-af485fa3de19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:41.118400 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e6044-60f8-40b3-b4db-af485fa3de19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:41.120420 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-0ee683c5-083c-4625-bc47-a7b392b6a47b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '268cced3ccab42dabb0ff527497ca9e3'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:41.121030 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-006e6044-60f8-40b3-b4db-af485fa3de19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:41.138095 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006e6044-60f8-40b3-b4db-af485fa3de19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:41.139657 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006e6044-60f8-40b3-b4db-af485fa3de19 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:41.143444 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-0ee683c5-083c-4625-bc47-a7b392b6a47b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '268cced3ccab42dabb0ff527497ca9e3'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:41.150879 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1129/2287] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:00:41.152359 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bc070-2dc6-4fd6-9f02-f725f109f88b None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:41.152991 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bc070-2dc6-4fd6-9f02-f725f109f88b None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:41.153706 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bc070-2dc6-4fd6-9f02-f725f109f88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:41.153818 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-0ee683c5-083c-4625-bc47-a7b392b6a47b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '268cced3ccab42dabb0ff527497ca9e3'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:41.166984 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1159/2288] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:00:40 2022] DELETE /identity/v3/users/268cced3ccab42dabb0ff527497ca9e3 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:41.182241 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-979bc070-2dc6-4fd6-9f02-f725f109f88b None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:41.185049 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-979bc070-2dc6-4fd6-9f02-f725f109f88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:41.314388 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1130/2289] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:41.319000 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee683c5-083c-4625-bc47-a7b392b6a47b admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:41.333524 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee683c5-083c-4625-bc47-a7b392b6a47b admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:41.339601 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62107a-44b4-41b7-b6ba-6a489ad88310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:41.340970 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62107a-44b4-41b7-b6ba-6a489ad88310 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:41.341526 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62107a-44b4-41b7-b6ba-6a489ad88310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:41.341866 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62107a-44b4-41b7-b6ba-6a489ad88310 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:41.342755 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62107a-44b4-41b7-b6ba-6a489ad88310 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:00:41.343586 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62107a-44b4-41b7-b6ba-6a489ad88310 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:41.345562 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62107a-44b4-41b7-b6ba-6a489ad88310 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:41.363822 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1160/2290] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 16:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:00:41.365242 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bc070-2dc6-4fd6-9f02-f725f109f88b None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:41.377856 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bc070-2dc6-4fd6-9f02-f725f109f88b None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:41.383453 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7741b6-a5bf-4bca-9d21-ac667d5c2b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:41.384345 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7741b6-a5bf-4bca-9d21-ac667d5c2b11 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:41.384706 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7741b6-a5bf-4bca-9d21-ac667d5c2b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:41.385044 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7741b6-a5bf-4bca-9d21-ac667d5c2b11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:41.385905 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7741b6-a5bf-4bca-9d21-ac667d5c2b11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:41.390068 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7741b6-a5bf-4bca-9d21-ac667d5c2b11 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:41.431805 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1131/2291] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:00:41 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:00:41.433378 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62107a-44b4-41b7-b6ba-6a489ad88310 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:41.444473 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62107a-44b4-41b7-b6ba-6a489ad88310 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:41.524350 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c4cbe-bd5f-4954-b118-a5ffd1921c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:41.525028 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c4cbe-bd5f-4954-b118-a5ffd1921c4b admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:41.525316 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c4cbe-bd5f-4954-b118-a5ffd1921c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:41.525591 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c4cbe-bd5f-4954-b118-a5ffd1921c4b admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:41.526231 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c4cbe-bd5f-4954-b118-a5ffd1921c4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:41.528370 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c4cbe-bd5f-4954-b118-a5ffd1921c4b admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:41.560866 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7741b6-a5bf-4bca-9d21-ac667d5c2b11 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:41.572103 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1161/2292] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:00:41 2022] POST /identity/v3/users => generated 287 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:41.575008 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7741b6-a5bf-4bca-9d21-ac667d5c2b11 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:41.581374 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba44f9-4117-46a3-87b2-b578ac0c63e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:41.582453 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba44f9-4117-46a3-87b2-b578ac0c63e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:41.582738 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba44f9-4117-46a3-87b2-b578ac0c63e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:41.583009 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba44f9-4117-46a3-87b2-b578ac0c63e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:41.583841 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba44f9-4117-46a3-87b2-b578ac0c63e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:41.585441 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba44f9-4117-46a3-87b2-b578ac0c63e6 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:41.600155 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1132/2293] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:41.604296 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c4cbe-bd5f-4954-b118-a5ffd1921c4b admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:41.620630 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c4cbe-bd5f-4954-b118-a5ffd1921c4b admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:41.629619 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d08fc-9393-4de4-86c5-2366920e2c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:41.630163 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d08fc-9393-4de4-86c5-2366920e2c1a admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:41.630437 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d08fc-9393-4de4-86c5-2366920e2c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:41.630705 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d08fc-9393-4de4-86c5-2366920e2c1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:41.631364 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d08fc-9393-4de4-86c5-2366920e2c1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:41.641602 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d08fc-9393-4de4-86c5-2366920e2c1a admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:41.665333 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12faa29a-8080-420c-a151-0cf42947fe03 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:41.665703 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12faa29a-8080-420c-a151-0cf42947fe03 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:41.666234 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12faa29a-8080-420c-a151-0cf42947fe03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:41.671552 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1162/2294] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:41.675595 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d08fc-9393-4de4-86c5-2366920e2c1a admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:41.689370 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d08fc-9393-4de4-86c5-2366920e2c1a admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:41.697274 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c02b54-928b-4b93-88a6-7da4ae589cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:41.698137 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c02b54-928b-4b93-88a6-7da4ae589cbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:41.698318 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c02b54-928b-4b93-88a6-7da4ae589cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:41.698487 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c02b54-928b-4b93-88a6-7da4ae589cbb admin admin] PATH_INFO: `/v3/projects/47a7d98889e84676890525536cfafda6/users/54646193ef6440bf84225cfdc9c6eff1/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:41.716457 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-12faa29a-8080-420c-a151-0cf42947fe03 None None] MFA Rules not processed for user `45d624c90b2b448595cf0f5eebbb2307`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:41.722172 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c02b54-928b-4b93-88a6-7da4ae589cbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=47a7d98889e84676890525536cfafda6, user_id=54646193ef6440bf84225cfdc9c6eff1, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:41.729308 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c02b54-928b-4b93-88a6-7da4ae589cbb admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:41.735936 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-12faa29a-8080-420c-a151-0cf42947fe03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:41.771254 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1163/2295] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:00:41 2022] PUT /identity/v3/projects/47a7d98889e84676890525536cfafda6/users/54646193ef6440bf84225cfdc9c6eff1/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:00:41.785282 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af719f36-796d-4d0a-8004-fd770771586d None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:41.785282 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af719f36-796d-4d0a-8004-fd770771586d None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:41.785282 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af719f36-796d-4d0a-8004-fd770771586d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:41.832734 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:41.873976 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-af719f36-796d-4d0a-8004-fd770771586d None None] MFA Rules not processed for user `54646193ef6440bf84225cfdc9c6eff1`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:41.875198 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-af719f36-796d-4d0a-8004-fd770771586d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:41.899909 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1133/2296] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:00:41.901014 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12faa29a-8080-420c-a151-0cf42947fe03 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:41.906790 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-12faa29a-8080-420c-a151-0cf42947fe03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:41.942091 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12faa29a-8080-420c-a151-0cf42947fe03 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:42.030039 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1164/2297] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:42.030039 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af719f36-796d-4d0a-8004-fd770771586d None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:42.030039 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-af719f36-796d-4d0a-8004-fd770771586d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:42.031874 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:42.067196 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e7fca-99ce-4243-bb6d-3bf211f3ab15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:42.067841 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e7fca-99ce-4243-bb6d-3bf211f3ab15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:42.068118 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e7fca-99ce-4243-bb6d-3bf211f3ab15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:42.068381 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e7fca-99ce-4243-bb6d-3bf211f3ab15 admin admin] PATH_INFO: `/v3/projects/e344a938bf314704a6613608afb04c25` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:42.071279 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e7fca-99ce-4243-bb6d-3bf211f3ab15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e344a938bf314704a6613608afb04c25)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:42.073247 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e7fca-99ce-4243-bb6d-3bf211f3ab15 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:42.129209 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af719f36-796d-4d0a-8004-fd770771586d None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:42.134967 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2e669-8795-4658-958a-74bd2e2d2721 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:42.135679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2e669-8795-4658-958a-74bd2e2d2721 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:42.136025 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2e669-8795-4658-958a-74bd2e2d2721 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:42.136419 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2e669-8795-4658-958a-74bd2e2d2721 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:42.161966 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-ca2e7fca-99ce-4243-bb6d-3bf211f3ab15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e344a938bf314704a6613608afb04c25', 'request_id': 'req-ca2e7fca-99ce-4243-bb6d-3bf211f3ab15'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:42.173280 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-ca2e7fca-99ce-4243-bb6d-3bf211f3ab15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e344a938bf314704a6613608afb04c25', 'request_id': 'req-ca2e7fca-99ce-4243-bb6d-3bf211f3ab15'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:42.194221 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-ca2e7fca-99ce-4243-bb6d-3bf211f3ab15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e344a938bf314704a6613608afb04c25', 'request_id': 'req-ca2e7fca-99ce-4243-bb6d-3bf211f3ab15'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:42.211230 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-ca2e7fca-99ce-4243-bb6d-3bf211f3ab15 admin admin] The token cache is being invalidate because project e344a938bf314704a6613608afb04c25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:00:42.211533 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-ca2e7fca-99ce-4243-bb6d-3bf211f3ab15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:42.212723 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-ca2e7fca-99ce-4243-bb6d-3bf211f3ab15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:42.214638 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1134/2298] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:00:41 2022] DELETE /identity/v3/projects/e344a938bf314704a6613608afb04c25 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:42.219918 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2e669-8795-4658-958a-74bd2e2d2721 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:42.223112 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2e669-8795-4658-958a-74bd2e2d2721 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:42.238127 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1165/2299] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:00:42.350466 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42527eae-3eb4-4d7a-9983-75a25110c530 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:42.350679 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42527eae-3eb4-4d7a-9983-75a25110c530 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:42.350919 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42527eae-3eb4-4d7a-9983-75a25110c530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:42.433527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2e669-8795-4658-958a-74bd2e2d2721 service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:42.435604 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-42527eae-3eb4-4d7a-9983-75a25110c530 None None] MFA Rules not processed for user `5d8a1e4ac4644274944267ab90d20eab`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:42.436224 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-cbb2e669-8795-4658-958a-74bd2e2d2721 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:42.437156 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-42527eae-3eb4-4d7a-9983-75a25110c530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:42.452217 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2e669-8795-4658-958a-74bd2e2d2721 service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:42.529359 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f71f90-e965-4515-be00-e5010ddf5c7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:42.530178 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f71f90-e965-4515-be00-e5010ddf5c7b service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:42.530847 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f71f90-e965-4515-be00-e5010ddf5c7b service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:42.531120 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f71f90-e965-4515-be00-e5010ddf5c7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:42.535154 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-29f71f90-e965-4515-be00-e5010ddf5c7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:42.544859 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:42.558263 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1135/2300] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:42.559223 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42527eae-3eb4-4d7a-9983-75a25110c530 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:42.562641 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-42527eae-3eb4-4d7a-9983-75a25110c530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:42.622694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f71f90-e965-4515-be00-e5010ddf5c7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:42.624365 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f71f90-e965-4515-be00-e5010ddf5c7b service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:42.639582 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1166/2301] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:00:42.691655 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42527eae-3eb4-4d7a-9983-75a25110c530 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:42.698912 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b0f28-bb9d-42bd-b230-7024fe8637c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:42.700303 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b0f28-bb9d-42bd-b230-7024fe8637c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:42.700728 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b0f28-bb9d-42bd-b230-7024fe8637c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:42.701194 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b0f28-bb9d-42bd-b230-7024fe8637c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:42.701919 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b0f28-bb9d-42bd-b230-7024fe8637c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:42.704446 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b0f28-bb9d-42bd-b230-7024fe8637c2 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:42.733815 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:42.755409 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1136/2302] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:00:42 2022] POST /identity/v3/projects => generated 371 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:42.759977 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f71f90-e965-4515-be00-e5010ddf5c7b service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:42.791887 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f71f90-e965-4515-be00-e5010ddf5c7b service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:42.911357 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d015278e-8378-459f-ab7d-340b11541fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:42.911977 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015278e-8378-459f-ab7d-340b11541fb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:42.912287 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015278e-8378-459f-ab7d-340b11541fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:42.912602 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015278e-8378-459f-ab7d-340b11541fb7 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:42.913256 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d015278e-8378-459f-ab7d-340b11541fb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:42.915160 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d015278e-8378-459f-ab7d-340b11541fb7 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:42.942110 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1167/2303] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:00:42 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:42.946113 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b0f28-bb9d-42bd-b230-7024fe8637c2 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:42.957091 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b0f28-bb9d-42bd-b230-7024fe8637c2 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:42.962394 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc441d-ceea-48bf-a169-c173e60d98be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:42.963013 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc441d-ceea-48bf-a169-c173e60d98be admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:42.963291 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc441d-ceea-48bf-a169-c173e60d98be admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:42.964138 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc441d-ceea-48bf-a169-c173e60d98be admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:42.964253 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc441d-ceea-48bf-a169-c173e60d98be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:42.966746 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc441d-ceea-48bf-a169-c173e60d98be admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:42.986632 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1137/2304] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:42.990981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d015278e-8378-459f-ab7d-340b11541fb7 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:43.010717 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d015278e-8378-459f-ab7d-340b11541fb7 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:43.019505 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743dab1d-637c-4e93-9e88-e9493e70ce3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:43.028845 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743dab1d-637c-4e93-9e88-e9493e70ce3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:43.028845 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743dab1d-637c-4e93-9e88-e9493e70ce3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:43.028845 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743dab1d-637c-4e93-9e88-e9493e70ce3d admin admin] PATH_INFO: `/v3/projects/0bdf772e68394307b978424ae26e6cb8/users/8c243e3da5df4f438a22366629f79326/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:43.048566 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743dab1d-637c-4e93-9e88-e9493e70ce3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bdf772e68394307b978424ae26e6cb8, user_id=8c243e3da5df4f438a22366629f79326, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:43.051593 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743dab1d-637c-4e93-9e88-e9493e70ce3d admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:43.072433 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1168/2305] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:00:42 2022] PUT /identity/v3/projects/0bdf772e68394307b978424ae26e6cb8/users/8c243e3da5df4f438a22366629f79326/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:00:43.077250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc441d-ceea-48bf-a169-c173e60d98be admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:43.120812 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc441d-ceea-48bf-a169-c173e60d98be admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:43.198612 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365138ca-fbd2-4a21-ac6c-4a622985dd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:43.199297 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365138ca-fbd2-4a21-ac6c-4a622985dd75 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:43.200216 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365138ca-fbd2-4a21-ac6c-4a622985dd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:43.200329 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365138ca-fbd2-4a21-ac6c-4a622985dd75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:43.200996 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365138ca-fbd2-4a21-ac6c-4a622985dd75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:43.202619 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365138ca-fbd2-4a21-ac6c-4a622985dd75 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:43.215894 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1138/2306] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:43.217092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743dab1d-637c-4e93-9e88-e9493e70ce3d admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:43.227706 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743dab1d-637c-4e93-9e88-e9493e70ce3d admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:43.233502 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134db3a1-3950-46cd-acf6-8a6c34e21216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:43.234178 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134db3a1-3950-46cd-acf6-8a6c34e21216 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:43.234462 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134db3a1-3950-46cd-acf6-8a6c34e21216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:43.234760 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134db3a1-3950-46cd-acf6-8a6c34e21216 admin admin] PATH_INFO: `/v3/projects/0bdf772e68394307b978424ae26e6cb8/users/8c243e3da5df4f438a22366629f79326/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:43.237260 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134db3a1-3950-46cd-acf6-8a6c34e21216 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bdf772e68394307b978424ae26e6cb8, user_id=8c243e3da5df4f438a22366629f79326, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:43.240191 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134db3a1-3950-46cd-acf6-8a6c34e21216 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:43.252068 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1169/2307] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:00:43 2022] PUT /identity/v3/projects/0bdf772e68394307b978424ae26e6cb8/users/8c243e3da5df4f438a22366629f79326/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:43.878230 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb2349-c0ed-4a29-9850-775bed7031f2 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:43.878519 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb2349-c0ed-4a29-9850-775bed7031f2 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:43.878794 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb2349-c0ed-4a29-9850-775bed7031f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:43.913613 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-25bb2349-c0ed-4a29-9850-775bed7031f2 None None] MFA Rules not processed for user `8c243e3da5df4f438a22366629f79326`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:43.915362 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-25bb2349-c0ed-4a29-9850-775bed7031f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:43.989782 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b5e40-98ce-479e-8ca7-6a4412d183b9 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:43.990183 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b5e40-98ce-479e-8ca7-6a4412d183b9 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:43.990537 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b5e40-98ce-479e-8ca7-6a4412d183b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:44.019364 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-cf7b5e40-98ce-479e-8ca7-6a4412d183b9 None None] MFA Rules not processed for user `45d624c90b2b448595cf0f5eebbb2307`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:44.020622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-cf7b5e40-98ce-479e-8ca7-6a4412d183b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:44.048546 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1139/2308] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:43 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:44.060361 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a6374-af7e-4ebe-987c-511deba5366f None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:44.060653 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a6374-af7e-4ebe-987c-511deba5366f None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:44.061008 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a6374-af7e-4ebe-987c-511deba5366f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:44.082414 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-a59a6374-af7e-4ebe-987c-511deba5366f None None] MFA Rules not processed for user `5d8a1e4ac4644274944267ab90d20eab`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:44.083623 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-a59a6374-af7e-4ebe-987c-511deba5366f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:44.112962 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1170/2309] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:00:44.171338 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1140/2310] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:00:44.184605 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b5e40-98ce-479e-8ca7-6a4412d183b9 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:44.188403 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-cf7b5e40-98ce-479e-8ca7-6a4412d183b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:44.209570 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:44.221999 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47670647-b4d0-442c-8476-780d80f3d568 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:44.222516 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47670647-b4d0-442c-8476-780d80f3d568 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:44.222631 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47670647-b4d0-442c-8476-780d80f3d568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:44.235162 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:44.256245 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-47670647-b4d0-442c-8476-780d80f3d568 None None] MFA Rules not processed for user `54646193ef6440bf84225cfdc9c6eff1`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:44.258168 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-47670647-b4d0-442c-8476-780d80f3d568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:44.294709 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b5e40-98ce-479e-8ca7-6a4412d183b9 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:44.302264 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c402a-6c83-44c9-9afa-31eb9f9afc9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:44.303005 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c402a-6c83-44c9-9afa-31eb9f9afc9c service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:44.303445 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c402a-6c83-44c9-9afa-31eb9f9afc9c service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:44.303822 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c402a-6c83-44c9-9afa-31eb9f9afc9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:44.313926 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c402a-6c83-44c9-9afa-31eb9f9afc9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:44.315917 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c402a-6c83-44c9-9afa-31eb9f9afc9c service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:44.341307 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1171/2311] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:00:44.343653 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1141/2312] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:00:45.363711 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c402a-6c83-44c9-9afa-31eb9f9afc9c service nova] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:45.365574 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c97c402a-6c83-44c9-9afa-31eb9f9afc9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:45.482838 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c402a-6c83-44c9-9afa-31eb9f9afc9c service nova] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:45.488430 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4bbe7-e366-4ce3-b262-565a80ad17c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:45.490223 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4bbe7-e366-4ce3-b262-565a80ad17c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:45.490706 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4bbe7-e366-4ce3-b262-565a80ad17c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:45.491261 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4bbe7-e366-4ce3-b262-565a80ad17c6 admin admin] PATH_INFO: `/v3/users/732004e1aecb4830a375976194c2dbb1` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:45.492938 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4bbe7-e366-4ce3-b262-565a80ad17c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=732004e1aecb4830a375976194c2dbb1)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:45.495198 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4bbe7-e366-4ce3-b262-565a80ad17c6 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:45.564636 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f3b4bbe7-e366-4ce3-b262-565a80ad17c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '732004e1aecb4830a375976194c2dbb1'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:45.565685 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f3b4bbe7-e366-4ce3-b262-565a80ad17c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '732004e1aecb4830a375976194c2dbb1'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:45.579751 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f3b4bbe7-e366-4ce3-b262-565a80ad17c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '732004e1aecb4830a375976194c2dbb1'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:45.597177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f3b4bbe7-e366-4ce3-b262-565a80ad17c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '732004e1aecb4830a375976194c2dbb1'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:45.608013 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f3b4bbe7-e366-4ce3-b262-565a80ad17c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '732004e1aecb4830a375976194c2dbb1'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:45.619614 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1172/2313] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:00:45 2022] DELETE /identity/v3/users/732004e1aecb4830a375976194c2dbb1 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:45.622505 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8b048-03bc-4fd8-bc3d-2624de50149a None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:45.622965 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8b048-03bc-4fd8-bc3d-2624de50149a None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:45.623149 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8b048-03bc-4fd8-bc3d-2624de50149a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:45.656030 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-06e8b048-03bc-4fd8-bc3d-2624de50149a None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:45.657530 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-06e8b048-03bc-4fd8-bc3d-2624de50149a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:45.745153 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1142/2314] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:45.758023 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4bbe7-e366-4ce3-b262-565a80ad17c6 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:45.759948 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-f3b4bbe7-e366-4ce3-b262-565a80ad17c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:45.771896 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:45.838055 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4bbe7-e366-4ce3-b262-565a80ad17c6 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:45.843928 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806a83c-deb7-4c8c-8194-70f78dbe5438 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:45.845045 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806a83c-deb7-4c8c-8194-70f78dbe5438 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:45.845371 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806a83c-deb7-4c8c-8194-70f78dbe5438 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:45.845639 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806a83c-deb7-4c8c-8194-70f78dbe5438 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:45.857603 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4806a83c-deb7-4c8c-8194-70f78dbe5438 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:45.866293 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4806a83c-deb7-4c8c-8194-70f78dbe5438 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:45.878790 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1173/2315] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:00:46.253424 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e8b048-03bc-4fd8-bc3d-2624de50149a None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:46.255139 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-06e8b048-03bc-4fd8-bc3d-2624de50149a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:46.287266 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e8b048-03bc-4fd8-bc3d-2624de50149a None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:46.296558 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b9cb9-0935-40ba-9ae8-0225360d9efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:46.297628 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b9cb9-0935-40ba-9ae8-0225360d9efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:46.298003 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b9cb9-0935-40ba-9ae8-0225360d9efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:46.298488 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b9cb9-0935-40ba-9ae8-0225360d9efe admin admin] PATH_INFO: `/v3/projects/d57943e222ff40a5b7767d126b3abed6` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:46.300734 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b9cb9-0935-40ba-9ae8-0225360d9efe admin admin] RBAC: Authorizing `identity:delete_project(project_id=d57943e222ff40a5b7767d126b3abed6)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:46.305571 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b9cb9-0935-40ba-9ae8-0225360d9efe admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:46.389778 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-b12b9cb9-0935-40ba-9ae8-0225360d9efe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd57943e222ff40a5b7767d126b3abed6', 'request_id': 'req-b12b9cb9-0935-40ba-9ae8-0225360d9efe'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:46.412675 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-b12b9cb9-0935-40ba-9ae8-0225360d9efe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd57943e222ff40a5b7767d126b3abed6', 'request_id': 'req-b12b9cb9-0935-40ba-9ae8-0225360d9efe'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:46.440653 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-b12b9cb9-0935-40ba-9ae8-0225360d9efe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd57943e222ff40a5b7767d126b3abed6', 'request_id': 'req-b12b9cb9-0935-40ba-9ae8-0225360d9efe'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:46.456017 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-b12b9cb9-0935-40ba-9ae8-0225360d9efe admin admin] The token cache is being invalidate because project d57943e222ff40a5b7767d126b3abed6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:00:46.456565 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-b12b9cb9-0935-40ba-9ae8-0225360d9efe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:46.458876 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-b12b9cb9-0935-40ba-9ae8-0225360d9efe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:00:46.466260 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1143/2316] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:00:46 2022] DELETE /identity/v3/projects/d57943e222ff40a5b7767d126b3abed6 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:00:46.466431 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ad68d-2e28-46ca-83ff-c89aae647746 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:46.466850 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ad68d-2e28-46ca-83ff-c89aae647746 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:46.467602 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ad68d-2e28-46ca-83ff-c89aae647746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:46.503255 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-611ad68d-2e28-46ca-83ff-c89aae647746 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:46.504547 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-611ad68d-2e28-46ca-83ff-c89aae647746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:46.597703 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1174/2317] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:00:46.599520 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf94969-5e2b-44dd-9bda-1c496a84305c None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:46.599912 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf94969-5e2b-44dd-9bda-1c496a84305c None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:46.600186 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf94969-5e2b-44dd-9bda-1c496a84305c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:46.624742 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-1cf94969-5e2b-44dd-9bda-1c496a84305c None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:46.626117 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-1cf94969-5e2b-44dd-9bda-1c496a84305c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:46.634689 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1144/2318] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:46.639495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ad68d-2e28-46ca-83ff-c89aae647746 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:46.649063 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ad68d-2e28-46ca-83ff-c89aae647746 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:46.653678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9cef0-e721-492f-a867-64cc37abc4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:46.654283 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9cef0-e721-492f-a867-64cc37abc4a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:46.654562 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9cef0-e721-492f-a867-64cc37abc4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:46.654832 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9cef0-e721-492f-a867-64cc37abc4a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:46.655481 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9cef0-e721-492f-a867-64cc37abc4a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:00:46.655782 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9cef0-e721-492f-a867-64cc37abc4a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:46.657407 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9cef0-e721-492f-a867-64cc37abc4a9 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:46.669291 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1175/2319] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 16:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:00:46.673679 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf94969-5e2b-44dd-9bda-1c496a84305c None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:46.683285 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf94969-5e2b-44dd-9bda-1c496a84305c None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:46.688834 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985215c-8295-4656-b025-b9b9f736fc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:46.689464 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985215c-8295-4656-b025-b9b9f736fc08 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:46.689768 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985215c-8295-4656-b025-b9b9f736fc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:46.690037 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985215c-8295-4656-b025-b9b9f736fc08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:46.690667 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7985215c-8295-4656-b025-b9b9f736fc08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:46.692558 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7985215c-8295-4656-b025-b9b9f736fc08 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:46.722904 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1145/2320] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:00:46 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:46.732309 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9cef0-e721-492f-a867-64cc37abc4a9 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:46.744056 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9cef0-e721-492f-a867-64cc37abc4a9 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:46.820066 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73dc3b8-c68f-4ad6-a25b-5922957dbed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:46.820744 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73dc3b8-c68f-4ad6-a25b-5922957dbed6 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:46.821074 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73dc3b8-c68f-4ad6-a25b-5922957dbed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:46.821354 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73dc3b8-c68f-4ad6-a25b-5922957dbed6 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:46.822169 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73dc3b8-c68f-4ad6-a25b-5922957dbed6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:46.824161 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73dc3b8-c68f-4ad6-a25b-5922957dbed6 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:46.846632 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1176/2321] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:00:46 2022] POST /identity/v3/users => generated 292 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:00:46.851115 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985215c-8295-4656-b025-b9b9f736fc08 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:46.859110 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:46.863313 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985215c-8295-4656-b025-b9b9f736fc08 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:46.869604 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05016cf-be63-4970-932c-bb0231d5ad3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:46.870225 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05016cf-be63-4970-932c-bb0231d5ad3d admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:46.870702 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05016cf-be63-4970-932c-bb0231d5ad3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:46.871312 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05016cf-be63-4970-932c-bb0231d5ad3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:46.872259 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05016cf-be63-4970-932c-bb0231d5ad3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:46.873912 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05016cf-be63-4970-932c-bb0231d5ad3d admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:46.884022 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1146/2322] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:46.888275 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73dc3b8-c68f-4ad6-a25b-5922957dbed6 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:46.898089 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73dc3b8-c68f-4ad6-a25b-5922957dbed6 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:46.903540 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe832705-f14b-40fe-9cfc-a79516e615d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:46.904150 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe832705-f14b-40fe-9cfc-a79516e615d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:46.904429 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe832705-f14b-40fe-9cfc-a79516e615d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:46.904723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe832705-f14b-40fe-9cfc-a79516e615d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:46.905403 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe832705-f14b-40fe-9cfc-a79516e615d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:46.906980 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe832705-f14b-40fe-9cfc-a79516e615d0 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:46.917335 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1177/2323] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:00:46.922300 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05016cf-be63-4970-932c-bb0231d5ad3d admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:46.931888 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05016cf-be63-4970-932c-bb0231d5ad3d admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:46.936746 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844b8fb-9fe6-4598-bc05-8a17758d807a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:46.937416 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844b8fb-9fe6-4598-bc05-8a17758d807a admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:46.937691 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844b8fb-9fe6-4598-bc05-8a17758d807a admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:46.937958 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844b8fb-9fe6-4598-bc05-8a17758d807a admin admin] PATH_INFO: `/v3/projects/ff02e1b08333461d98ec516b3621e986/users/9ab9f971cab5489fab98b71656569e07/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:46.951914 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0844b8fb-9fe6-4598-bc05-8a17758d807a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff02e1b08333461d98ec516b3621e986, user_id=9ab9f971cab5489fab98b71656569e07, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:46.954576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0844b8fb-9fe6-4598-bc05-8a17758d807a admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:46.967509 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1147/2324] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:00:46 2022] PUT /identity/v3/projects/ff02e1b08333461d98ec516b3621e986/users/9ab9f971cab5489fab98b71656569e07/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:00:46.972540 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff86b2-c6a2-46b1-b521-1712c5541676 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:46.972854 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff86b2-c6a2-46b1-b521-1712c5541676 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:46.973128 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff86b2-c6a2-46b1-b521-1712c5541676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:46.992401 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-e4ff86b2-c6a2-46b1-b521-1712c5541676 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:46.993635 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-e4ff86b2-c6a2-46b1-b521-1712c5541676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:47.002773 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:47.053301 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1178/2325] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:47.062982 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844b8fb-9fe6-4598-bc05-8a17758d807a admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:47.064962 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-0844b8fb-9fe6-4598-bc05-8a17758d807a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:47.126058 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844b8fb-9fe6-4598-bc05-8a17758d807a admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:47.129769 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3303ff-f67e-445e-888d-f2cc513b1990 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:47.130390 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3303ff-f67e-445e-888d-f2cc513b1990 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:47.130669 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3303ff-f67e-445e-888d-f2cc513b1990 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:47.130942 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3303ff-f67e-445e-888d-f2cc513b1990 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:47.145803 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3303ff-f67e-445e-888d-f2cc513b1990 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:47.147568 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3303ff-f67e-445e-888d-f2cc513b1990 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:47.161060 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1148/2326] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:00:48.982701 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b96de-c9ce-4326-b2e4-87972051ed53 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:48.983208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b96de-c9ce-4326-b2e4-87972051ed53 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:48.983669 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b96de-c9ce-4326-b2e4-87972051ed53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:49.077671 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-643b96de-c9ce-4326-b2e4-87972051ed53 None None] MFA Rules not processed for user `9ab9f971cab5489fab98b71656569e07`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:49.079228 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-643b96de-c9ce-4326-b2e4-87972051ed53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:49.267571 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1179/2327] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:00:49.279448 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3303ff-f67e-445e-888d-f2cc513b1990 service neutron] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:00:49.281393 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-bc3303ff-f67e-445e-888d-f2cc513b1990 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:49.397239 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3303ff-f67e-445e-888d-f2cc513b1990 service neutron] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:00:49.408236 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a436f6e4-8c29-4447-8a37-3b7ed68e66d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:00:49.409224 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436f6e4-8c29-4447-8a37-3b7ed68e66d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:49.410184 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436f6e4-8c29-4447-8a37-3b7ed68e66d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:49.410613 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436f6e4-8c29-4447-8a37-3b7ed68e66d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:49.428865 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a436f6e4-8c29-4447-8a37-3b7ed68e66d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:00:49.430765 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a436f6e4-8c29-4447-8a37-3b7ed68e66d2 service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:00:49.442808 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1149/2328] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:00:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:00:50.975729 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819c491-844f-4ff4-84d2-3252dd73d2e0 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:00:50.976261 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819c491-844f-4ff4-84d2-3252dd73d2e0 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:00:50.976261 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819c491-844f-4ff4-84d2-3252dd73d2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:00:51.000080 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-9819c491-844f-4ff4-84d2-3252dd73d2e0 None None] MFA Rules not processed for user `9ab9f971cab5489fab98b71656569e07`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:00:51.001914 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-9819c491-844f-4ff4-84d2-3252dd73d2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:00:51.011337 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1180/2329] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:00:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:00:59.437533 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=65,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:00.993410 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=55 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:01.010278 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a436f6e4-8c29-4447-8a37-3b7ed68e66d2 service cinder] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:01.012473 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-a436f6e4-8c29-4447-8a37-3b7ed68e66d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:01.035547 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a436f6e4-8c29-4447-8a37-3b7ed68e66d2 service cinder] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:01.042054 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4050a5-490e-4923-8d6f-a4bcdedf23c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:01.043537 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4050a5-490e-4923-8d6f-a4bcdedf23c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:01.044057 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4050a5-490e-4923-8d6f-a4bcdedf23c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:01.044529 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4050a5-490e-4923-8d6f-a4bcdedf23c0 admin admin] PATH_INFO: `/v3/users/9ec6168f0d544ae4899437ea6bc7b05b` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:01.045978 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4050a5-490e-4923-8d6f-a4bcdedf23c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ec6168f0d544ae4899437ea6bc7b05b)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:01.048159 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4050a5-490e-4923-8d6f-a4bcdedf23c0 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:01.123885 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4b4050a5-490e-4923-8d6f-a4bcdedf23c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ec6168f0d544ae4899437ea6bc7b05b'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:01.136734 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4b4050a5-490e-4923-8d6f-a4bcdedf23c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ec6168f0d544ae4899437ea6bc7b05b'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:01.137518 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4b4050a5-490e-4923-8d6f-a4bcdedf23c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ec6168f0d544ae4899437ea6bc7b05b'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:01.139012 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4b4050a5-490e-4923-8d6f-a4bcdedf23c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ec6168f0d544ae4899437ea6bc7b05b'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:01.147305 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4b4050a5-490e-4923-8d6f-a4bcdedf23c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ec6168f0d544ae4899437ea6bc7b05b'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:01.161836 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1150/2330] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:01:01 2022] DELETE /identity/v3/users/9ec6168f0d544ae4899437ea6bc7b05b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:01:01.167125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041ee5f-aae4-4abd-b577-f6f125df8ac0 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:01.167553 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041ee5f-aae4-4abd-b577-f6f125df8ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:01.167879 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041ee5f-aae4-4abd-b577-f6f125df8ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:01.187392 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-2041ee5f-aae4-4abd-b577-f6f125df8ac0 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:01:01.194887 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-2041ee5f-aae4-4abd-b577-f6f125df8ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:01.259951 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1181/2331] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:01:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:01:01.270275 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4050a5-490e-4923-8d6f-a4bcdedf23c0 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:01.273689 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-4b4050a5-490e-4923-8d6f-a4bcdedf23c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:01.337497 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4050a5-490e-4923-8d6f-a4bcdedf23c0 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:01.341952 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83fede-9e9b-4143-be2e-1cf7842e20f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:01.342555 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83fede-9e9b-4143-be2e-1cf7842e20f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:01.342829 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83fede-9e9b-4143-be2e-1cf7842e20f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:01.343096 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83fede-9e9b-4143-be2e-1cf7842e20f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:01.352326 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83fede-9e9b-4143-be2e-1cf7842e20f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:01.353785 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83fede-9e9b-4143-be2e-1cf7842e20f6 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:01.363587 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1151/2332] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:01:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:01:01.653126 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041ee5f-aae4-4abd-b577-f6f125df8ac0 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:01.654754 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-2041ee5f-aae4-4abd-b577-f6f125df8ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:01.668648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041ee5f-aae4-4abd-b577-f6f125df8ac0 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:01.673627 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb6d9fb-e2f4-468e-a135-eaf0bb7e2050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:01.674261 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6d9fb-e2f4-468e-a135-eaf0bb7e2050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:01.674537 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6d9fb-e2f4-468e-a135-eaf0bb7e2050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:01.674805 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6d9fb-e2f4-468e-a135-eaf0bb7e2050 admin admin] PATH_INFO: `/v3/projects/5aef1ed4921e44c3a379397c10afa55f` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:01.676870 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb6d9fb-e2f4-468e-a135-eaf0bb7e2050 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aef1ed4921e44c3a379397c10afa55f)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:01.678656 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb6d9fb-e2f4-468e-a135-eaf0bb7e2050 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:01.727528 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-adb6d9fb-e2f4-468e-a135-eaf0bb7e2050 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aef1ed4921e44c3a379397c10afa55f', 'request_id': 'req-adb6d9fb-e2f4-468e-a135-eaf0bb7e2050'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:01.736052 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-adb6d9fb-e2f4-468e-a135-eaf0bb7e2050 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aef1ed4921e44c3a379397c10afa55f', 'request_id': 'req-adb6d9fb-e2f4-468e-a135-eaf0bb7e2050'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:01.742339 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-adb6d9fb-e2f4-468e-a135-eaf0bb7e2050 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aef1ed4921e44c3a379397c10afa55f', 'request_id': 'req-adb6d9fb-e2f4-468e-a135-eaf0bb7e2050'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:01.752771 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-adb6d9fb-e2f4-468e-a135-eaf0bb7e2050 admin admin] The token cache is being invalidate because project 5aef1ed4921e44c3a379397c10afa55f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:01:01.753092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-adb6d9fb-e2f4-468e-a135-eaf0bb7e2050 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:01.753748 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-adb6d9fb-e2f4-468e-a135-eaf0bb7e2050 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:01.755315 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1182/2333] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:01:01 2022] DELETE /identity/v3/projects/5aef1ed4921e44c3a379397c10afa55f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:01:01.759442 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83fede-9e9b-4143-be2e-1cf7842e20f6 service neutron] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:01.769649 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83fede-9e9b-4143-be2e-1cf7842e20f6 service neutron] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:01.826529 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939b4be-a59d-4b87-8a13-c6a1c6bb2f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:01.827071 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939b4be-a59d-4b87-8a13-c6a1c6bb2f7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:01.827343 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939b4be-a59d-4b87-8a13-c6a1c6bb2f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:01.827611 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939b4be-a59d-4b87-8a13-c6a1c6bb2f7c admin admin] PATH_INFO: `/v3/users/5254f4a8f8214b2ba772845ef98d4491` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:01.828714 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b939b4be-a59d-4b87-8a13-c6a1c6bb2f7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5254f4a8f8214b2ba772845ef98d4491)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:01.830664 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b939b4be-a59d-4b87-8a13-c6a1c6bb2f7c admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:01.846878 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:01.878653 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-b939b4be-a59d-4b87-8a13-c6a1c6bb2f7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5254f4a8f8214b2ba772845ef98d4491'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:01.890988 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-b939b4be-a59d-4b87-8a13-c6a1c6bb2f7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5254f4a8f8214b2ba772845ef98d4491'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:01.891685 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-b939b4be-a59d-4b87-8a13-c6a1c6bb2f7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5254f4a8f8214b2ba772845ef98d4491'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:01.892301 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-b939b4be-a59d-4b87-8a13-c6a1c6bb2f7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5254f4a8f8214b2ba772845ef98d4491'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:01.899587 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-b939b4be-a59d-4b87-8a13-c6a1c6bb2f7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5254f4a8f8214b2ba772845ef98d4491'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:01.915457 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1152/2334] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:01:01 2022] DELETE /identity/v3/users/5254f4a8f8214b2ba772845ef98d4491 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:01:02.199000 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb6d9fb-e2f4-468e-a135-eaf0bb7e2050 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:02.201058 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-adb6d9fb-e2f4-468e-a135-eaf0bb7e2050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:02.218026 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb6d9fb-e2f4-468e-a135-eaf0bb7e2050 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:02.285813 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895eaa18-6de7-4b36-9b8e-5d03fa33c2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:02.286467 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895eaa18-6de7-4b36-9b8e-5d03fa33c2dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:02.286750 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895eaa18-6de7-4b36-9b8e-5d03fa33c2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:02.287025 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895eaa18-6de7-4b36-9b8e-5d03fa33c2dc admin admin] PATH_INFO: `/v3/projects/be79397582244a3c99b38904f2352acd` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:02.288306 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895eaa18-6de7-4b36-9b8e-5d03fa33c2dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=be79397582244a3c99b38904f2352acd)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:02.290246 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895eaa18-6de7-4b36-9b8e-5d03fa33c2dc admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:02.330695 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:02.359626 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-895eaa18-6de7-4b36-9b8e-5d03fa33c2dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be79397582244a3c99b38904f2352acd', 'request_id': 'req-895eaa18-6de7-4b36-9b8e-5d03fa33c2dc'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:02.368504 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-895eaa18-6de7-4b36-9b8e-5d03fa33c2dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be79397582244a3c99b38904f2352acd', 'request_id': 'req-895eaa18-6de7-4b36-9b8e-5d03fa33c2dc'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:02.386473 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-895eaa18-6de7-4b36-9b8e-5d03fa33c2dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be79397582244a3c99b38904f2352acd', 'request_id': 'req-895eaa18-6de7-4b36-9b8e-5d03fa33c2dc'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:02.407920 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-895eaa18-6de7-4b36-9b8e-5d03fa33c2dc admin admin] The token cache is being invalidate because project be79397582244a3c99b38904f2352acd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:01:02.408261 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-895eaa18-6de7-4b36-9b8e-5d03fa33c2dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:02.408971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-895eaa18-6de7-4b36-9b8e-5d03fa33c2dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:02.411146 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1183/2335] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:01:02 2022] DELETE /identity/v3/projects/be79397582244a3c99b38904f2352acd => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:01:02.416626 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02324c-1a11-4d4e-be73-84be1384b710 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:02.417309 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02324c-1a11-4d4e-be73-84be1384b710 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:02.417309 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02324c-1a11-4d4e-be73-84be1384b710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:02.440535 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-7a02324c-1a11-4d4e-be73-84be1384b710 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:01:02.441789 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-7a02324c-1a11-4d4e-be73-84be1384b710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:02.515622 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1153/2336] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:01:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:01:02.517826 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbafb0c-6d0b-4f65-b851-b075ffed3491 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:02.518335 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbafb0c-6d0b-4f65-b851-b075ffed3491 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:02.518848 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbafb0c-6d0b-4f65-b851-b075ffed3491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:02.559459 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-2cbafb0c-6d0b-4f65-b851-b075ffed3491 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:01:02.560710 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-2cbafb0c-6d0b-4f65-b851-b075ffed3491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:02.572653 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1184/2337] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:01:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:01:02.574534 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02324c-1a11-4d4e-be73-84be1384b710 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:02.591380 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02324c-1a11-4d4e-be73-84be1384b710 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:02.598610 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338510f-3047-439f-9ffb-a9c525e9a84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:02.599489 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338510f-3047-439f-9ffb-a9c525e9a84d admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:02.600373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338510f-3047-439f-9ffb-a9c525e9a84d admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:02.600854 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338510f-3047-439f-9ffb-a9c525e9a84d admin admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:02.602273 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338510f-3047-439f-9ffb-a9c525e9a84d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:01:02.602813 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338510f-3047-439f-9ffb-a9c525e9a84d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:02.606464 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338510f-3047-439f-9ffb-a9c525e9a84d admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:02.622986 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1154/2338] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 16:01:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:01:02.627240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbafb0c-6d0b-4f65-b851-b075ffed3491 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:02.639331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbafb0c-6d0b-4f65-b851-b075ffed3491 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:02.644976 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79ce58-53e3-4884-b81c-2630d3eef0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:02.645654 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79ce58-53e3-4884-b81c-2630d3eef0e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:02.645932 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79ce58-53e3-4884-b81c-2630d3eef0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:02.646201 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79ce58-53e3-4884-b81c-2630d3eef0e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:02.646882 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c79ce58-53e3-4884-b81c-2630d3eef0e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:02.649142 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c79ce58-53e3-4884-b81c-2630d3eef0e3 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:02.692986 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1185/2339] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:01:02 2022] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:01:02.696524 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338510f-3047-439f-9ffb-a9c525e9a84d admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:02.707639 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338510f-3047-439f-9ffb-a9c525e9a84d admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:02.777191 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f59e0-13a3-4bb0-ad17-475e5de8bd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:02.778008 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f59e0-13a3-4bb0-ad17-475e5de8bd91 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:02.778288 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f59e0-13a3-4bb0-ad17-475e5de8bd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:02.778565 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f59e0-13a3-4bb0-ad17-475e5de8bd91 admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:02.779205 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f59e0-13a3-4bb0-ad17-475e5de8bd91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:02.781203 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f59e0-13a3-4bb0-ad17-475e5de8bd91 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:02.805856 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1155/2340] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:01:02 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:01:02.807015 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79ce58-53e3-4884-b81c-2630d3eef0e3 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:02.818034 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79ce58-53e3-4884-b81c-2630d3eef0e3 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:02.822815 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05aedec-e5fb-46b4-ab76-4ff5d5ffb0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:02.823985 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05aedec-e5fb-46b4-ab76-4ff5d5ffb0e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:02.824409 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05aedec-e5fb-46b4-ab76-4ff5d5ffb0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:02.824675 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05aedec-e5fb-46b4-ab76-4ff5d5ffb0e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:02.825360 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05aedec-e5fb-46b4-ab76-4ff5d5ffb0e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:02.826943 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05aedec-e5fb-46b4-ab76-4ff5d5ffb0e8 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:02.837185 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1186/2341] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:01:02.841883 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f59e0-13a3-4bb0-ad17-475e5de8bd91 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:02.851893 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f59e0-13a3-4bb0-ad17-475e5de8bd91 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:02.856774 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c9745-e1dc-43d5-b82b-abd2fd4f62e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:02.857393 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c9745-e1dc-43d5-b82b-abd2fd4f62e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:02.857668 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c9745-e1dc-43d5-b82b-abd2fd4f62e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:02.857936 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c9745-e1dc-43d5-b82b-abd2fd4f62e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:02.858575 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c9745-e1dc-43d5-b82b-abd2fd4f62e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:02.860155 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c9745-e1dc-43d5-b82b-abd2fd4f62e3 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:02.865290 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:02.872340 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1156/2342] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:01:02.876303 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05aedec-e5fb-46b4-ab76-4ff5d5ffb0e8 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:02.887075 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05aedec-e5fb-46b4-ab76-4ff5d5ffb0e8 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:02.893247 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29880847-8237-4d04-8e3b-75ab5209ec1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:02.893911 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29880847-8237-4d04-8e3b-75ab5209ec1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:02.894192 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29880847-8237-4d04-8e3b-75ab5209ec1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:02.894486 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29880847-8237-4d04-8e3b-75ab5209ec1a admin admin] PATH_INFO: `/v3/projects/19cb8979b19a48079d28124d2c6fc715/users/82476dfc68794b9c87e6f653ee481b11/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:02.909392 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29880847-8237-4d04-8e3b-75ab5209ec1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=19cb8979b19a48079d28124d2c6fc715, user_id=82476dfc68794b9c87e6f653ee481b11, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:02.912053 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29880847-8237-4d04-8e3b-75ab5209ec1a admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:02.925096 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1187/2343] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:01:02 2022] PUT /identity/v3/projects/19cb8979b19a48079d28124d2c6fc715/users/82476dfc68794b9c87e6f653ee481b11/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:01:02.937022 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381ad1d-bd57-4b39-95df-1661aaae3da4 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:02.937242 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381ad1d-bd57-4b39-95df-1661aaae3da4 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:02.937506 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381ad1d-bd57-4b39-95df-1661aaae3da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:02.965897 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-2381ad1d-bd57-4b39-95df-1661aaae3da4 None None] MFA Rules not processed for user `82476dfc68794b9c87e6f653ee481b11`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:01:02.967111 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-2381ad1d-bd57-4b39-95df-1661aaae3da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:03.031180 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1157/2344] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:01:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:01:03.035616 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29880847-8237-4d04-8e3b-75ab5209ec1a admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:03.096665 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29880847-8237-4d04-8e3b-75ab5209ec1a admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:03.101320 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111b0ba-5f08-45a3-8391-6a6943da7e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:03.101936 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111b0ba-5f08-45a3-8391-6a6943da7e7d admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:03.102211 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111b0ba-5f08-45a3-8391-6a6943da7e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:03.102482 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111b0ba-5f08-45a3-8391-6a6943da7e7d admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:03.103134 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3111b0ba-5f08-45a3-8391-6a6943da7e7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:03.105056 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3111b0ba-5f08-45a3-8391-6a6943da7e7d admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:03.131937 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1188/2345] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:01:03 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:01:03.137129 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381ad1d-bd57-4b39-95df-1661aaae3da4 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:03.147819 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381ad1d-bd57-4b39-95df-1661aaae3da4 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:03.206254 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9873c6a-bcfe-4fbe-8749-bfa3420bfebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:03.206868 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9873c6a-bcfe-4fbe-8749-bfa3420bfebc admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:03.207148 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9873c6a-bcfe-4fbe-8749-bfa3420bfebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:03.207423 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9873c6a-bcfe-4fbe-8749-bfa3420bfebc admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:03.208055 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9873c6a-bcfe-4fbe-8749-bfa3420bfebc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:03.210015 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9873c6a-bcfe-4fbe-8749-bfa3420bfebc admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:03.237656 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1158/2346] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:01:03 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:01:03.241668 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111b0ba-5f08-45a3-8391-6a6943da7e7d admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:03.256585 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111b0ba-5f08-45a3-8391-6a6943da7e7d admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:03.262377 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5247c-c144-4fa0-bc51-93eb4f7a9d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:03.262994 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5247c-c144-4fa0-bc51-93eb4f7a9d8a admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:03.263273 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5247c-c144-4fa0-bc51-93eb4f7a9d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:03.263548 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5247c-c144-4fa0-bc51-93eb4f7a9d8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:03.264200 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed5247c-c144-4fa0-bc51-93eb4f7a9d8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:03.265918 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed5247c-c144-4fa0-bc51-93eb4f7a9d8a admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:03.285572 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1189/2347] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:01:03.289594 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9873c6a-bcfe-4fbe-8749-bfa3420bfebc admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:03.300704 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9873c6a-bcfe-4fbe-8749-bfa3420bfebc admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:03.305586 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cec9c0-2f6b-4432-996a-a5de7924f939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:03.306189 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cec9c0-2f6b-4432-996a-a5de7924f939 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:03.306469 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cec9c0-2f6b-4432-996a-a5de7924f939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:03.306737 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cec9c0-2f6b-4432-996a-a5de7924f939 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:03.307380 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cec9c0-2f6b-4432-996a-a5de7924f939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:03.310567 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cec9c0-2f6b-4432-996a-a5de7924f939 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:03.320730 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1159/2348] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:01:03.325206 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5247c-c144-4fa0-bc51-93eb4f7a9d8a admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:03.335466 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5247c-c144-4fa0-bc51-93eb4f7a9d8a admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:03.340463 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d882a12-3c02-4f19-b094-19fc6491452c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:03.341168 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d882a12-3c02-4f19-b094-19fc6491452c admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:03.341448 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d882a12-3c02-4f19-b094-19fc6491452c admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:03.342380 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d882a12-3c02-4f19-b094-19fc6491452c admin admin] PATH_INFO: `/v3/projects/c39ad89f81724c7997dbd4f7c3404c69/users/44d285184be146e9afc36274356f0c9e/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:03.361137 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d882a12-3c02-4f19-b094-19fc6491452c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c39ad89f81724c7997dbd4f7c3404c69, user_id=44d285184be146e9afc36274356f0c9e, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:03.365604 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d882a12-3c02-4f19-b094-19fc6491452c admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:03.379070 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:03.385781 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1190/2349] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:01:03 2022] PUT /identity/v3/projects/c39ad89f81724c7997dbd4f7c3404c69/users/44d285184be146e9afc36274356f0c9e/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:01:03.396179 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a49c7-b8c2-4cf4-9c9c-f6fd98b46cb7 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:03.396466 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a49c7-b8c2-4cf4-9c9c-f6fd98b46cb7 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:03.396739 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a49c7-b8c2-4cf4-9c9c-f6fd98b46cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:03.428496 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-194a49c7-b8c2-4cf4-9c9c-f6fd98b46cb7 None None] MFA Rules not processed for user `44d285184be146e9afc36274356f0c9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:01:03.429859 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-194a49c7-b8c2-4cf4-9c9c-f6fd98b46cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:03.536853 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:03.544869 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1160/2350] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:01:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:01:03.548205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d882a12-3c02-4f19-b094-19fc6491452c admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:03.629062 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d882a12-3c02-4f19-b094-19fc6491452c admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:03.634242 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf87ae-9fa7-4897-87a1-49ac3c3a6f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:03.634843 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf87ae-9fa7-4897-87a1-49ac3c3a6f8a admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:03.635118 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf87ae-9fa7-4897-87a1-49ac3c3a6f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:03.635386 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf87ae-9fa7-4897-87a1-49ac3c3a6f8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:03.636679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf87ae-9fa7-4897-87a1-49ac3c3a6f8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:03.638710 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf87ae-9fa7-4897-87a1-49ac3c3a6f8a admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:03.667249 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1191/2351] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:01:03 2022] POST /identity/v3/projects => generated 387 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:01:03.671768 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a49c7-b8c2-4cf4-9c9c-f6fd98b46cb7 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:03.683330 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a49c7-b8c2-4cf4-9c9c-f6fd98b46cb7 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:03.768982 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659b40c-98a7-414a-a130-21f42c9506de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:03.770269 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659b40c-98a7-414a-a130-21f42c9506de admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:03.770594 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659b40c-98a7-414a-a130-21f42c9506de admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:03.770837 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659b40c-98a7-414a-a130-21f42c9506de admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:03.771681 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5659b40c-98a7-414a-a130-21f42c9506de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:03.773854 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5659b40c-98a7-414a-a130-21f42c9506de admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:03.805951 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf87ae-9fa7-4897-87a1-49ac3c3a6f8a admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:03.808410 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1161/2352] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:01:03 2022] POST /identity/v3/users => generated 300 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:01:03.817595 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf87ae-9fa7-4897-87a1-49ac3c3a6f8a admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:03.822460 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff8a37-b5b0-4d18-97e5-53e5c7511ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:03.823081 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff8a37-b5b0-4d18-97e5-53e5c7511ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:03.824157 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff8a37-b5b0-4d18-97e5-53e5c7511ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:03.824675 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff8a37-b5b0-4d18-97e5-53e5c7511ca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:03.825379 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff8a37-b5b0-4d18-97e5-53e5c7511ca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:03.826981 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff8a37-b5b0-4d18-97e5-53e5c7511ca9 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:03.837801 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1192/2353] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:01:03.842727 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659b40c-98a7-414a-a130-21f42c9506de admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:03.854222 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659b40c-98a7-414a-a130-21f42c9506de admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:03.862154 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c315d4-0d6b-42c2-8ff5-fa23a1f342dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:03.863092 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c315d4-0d6b-42c2-8ff5-fa23a1f342dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:03.863347 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c315d4-0d6b-42c2-8ff5-fa23a1f342dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:03.863734 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c315d4-0d6b-42c2-8ff5-fa23a1f342dc admin admin] PATH_INFO: `/v3/projects/cc45ac08ee1b467bb0c692686e8808c6/users/3bcf153b89964939b7429ea18dbcc734/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:03.882192 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c315d4-0d6b-42c2-8ff5-fa23a1f342dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc45ac08ee1b467bb0c692686e8808c6, user_id=3bcf153b89964939b7429ea18dbcc734, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:03.885895 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c315d4-0d6b-42c2-8ff5-fa23a1f342dc admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:03.900338 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1162/2354] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:01:03 2022] PUT /identity/v3/projects/cc45ac08ee1b467bb0c692686e8808c6/users/3bcf153b89964939b7429ea18dbcc734/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:01:03.905025 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff8a37-b5b0-4d18-97e5-53e5c7511ca9 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:03.919994 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff8a37-b5b0-4d18-97e5-53e5c7511ca9 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:04.011631 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e82fd-9072-4a23-a775-bf8b9712c289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:04.013287 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e82fd-9072-4a23-a775-bf8b9712c289 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:04.013764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e82fd-9072-4a23-a775-bf8b9712c289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:04.014111 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e82fd-9072-4a23-a775-bf8b9712c289 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:04.014853 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e82fd-9072-4a23-a775-bf8b9712c289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:04.017834 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e82fd-9072-4a23-a775-bf8b9712c289 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:04.041763 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1193/2355] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:01:04.046389 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c315d4-0d6b-42c2-8ff5-fa23a1f342dc admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:04.056536 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c315d4-0d6b-42c2-8ff5-fa23a1f342dc admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:04.061932 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b6d60-3ed3-471d-b246-bed9f417462c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:04.062635 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b6d60-3ed3-471d-b246-bed9f417462c admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:04.062956 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b6d60-3ed3-471d-b246-bed9f417462c admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:04.063320 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b6d60-3ed3-471d-b246-bed9f417462c admin admin] PATH_INFO: `/v3/projects/cc45ac08ee1b467bb0c692686e8808c6/users/3bcf153b89964939b7429ea18dbcc734/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:04.066064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b6d60-3ed3-471d-b246-bed9f417462c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc45ac08ee1b467bb0c692686e8808c6, user_id=3bcf153b89964939b7429ea18dbcc734, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:04.069111 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b6d60-3ed3-471d-b246-bed9f417462c admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:04.080113 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1163/2356] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:01:04 2022] PUT /identity/v3/projects/cc45ac08ee1b467bb0c692686e8808c6/users/3bcf153b89964939b7429ea18dbcc734/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:01:04.090947 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1519ec7-d1d5-4574-b8ed-313f6122ac03 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:04.091330 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1519ec7-d1d5-4574-b8ed-313f6122ac03 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:04.091632 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1519ec7-d1d5-4574-b8ed-313f6122ac03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:04.122432 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-d1519ec7-d1d5-4574-b8ed-313f6122ac03 None None] MFA Rules not processed for user `3bcf153b89964939b7429ea18dbcc734`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:01:04.123651 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-d1519ec7-d1d5-4574-b8ed-313f6122ac03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:04.189630 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:04.200057 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1194/2357] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:01:04 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:01:04.210879 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b6d60-3ed3-471d-b246-bed9f417462c admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:04.212606 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-6d5b6d60-3ed3-471d-b246-bed9f417462c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:04.284338 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b6d60-3ed3-471d-b246-bed9f417462c admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:04.284338 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856c5ea-834d-4d37-abe4-3bd5cd724ca7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:04.284338 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856c5ea-834d-4d37-abe4-3bd5cd724ca7 service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:04.284338 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856c5ea-834d-4d37-abe4-3bd5cd724ca7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:04.284708 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856c5ea-834d-4d37-abe4-3bd5cd724ca7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:04.288316 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856c5ea-834d-4d37-abe4-3bd5cd724ca7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:04.289758 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856c5ea-834d-4d37-abe4-3bd5cd724ca7 service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:04.298943 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1164/2358] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:01:04 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:01:04.869134 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1519ec7-d1d5-4574-b8ed-313f6122ac03 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:04.873423 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-d1519ec7-d1d5-4574-b8ed-313f6122ac03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:04.890481 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1519ec7-d1d5-4574-b8ed-313f6122ac03 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:04.894954 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe392e4f-80b2-4b9d-bdc3-9af13fe2c208 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:04.895453 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe392e4f-80b2-4b9d-bdc3-9af13fe2c208 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:04.895803 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe392e4f-80b2-4b9d-bdc3-9af13fe2c208 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:04.896170 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe392e4f-80b2-4b9d-bdc3-9af13fe2c208 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:04.959026 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe392e4f-80b2-4b9d-bdc3-9af13fe2c208 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:04.960411 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe392e4f-80b2-4b9d-bdc3-9af13fe2c208 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:04.970968 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1195/2359] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:01:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:01:09.275162 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856c5ea-834d-4d37-abe4-3bd5cd724ca7 service cinder] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:09.285360 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856c5ea-834d-4d37-abe4-3bd5cd724ca7 service cinder] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:09.289038 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9bcff-fd96-4660-b1eb-fa3b7fc6d004 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:09.289642 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9bcff-fd96-4660-b1eb-fa3b7fc6d004 service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:09.289921 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9bcff-fd96-4660-b1eb-fa3b7fc6d004 service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:09.290192 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9bcff-fd96-4660-b1eb-fa3b7fc6d004 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:09.372699 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:09.401003 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e9bcff-fd96-4660-b1eb-fa3b7fc6d004 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:09.405843 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e9bcff-fd96-4660-b1eb-fa3b7fc6d004 service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:09.422172 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1165/2360] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:01:09 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:01:11.035288 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe392e4f-80b2-4b9d-bdc3-9af13fe2c208 service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:11.044643 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe392e4f-80b2-4b9d-bdc3-9af13fe2c208 service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:11.048296 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46f055-318e-449a-82a4-45db4e6b9fbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:11.048935 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46f055-318e-449a-82a4-45db4e6b9fbd service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:11.049215 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46f055-318e-449a-82a4-45db4e6b9fbd service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:11.049486 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46f055-318e-449a-82a4-45db4e6b9fbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:11.051231 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-5b46f055-318e-449a-82a4-45db4e6b9fbd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:11.113299 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46f055-318e-449a-82a4-45db4e6b9fbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:11.114700 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46f055-318e-449a-82a4-45db4e6b9fbd service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:11.123884 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1196/2361] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:01:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:01:11.639183 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc49cb-d909-40fd-bfb2-f57ba410c5e2 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:11.639643 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc49cb-d909-40fd-bfb2-f57ba410c5e2 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:11.640105 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc49cb-d909-40fd-bfb2-f57ba410c5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:11.664622 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-e6bc49cb-d909-40fd-bfb2-f57ba410c5e2 None None] MFA Rules not processed for user `45d624c90b2b448595cf0f5eebbb2307`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:01:11.665859 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-e6bc49cb-d909-40fd-bfb2-f57ba410c5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:11.767618 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1166/2362] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:01:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:01:11.858754 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46f055-318e-449a-82a4-45db4e6b9fbd service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:11.947320 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75d98e-24e6-454b-8641-dea8296ba84b None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:11.947612 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75d98e-24e6-454b-8641-dea8296ba84b None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:11.948517 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75d98e-24e6-454b-8641-dea8296ba84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:11.972456 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46f055-318e-449a-82a4-45db4e6b9fbd service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:11.976552 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-cc75d98e-24e6-454b-8641-dea8296ba84b None None] MFA Rules not processed for user `d7958b395d5e4f5da37927536b1856ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:01:11.978065 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-cc75d98e-24e6-454b-8641-dea8296ba84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:11.980312 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193bd1bc-e766-4dfe-911f-036107b56ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:11.981788 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bd1bc-e766-4dfe-911f-036107b56ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:11.982268 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bd1bc-e766-4dfe-911f-036107b56ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:11.989080 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bd1bc-e766-4dfe-911f-036107b56ad0 admin admin] PATH_INFO: `/v3/users/82476dfc68794b9c87e6f653ee481b11` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:11.992124 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193bd1bc-e766-4dfe-911f-036107b56ad0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82476dfc68794b9c87e6f653ee481b11)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:11.997930 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193bd1bc-e766-4dfe-911f-036107b56ad0 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:12.076353 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:12.097007 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1167/2363] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Aug 30 16:01:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:01:12.099655 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-193bd1bc-e766-4dfe-911f-036107b56ad0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82476dfc68794b9c87e6f653ee481b11'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:12.102233 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-193bd1bc-e766-4dfe-911f-036107b56ad0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82476dfc68794b9c87e6f653ee481b11'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:12.123784 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-193bd1bc-e766-4dfe-911f-036107b56ad0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82476dfc68794b9c87e6f653ee481b11'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:12.156458 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75d98e-24e6-454b-8641-dea8296ba84b None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:12.158899 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-cc75d98e-24e6-454b-8641-dea8296ba84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:12.175164 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-193bd1bc-e766-4dfe-911f-036107b56ad0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82476dfc68794b9c87e6f653ee481b11'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:12.194579 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-193bd1bc-e766-4dfe-911f-036107b56ad0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82476dfc68794b9c87e6f653ee481b11'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:12.202791 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1197/2364] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:01:11 2022] DELETE /identity/v3/users/82476dfc68794b9c87e6f653ee481b11 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:01:12.207518 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc56ab-040c-4610-8b60-54b0a5b98863 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:12.207910 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc56ab-040c-4610-8b60-54b0a5b98863 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:12.208421 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc56ab-040c-4610-8b60-54b0a5b98863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:12.253230 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-e7dc56ab-040c-4610-8b60-54b0a5b98863 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:01:12.257029 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-e7dc56ab-040c-4610-8b60-54b0a5b98863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:12.321047 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75d98e-24e6-454b-8641-dea8296ba84b None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:12.351843 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1198/2365] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:01:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:01:12.359867 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc56ab-040c-4610-8b60-54b0a5b98863 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:12.365344 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-e7dc56ab-040c-4610-8b60-54b0a5b98863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:12.402674 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:12.446081 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38c30c-5993-4c41-9e9c-8377fbaabbc3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94765f224c734beabe83b4dc0c5e511f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:12.447301 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38c30c-5993-4c41-9e9c-8377fbaabbc3 service swift] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:12.447301 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38c30c-5993-4c41-9e9c-8377fbaabbc3 service swift] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:12.447524 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38c30c-5993-4c41-9e9c-8377fbaabbc3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:12.450584 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-fb38c30c-5993-4c41-9e9c-8377fbaabbc3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:12.481241 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc56ab-040c-4610-8b60-54b0a5b98863 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:12.485711 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c39091-74be-4b3e-bca9-fbc643ccd1db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:12.486269 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c39091-74be-4b3e-bca9-fbc643ccd1db service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:12.486550 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c39091-74be-4b3e-bca9-fbc643ccd1db service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:12.486827 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c39091-74be-4b3e-bca9-fbc643ccd1db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:12.499229 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c39091-74be-4b3e-bca9-fbc643ccd1db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:12.501496 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c39091-74be-4b3e-bca9-fbc643ccd1db service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:12.525670 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1199/2366] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:01:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:01:12.540828 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38c30c-5993-4c41-9e9c-8377fbaabbc3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:12.543808 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38c30c-5993-4c41-9e9c-8377fbaabbc3 service swift] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:12.556091 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1168/2367] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Aug 30 16:01:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 16:01:13.067328 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c39091-74be-4b3e-bca9-fbc643ccd1db service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:13.069800 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-44c39091-74be-4b3e-bca9-fbc643ccd1db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:13.097677 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c39091-74be-4b3e-bca9-fbc643ccd1db service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:13.112049 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca115b67-7318-4e83-b333-871b93d5e7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:13.112727 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca115b67-7318-4e83-b333-871b93d5e7d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:13.113142 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca115b67-7318-4e83-b333-871b93d5e7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:13.114235 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca115b67-7318-4e83-b333-871b93d5e7d9 admin admin] PATH_INFO: `/v3/projects/19cb8979b19a48079d28124d2c6fc715` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:13.123073 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca115b67-7318-4e83-b333-871b93d5e7d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19cb8979b19a48079d28124d2c6fc715)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:13.125380 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca115b67-7318-4e83-b333-871b93d5e7d9 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:13.195826 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:13.205852 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-ca115b67-7318-4e83-b333-871b93d5e7d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19cb8979b19a48079d28124d2c6fc715', 'request_id': 'req-ca115b67-7318-4e83-b333-871b93d5e7d9'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:13.217289 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-ca115b67-7318-4e83-b333-871b93d5e7d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19cb8979b19a48079d28124d2c6fc715', 'request_id': 'req-ca115b67-7318-4e83-b333-871b93d5e7d9'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:13.224314 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-ca115b67-7318-4e83-b333-871b93d5e7d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19cb8979b19a48079d28124d2c6fc715', 'request_id': 'req-ca115b67-7318-4e83-b333-871b93d5e7d9'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:13.243254 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-ca115b67-7318-4e83-b333-871b93d5e7d9 admin admin] The token cache is being invalidate because project 19cb8979b19a48079d28124d2c6fc715 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:01:13.243732 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-ca115b67-7318-4e83-b333-871b93d5e7d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:13.244532 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-ca115b67-7318-4e83-b333-871b93d5e7d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:13.248871 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1200/2368] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:01:13 2022] DELETE /identity/v3/projects/19cb8979b19a48079d28124d2c6fc715 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:01:13.250278 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38c30c-5993-4c41-9e9c-8377fbaabbc3 service swift] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:13.261664 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38c30c-5993-4c41-9e9c-8377fbaabbc3 service swift] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:13.267846 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0bdc7-144d-49a4-8204-928bc4be1b41 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:13.268215 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0bdc7-144d-49a4-8204-928bc4be1b41 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:13.268563 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0bdc7-144d-49a4-8204-928bc4be1b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:13.297714 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-00c0bdc7-144d-49a4-8204-928bc4be1b41 None None] MFA Rules not processed for user `d7958b395d5e4f5da37927536b1856ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:01:13.299038 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-00c0bdc7-144d-49a4-8204-928bc4be1b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:13.327272 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e63a04-888f-4a1e-a69e-a65c7bd44627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:13.327911 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e63a04-888f-4a1e-a69e-a65c7bd44627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:13.328194 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e63a04-888f-4a1e-a69e-a65c7bd44627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:13.328532 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e63a04-888f-4a1e-a69e-a65c7bd44627 admin admin] PATH_INFO: `/v3/users/44d285184be146e9afc36274356f0c9e` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:13.329693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e63a04-888f-4a1e-a69e-a65c7bd44627 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44d285184be146e9afc36274356f0c9e)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:13.331649 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e63a04-888f-4a1e-a69e-a65c7bd44627 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:13.359219 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1201/2369] 10.222.0.25 () {58 vars in 967 bytes} [Tue Aug 30 16:01:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:01:13.373363 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0bdc7-144d-49a4-8204-928bc4be1b41 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:13.375147 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-00c0bdc7-144d-49a4-8204-928bc4be1b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:13.382930 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-d5e63a04-888f-4a1e-a69e-a65c7bd44627 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44d285184be146e9afc36274356f0c9e'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:13.396013 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-d5e63a04-888f-4a1e-a69e-a65c7bd44627 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44d285184be146e9afc36274356f0c9e'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:13.396697 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-d5e63a04-888f-4a1e-a69e-a65c7bd44627 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44d285184be146e9afc36274356f0c9e'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:13.397360 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-d5e63a04-888f-4a1e-a69e-a65c7bd44627 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44d285184be146e9afc36274356f0c9e'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:13.404910 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-d5e63a04-888f-4a1e-a69e-a65c7bd44627 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44d285184be146e9afc36274356f0c9e'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:13.418428 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1169/2370] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:01:13 2022] DELETE /identity/v3/users/44d285184be146e9afc36274356f0c9e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:01:13.455187 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0bdc7-144d-49a4-8204-928bc4be1b41 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:13.539619 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6c529-067d-46e5-9c8b-817da12a9774 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94765f224c734beabe83b4dc0c5e511f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:13.540294 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6c529-067d-46e5-9c8b-817da12a9774 service swift] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:13.540582 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6c529-067d-46e5-9c8b-817da12a9774 service swift] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:13.541056 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6c529-067d-46e5-9c8b-817da12a9774 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:13.546700 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7cf6c529-067d-46e5-9c8b-817da12a9774 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:13.575888 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:13.618733 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf6c529-067d-46e5-9c8b-817da12a9774 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:13.620906 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf6c529-067d-46e5-9c8b-817da12a9774 service swift] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:13.629796 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1202/2371] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Aug 30 16:01:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 16:01:13.853071 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e63a04-888f-4a1e-a69e-a65c7bd44627 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:13.857783 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-d5e63a04-888f-4a1e-a69e-a65c7bd44627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:13.876938 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:13.971569 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e63a04-888f-4a1e-a69e-a65c7bd44627 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:13.976695 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f68fa-dbeb-4cc9-990d-9bf9c94d3dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:13.980712 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f68fa-dbeb-4cc9-990d-9bf9c94d3dd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:13.981037 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f68fa-dbeb-4cc9-990d-9bf9c94d3dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:13.981372 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f68fa-dbeb-4cc9-990d-9bf9c94d3dd0 admin admin] PATH_INFO: `/v3/projects/c39ad89f81724c7997dbd4f7c3404c69` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:13.983206 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74f68fa-dbeb-4cc9-990d-9bf9c94d3dd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c39ad89f81724c7997dbd4f7c3404c69)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:13.985882 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74f68fa-dbeb-4cc9-990d-9bf9c94d3dd0 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:14.011822 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3ecfe-843a-4b47-ba3e-490943c387f9 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:14.011822 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3ecfe-843a-4b47-ba3e-490943c387f9 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:14.011822 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3ecfe-843a-4b47-ba3e-490943c387f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:14.036541 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-c1d3ecfe-843a-4b47-ba3e-490943c387f9 None None] MFA Rules not processed for user `d7958b395d5e4f5da37927536b1856ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:01:14.038193 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c1d3ecfe-843a-4b47-ba3e-490943c387f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:14.059750 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-c74f68fa-dbeb-4cc9-990d-9bf9c94d3dd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c39ad89f81724c7997dbd4f7c3404c69', 'request_id': 'req-c74f68fa-dbeb-4cc9-990d-9bf9c94d3dd0'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:14.069404 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-c74f68fa-dbeb-4cc9-990d-9bf9c94d3dd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c39ad89f81724c7997dbd4f7c3404c69', 'request_id': 'req-c74f68fa-dbeb-4cc9-990d-9bf9c94d3dd0'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:14.090681 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-c74f68fa-dbeb-4cc9-990d-9bf9c94d3dd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c39ad89f81724c7997dbd4f7c3404c69', 'request_id': 'req-c74f68fa-dbeb-4cc9-990d-9bf9c94d3dd0'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:14.113170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-c74f68fa-dbeb-4cc9-990d-9bf9c94d3dd0 admin admin] The token cache is being invalidate because project c39ad89f81724c7997dbd4f7c3404c69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:01:14.113950 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-c74f68fa-dbeb-4cc9-990d-9bf9c94d3dd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:14.115459 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-c74f68fa-dbeb-4cc9-990d-9bf9c94d3dd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:14.117132 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1203/2372] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Aug 30 16:01:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:01:14.118481 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1170/2373] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:01:13 2022] DELETE /identity/v3/projects/c39ad89f81724c7997dbd4f7c3404c69 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:01:14.130220 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3ecfe-843a-4b47-ba3e-490943c387f9 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:14.130371 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f68fa-dbeb-4cc9-990d-9bf9c94d3dd0 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:14.131664 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-c74f68fa-dbeb-4cc9-990d-9bf9c94d3dd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:14.221014 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f68fa-dbeb-4cc9-990d-9bf9c94d3dd0 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:14.223590 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3ecfe-843a-4b47-ba3e-490943c387f9 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:14.227093 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4f0c5-e04b-41a7-bb89-b1ae8ca15ab5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94765f224c734beabe83b4dc0c5e511f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:14.227829 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4f0c5-e04b-41a7-bb89-b1ae8ca15ab5 service swift] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:14.228177 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4f0c5-e04b-41a7-bb89-b1ae8ca15ab5 service swift] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:14.228554 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4f0c5-e04b-41a7-bb89-b1ae8ca15ab5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:14.229608 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa5725-4a94-44ee-94ee-476a5184e5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:14.230414 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa5725-4a94-44ee-94ee-476a5184e5ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:14.232297 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-75f4f0c5-e04b-41a7-bb89-b1ae8ca15ab5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:14.232435 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa5725-4a94-44ee-94ee-476a5184e5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:14.232718 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa5725-4a94-44ee-94ee-476a5184e5ba admin admin] PATH_INFO: `/v3/users/3bcf153b89964939b7429ea18dbcc734` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:14.235021 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa5725-4a94-44ee-94ee-476a5184e5ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bcf153b89964939b7429ea18dbcc734)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:14.236975 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa5725-4a94-44ee-94ee-476a5184e5ba admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:14.246603 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f4f0c5-e04b-41a7-bb89-b1ae8ca15ab5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:14.248469 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f4f0c5-e04b-41a7-bb89-b1ae8ca15ab5 service swift] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:14.278577 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1171/2374] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Aug 30 16:01:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 16:01:14.300491 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-4efa5725-4a94-44ee-94ee-476a5184e5ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bcf153b89964939b7429ea18dbcc734'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:14.301354 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-4efa5725-4a94-44ee-94ee-476a5184e5ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bcf153b89964939b7429ea18dbcc734'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:14.309912 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-4efa5725-4a94-44ee-94ee-476a5184e5ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bcf153b89964939b7429ea18dbcc734'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:14.329576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:14.343098 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-4efa5725-4a94-44ee-94ee-476a5184e5ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bcf153b89964939b7429ea18dbcc734'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:14.353325 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-4efa5725-4a94-44ee-94ee-476a5184e5ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bcf153b89964939b7429ea18dbcc734'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:14.363566 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1204/2375] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:01:14 2022] DELETE /identity/v3/users/3bcf153b89964939b7429ea18dbcc734 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:01:14.741665 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4f0c5-e04b-41a7-bb89-b1ae8ca15ab5 service swift] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:14.743206 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-75f4f0c5-e04b-41a7-bb89-b1ae8ca15ab5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:14.788183 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef2d00-1584-4354-9d61-a0ec386552f0 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:14.788468 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef2d00-1584-4354-9d61-a0ec386552f0 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:14.788742 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef2d00-1584-4354-9d61-a0ec386552f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:14.792125 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4f0c5-e04b-41a7-bb89-b1ae8ca15ab5 service swift] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:14.815391 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-53ef2d00-1584-4354-9d61-a0ec386552f0 None None] MFA Rules not processed for user `d7958b395d5e4f5da37927536b1856ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:01:14.816773 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-53ef2d00-1584-4354-9d61-a0ec386552f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:14.857641 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:14.921688 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1205/2376] 10.222.0.25 () {58 vars in 967 bytes} [Tue Aug 30 16:01:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:01:14.941468 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef2d00-1584-4354-9d61-a0ec386552f0 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:14.943455 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-53ef2d00-1584-4354-9d61-a0ec386552f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:14.947022 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6943a-28f5-4500-a583-3ea1491c05cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:14.948618 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6943a-28f5-4500-a583-3ea1491c05cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:14.949230 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6943a-28f5-4500-a583-3ea1491c05cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:14.950674 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6943a-28f5-4500-a583-3ea1491c05cd admin admin] PATH_INFO: `/v3/projects/cc45ac08ee1b467bb0c692686e8808c6` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:14.954567 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6943a-28f5-4500-a583-3ea1491c05cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc45ac08ee1b467bb0c692686e8808c6)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:14.958237 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6943a-28f5-4500-a583-3ea1491c05cd admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:15.033727 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-a2f6943a-28f5-4500-a583-3ea1491c05cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc45ac08ee1b467bb0c692686e8808c6', 'request_id': 'req-a2f6943a-28f5-4500-a583-3ea1491c05cd'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:15.039256 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-a2f6943a-28f5-4500-a583-3ea1491c05cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc45ac08ee1b467bb0c692686e8808c6', 'request_id': 'req-a2f6943a-28f5-4500-a583-3ea1491c05cd'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:15.039630 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef2d00-1584-4354-9d61-a0ec386552f0 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:15.049233 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-a2f6943a-28f5-4500-a583-3ea1491c05cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc45ac08ee1b467bb0c692686e8808c6', 'request_id': 'req-a2f6943a-28f5-4500-a583-3ea1491c05cd'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:15.063956 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-a2f6943a-28f5-4500-a583-3ea1491c05cd admin admin] The token cache is being invalidate because project cc45ac08ee1b467bb0c692686e8808c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:01:15.064245 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-a2f6943a-28f5-4500-a583-3ea1491c05cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:15.064934 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-a2f6943a-28f5-4500-a583-3ea1491c05cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:15.066607 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1172/2377] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:01:14 2022] DELETE /identity/v3/projects/cc45ac08ee1b467bb0c692686e8808c6 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:01:15.072697 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124821a-aed5-43d2-acac-6abdc7c7a0ce None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:15.073709 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124821a-aed5-43d2-acac-6abdc7c7a0ce None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:15.073909 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124821a-aed5-43d2-acac-6abdc7c7a0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:15.093896 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-7124821a-aed5-43d2-acac-6abdc7c7a0ce None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:01:15.095257 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-7124821a-aed5-43d2-acac-6abdc7c7a0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:15.109342 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0844b17-302f-487d-a98c-83faa1676647 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94765f224c734beabe83b4dc0c5e511f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:15.110139 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0844b17-302f-487d-a98c-83faa1676647 service swift] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:15.110519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0844b17-302f-487d-a98c-83faa1676647 service swift] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:15.110887 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0844b17-302f-487d-a98c-83faa1676647 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:15.112880 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c0844b17-302f-487d-a98c-83faa1676647 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:15.152897 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:15.189793 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1173/2378] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:01:15.209325 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0844b17-302f-487d-a98c-83faa1676647 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:15.211224 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0844b17-302f-487d-a98c-83faa1676647 service swift] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:15.212077 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b337f-f77f-4edf-9061-0231def31f1f None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:15.212521 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b337f-f77f-4edf-9061-0231def31f1f None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:15.212975 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b337f-f77f-4edf-9061-0231def31f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:15.225561 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1206/2379] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Aug 30 16:01:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 16:01:15.246470 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-965b337f-f77f-4edf-9061-0231def31f1f None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:01:15.247847 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-965b337f-f77f-4edf-9061-0231def31f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:15.259080 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1174/2380] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:01:15.264901 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0844b17-302f-487d-a98c-83faa1676647 service swift] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:15.281737 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0844b17-302f-487d-a98c-83faa1676647 service swift] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:15.301196 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59f93f-9d40-444f-a31f-3fdc0e7a668f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:15.301196 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59f93f-9d40-444f-a31f-3fdc0e7a668f admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:15.301196 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59f93f-9d40-444f-a31f-3fdc0e7a668f admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:15.301548 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59f93f-9d40-444f-a31f-3fdc0e7a668f admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:15.302161 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59f93f-9d40-444f-a31f-3fdc0e7a668f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:01:15.302429 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59f93f-9d40-444f-a31f-3fdc0e7a668f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:15.304528 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59f93f-9d40-444f-a31f-3fdc0e7a668f admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:15.320723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1207/2381] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 16:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:01:15.325555 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965b337f-f77f-4edf-9061-0231def31f1f None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:15.339980 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965b337f-f77f-4edf-9061-0231def31f1f None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:15.358134 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451da034-645e-43e1-bb7c-b1b12ae678ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:15.358678 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451da034-645e-43e1-bb7c-b1b12ae678ba admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:15.358967 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451da034-645e-43e1-bb7c-b1b12ae678ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:15.359962 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451da034-645e-43e1-bb7c-b1b12ae678ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:15.360807 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451da034-645e-43e1-bb7c-b1b12ae678ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:15.363575 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451da034-645e-43e1-bb7c-b1b12ae678ba admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:15.437483 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1175/2382] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:01:15 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:01:15.442476 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59f93f-9d40-444f-a31f-3fdc0e7a668f admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:15.466460 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59f93f-9d40-444f-a31f-3fdc0e7a668f admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:15.564895 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88168a9-8869-465d-b5a9-169ffcd5d732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:15.565468 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88168a9-8869-465d-b5a9-169ffcd5d732 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:15.565744 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88168a9-8869-465d-b5a9-169ffcd5d732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:15.566010 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88168a9-8869-465d-b5a9-169ffcd5d732 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:15.566664 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88168a9-8869-465d-b5a9-169ffcd5d732 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:15.568688 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88168a9-8869-465d-b5a9-169ffcd5d732 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:15.603169 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1208/2383] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:01:15 2022] POST /identity/v3/users => generated 294 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:01:15.605640 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451da034-645e-43e1-bb7c-b1b12ae678ba admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:15.634006 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451da034-645e-43e1-bb7c-b1b12ae678ba admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:15.640756 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37e733-2146-42da-a136-dc5806140bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:15.641416 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37e733-2146-42da-a136-dc5806140bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:15.641662 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37e733-2146-42da-a136-dc5806140bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:15.642333 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37e733-2146-42da-a136-dc5806140bc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:15.643294 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b37e733-2146-42da-a136-dc5806140bc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:15.645424 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b37e733-2146-42da-a136-dc5806140bc1 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:15.662695 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1176/2384] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:01:15.663501 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88168a9-8869-465d-b5a9-169ffcd5d732 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:15.676725 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88168a9-8869-465d-b5a9-169ffcd5d732 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:15.690590 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c0f36-3c8d-4ebf-8c9d-2a829de95f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:15.691352 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c0f36-3c8d-4ebf-8c9d-2a829de95f1a admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:15.691732 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c0f36-3c8d-4ebf-8c9d-2a829de95f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:15.694022 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c0f36-3c8d-4ebf-8c9d-2a829de95f1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:15.694022 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c0f36-3c8d-4ebf-8c9d-2a829de95f1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:15.696931 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c0f36-3c8d-4ebf-8c9d-2a829de95f1a admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:15.710611 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1209/2385] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:01:15.716183 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37e733-2146-42da-a136-dc5806140bc1 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:15.740978 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37e733-2146-42da-a136-dc5806140bc1 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:15.754948 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4684fa-a32c-4e02-b4a4-b8f04b485c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:15.755777 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4684fa-a32c-4e02-b4a4-b8f04b485c73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:15.756431 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4684fa-a32c-4e02-b4a4-b8f04b485c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:15.756864 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4684fa-a32c-4e02-b4a4-b8f04b485c73 admin admin] PATH_INFO: `/v3/projects/d6511f8bf1c9404682c76112ff82745b/users/933e64b9a2a5439c97b8f5e7ab9562b9/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:15.777989 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:15.781495 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4684fa-a32c-4e02-b4a4-b8f04b485c73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6511f8bf1c9404682c76112ff82745b, user_id=933e64b9a2a5439c97b8f5e7ab9562b9, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:15.786289 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4684fa-a32c-4e02-b4a4-b8f04b485c73 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:15.807455 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1177/2386] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:01:15 2022] PUT /identity/v3/projects/d6511f8bf1c9404682c76112ff82745b/users/933e64b9a2a5439c97b8f5e7ab9562b9/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:01:15.824693 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67185b38-1c86-48b5-92f5-9b321a73dcf0 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:15.824693 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67185b38-1c86-48b5-92f5-9b321a73dcf0 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:15.824693 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67185b38-1c86-48b5-92f5-9b321a73dcf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:15.854612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-67185b38-1c86-48b5-92f5-9b321a73dcf0 None None] MFA Rules not processed for user `933e64b9a2a5439c97b8f5e7ab9562b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:01:15.856043 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-67185b38-1c86-48b5-92f5-9b321a73dcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:15.954381 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1210/2387] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:01:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:01:15.959323 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4684fa-a32c-4e02-b4a4-b8f04b485c73 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:16.068536 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4684fa-a32c-4e02-b4a4-b8f04b485c73 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:16.074329 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac79e89d-8ff8-41d5-a90d-d5cfb79e20c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:16.075043 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79e89d-8ff8-41d5-a90d-d5cfb79e20c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:16.075395 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79e89d-8ff8-41d5-a90d-d5cfb79e20c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:16.075742 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79e89d-8ff8-41d5-a90d-d5cfb79e20c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:16.076530 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac79e89d-8ff8-41d5-a90d-d5cfb79e20c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:16.078758 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac79e89d-8ff8-41d5-a90d-d5cfb79e20c2 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:16.132976 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1178/2388] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:01:15 2022] POST /identity/v3/projects => generated 387 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:01:16.137309 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67185b38-1c86-48b5-92f5-9b321a73dcf0 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:16.155485 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67185b38-1c86-48b5-92f5-9b321a73dcf0 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:16.232470 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:16.280394 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e5f56-11ab-419a-a91f-1a3d2108efdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:16.281203 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e5f56-11ab-419a-a91f-1a3d2108efdd admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:16.281556 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e5f56-11ab-419a-a91f-1a3d2108efdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:16.281922 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e5f56-11ab-419a-a91f-1a3d2108efdd admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:16.282671 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e5f56-11ab-419a-a91f-1a3d2108efdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:16.284693 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e5f56-11ab-419a-a91f-1a3d2108efdd admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:16.318808 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1211/2389] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:01:16 2022] POST /identity/v3/users => generated 300 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:01:16.323621 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac79e89d-8ff8-41d5-a90d-d5cfb79e20c2 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:16.336705 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac79e89d-8ff8-41d5-a90d-d5cfb79e20c2 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:16.344032 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076469e-8911-4cc8-b985-bfebd1f2cf1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:16.344748 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076469e-8911-4cc8-b985-bfebd1f2cf1c admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:16.345160 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076469e-8911-4cc8-b985-bfebd1f2cf1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:16.345499 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076469e-8911-4cc8-b985-bfebd1f2cf1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:16.346866 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076469e-8911-4cc8-b985-bfebd1f2cf1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:16.348929 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076469e-8911-4cc8-b985-bfebd1f2cf1c admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:16.373608 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1179/2390] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:01:16.374260 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e5f56-11ab-419a-a91f-1a3d2108efdd admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:16.386761 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e5f56-11ab-419a-a91f-1a3d2108efdd admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:16.391690 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b43f9-e5d5-4233-9e49-aec0c401aae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:16.392381 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b43f9-e5d5-4233-9e49-aec0c401aae9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:16.392690 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b43f9-e5d5-4233-9e49-aec0c401aae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:16.393005 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b43f9-e5d5-4233-9e49-aec0c401aae9 admin admin] PATH_INFO: `/v3/projects/2449f9b81d0b4fe1b08de2257fd4f10c/users/c163edfbac4a47a09a67936f31ee9a19/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:16.418090 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387b43f9-e5d5-4233-9e49-aec0c401aae9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2449f9b81d0b4fe1b08de2257fd4f10c, user_id=c163edfbac4a47a09a67936f31ee9a19, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:16.420978 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387b43f9-e5d5-4233-9e49-aec0c401aae9 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:16.441994 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1212/2391] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:01:16 2022] PUT /identity/v3/projects/2449f9b81d0b4fe1b08de2257fd4f10c/users/c163edfbac4a47a09a67936f31ee9a19/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:01:16.446794 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076469e-8911-4cc8-b985-bfebd1f2cf1c admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:16.457357 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076469e-8911-4cc8-b985-bfebd1f2cf1c admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:16.535184 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c80d01-9bdc-48e0-a25c-2bb1422122d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:16.535812 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c80d01-9bdc-48e0-a25c-2bb1422122d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:16.536098 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c80d01-9bdc-48e0-a25c-2bb1422122d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:16.536371 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c80d01-9bdc-48e0-a25c-2bb1422122d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:16.537071 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c80d01-9bdc-48e0-a25c-2bb1422122d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:16.538805 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c80d01-9bdc-48e0-a25c-2bb1422122d5 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:16.552852 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1180/2392] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:01:16.556293 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b43f9-e5d5-4233-9e49-aec0c401aae9 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:16.567356 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b43f9-e5d5-4233-9e49-aec0c401aae9 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:16.572337 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89a2fb-b002-47ef-91e6-2c0a21cab5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:16.573422 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89a2fb-b002-47ef-91e6-2c0a21cab5db admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:16.573705 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89a2fb-b002-47ef-91e6-2c0a21cab5db admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:16.573975 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89a2fb-b002-47ef-91e6-2c0a21cab5db admin admin] PATH_INFO: `/v3/projects/2449f9b81d0b4fe1b08de2257fd4f10c/users/c163edfbac4a47a09a67936f31ee9a19/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:16.575900 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e89a2fb-b002-47ef-91e6-2c0a21cab5db admin admin] RBAC: Authorizing `identity:create_grant(project_id=2449f9b81d0b4fe1b08de2257fd4f10c, user_id=c163edfbac4a47a09a67936f31ee9a19, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:16.578549 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e89a2fb-b002-47ef-91e6-2c0a21cab5db admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:16.597146 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1213/2393] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:01:16 2022] PUT /identity/v3/projects/2449f9b81d0b4fe1b08de2257fd4f10c/users/c163edfbac4a47a09a67936f31ee9a19/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:01:16.609038 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d364d1-bfd3-4bc3-b28f-31919462d556 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:16.609440 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d364d1-bfd3-4bc3-b28f-31919462d556 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:16.609719 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d364d1-bfd3-4bc3-b28f-31919462d556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:16.649569 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-68d364d1-bfd3-4bc3-b28f-31919462d556 None None] MFA Rules not processed for user `c163edfbac4a47a09a67936f31ee9a19`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:01:16.651694 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-68d364d1-bfd3-4bc3-b28f-31919462d556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:16.733943 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:16.766176 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1181/2394] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:01:16 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:01:16.786621 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89a2fb-b002-47ef-91e6-2c0a21cab5db admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:16.788967 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-0e89a2fb-b002-47ef-91e6-2c0a21cab5db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:16.864062 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89a2fb-b002-47ef-91e6-2c0a21cab5db admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:16.867627 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c346b-767d-40e4-9c0b-ba579cf53ae7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:16.868232 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c346b-767d-40e4-9c0b-ba579cf53ae7 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:16.868507 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c346b-767d-40e4-9c0b-ba579cf53ae7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:16.868801 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c346b-767d-40e4-9c0b-ba579cf53ae7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:16.879653 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c346b-767d-40e4-9c0b-ba579cf53ae7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:16.881388 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c346b-767d-40e4-9c0b-ba579cf53ae7 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:16.893261 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1214/2395] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:01:16 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:01:17.628839 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d364d1-bfd3-4bc3-b28f-31919462d556 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:17.758169 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c346b-767d-40e4-9c0b-ba579cf53ae7 service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:17.761539 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-456c346b-767d-40e4-9c0b-ba579cf53ae7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:17.775425 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d364d1-bfd3-4bc3-b28f-31919462d556 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:17.785200 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c6d5d-7af0-4d82-975f-903331606d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:17.785398 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c346b-767d-40e4-9c0b-ba579cf53ae7 service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:17.787675 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c6d5d-7af0-4d82-975f-903331606d90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:17.788022 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c6d5d-7af0-4d82-975f-903331606d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:17.788311 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c6d5d-7af0-4d82-975f-903331606d90 admin admin] PATH_INFO: `/v3/users/933e64b9a2a5439c97b8f5e7ab9562b9` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:17.790019 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c6d5d-7af0-4d82-975f-903331606d90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=933e64b9a2a5439c97b8f5e7ab9562b9)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:17.792854 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c6d5d-7af0-4d82-975f-903331606d90 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:17.798022 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e014670-bc0f-4768-9960-c73f2f0af673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:17.798688 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e014670-bc0f-4768-9960-c73f2f0af673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:17.798967 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e014670-bc0f-4768-9960-c73f2f0af673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:17.799236 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e014670-bc0f-4768-9960-c73f2f0af673 admin admin] PATH_INFO: `/v3/users/54646193ef6440bf84225cfdc9c6eff1` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:17.801452 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e014670-bc0f-4768-9960-c73f2f0af673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54646193ef6440bf84225cfdc9c6eff1)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:17.803401 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e014670-bc0f-4768-9960-c73f2f0af673 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:17.865699 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-301c6d5d-7af0-4d82-975f-903331606d90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '933e64b9a2a5439c97b8f5e7ab9562b9'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:17.881888 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-301c6d5d-7af0-4d82-975f-903331606d90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '933e64b9a2a5439c97b8f5e7ab9562b9'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:17.883068 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-301c6d5d-7af0-4d82-975f-903331606d90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '933e64b9a2a5439c97b8f5e7ab9562b9'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:17.883734 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-301c6d5d-7af0-4d82-975f-903331606d90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '933e64b9a2a5439c97b8f5e7ab9562b9'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:17.895930 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-301c6d5d-7af0-4d82-975f-903331606d90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '933e64b9a2a5439c97b8f5e7ab9562b9'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:17.896646 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-8e014670-bc0f-4768-9960-c73f2f0af673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54646193ef6440bf84225cfdc9c6eff1'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:17.897786 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-8e014670-bc0f-4768-9960-c73f2f0af673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54646193ef6440bf84225cfdc9c6eff1'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:17.910976 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-8e014670-bc0f-4768-9960-c73f2f0af673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54646193ef6440bf84225cfdc9c6eff1'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:17.912706 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1182/2396] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:01:17 2022] DELETE /identity/v3/users/933e64b9a2a5439c97b8f5e7ab9562b9 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:01:17.917563 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa12296-9e0b-4cdf-9988-d2385f9acafd None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:17.917915 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa12296-9e0b-4cdf-9988-d2385f9acafd None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:17.918668 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa12296-9e0b-4cdf-9988-d2385f9acafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:17.929719 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-8e014670-bc0f-4768-9960-c73f2f0af673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54646193ef6440bf84225cfdc9c6eff1'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:17.938993 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-8e014670-bc0f-4768-9960-c73f2f0af673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54646193ef6440bf84225cfdc9c6eff1'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:17.939937 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-eaa12296-9e0b-4cdf-9988-d2385f9acafd None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:01:17.940619 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:17.941007 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-eaa12296-9e0b-4cdf-9988-d2385f9acafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:17.948301 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1215/2397] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:01:17 2022] DELETE /identity/v3/users/54646193ef6440bf84225cfdc9c6eff1 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:01:17.952533 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f4647-89bf-4341-8939-2b306855cc48 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:17.953414 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f4647-89bf-4341-8939-2b306855cc48 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:17.953953 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f4647-89bf-4341-8939-2b306855cc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:17.977057 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-d08f4647-89bf-4341-8939-2b306855cc48 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:01:17.978381 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-d08f4647-89bf-4341-8939-2b306855cc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:18.015211 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1183/2398] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:01:18.025324 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa12296-9e0b-4cdf-9988-d2385f9acafd None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:18.026933 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-eaa12296-9e0b-4cdf-9988-d2385f9acafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:18.036842 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:18.046597 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1216/2399] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:01:18.057552 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f4647-89bf-4341-8939-2b306855cc48 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:18.060022 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-d08f4647-89bf-4341-8939-2b306855cc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:18.096185 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa12296-9e0b-4cdf-9988-d2385f9acafd None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:18.125712 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f4647-89bf-4341-8939-2b306855cc48 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:18.129814 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51508efc-47c5-4d9a-af37-76b97a09a478 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:18.130420 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51508efc-47c5-4d9a-af37-76b97a09a478 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:18.130697 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51508efc-47c5-4d9a-af37-76b97a09a478 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:18.130968 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51508efc-47c5-4d9a-af37-76b97a09a478 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:18.141122 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51508efc-47c5-4d9a-af37-76b97a09a478 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:18.142727 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51508efc-47c5-4d9a-af37-76b97a09a478 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:18.153650 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1217/2400] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:01:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:01:18.155160 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6378da7-33aa-4b20-b2c7-f4ee1725d950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:18.155779 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6378da7-33aa-4b20-b2c7-f4ee1725d950 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:18.156068 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6378da7-33aa-4b20-b2c7-f4ee1725d950 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:18.156343 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6378da7-33aa-4b20-b2c7-f4ee1725d950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:18.167307 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6378da7-33aa-4b20-b2c7-f4ee1725d950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:18.169246 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6378da7-33aa-4b20-b2c7-f4ee1725d950 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:18.180975 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1184/2401] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:01:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:01:18.567492 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51508efc-47c5-4d9a-af37-76b97a09a478 service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:18.569307 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-51508efc-47c5-4d9a-af37-76b97a09a478 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:18.584916 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51508efc-47c5-4d9a-af37-76b97a09a478 service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:18.591731 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f80c15-dd01-4219-8f31-6904708408f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:18.592380 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f80c15-dd01-4219-8f31-6904708408f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:18.592662 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f80c15-dd01-4219-8f31-6904708408f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:18.593039 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f80c15-dd01-4219-8f31-6904708408f7 admin admin] PATH_INFO: `/v3/projects/47a7d98889e84676890525536cfafda6` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:18.594201 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f80c15-dd01-4219-8f31-6904708408f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47a7d98889e84676890525536cfafda6)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:18.596741 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f80c15-dd01-4219-8f31-6904708408f7 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:18.676013 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6378da7-33aa-4b20-b2c7-f4ee1725d950 service neutron] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:18.678167 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-b6378da7-33aa-4b20-b2c7-f4ee1725d950 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:18.705314 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-31f80c15-dd01-4219-8f31-6904708408f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47a7d98889e84676890525536cfafda6', 'request_id': 'req-31f80c15-dd01-4219-8f31-6904708408f7'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:18.735067 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6378da7-33aa-4b20-b2c7-f4ee1725d950 service neutron] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:18.745043 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-31f80c15-dd01-4219-8f31-6904708408f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47a7d98889e84676890525536cfafda6', 'request_id': 'req-31f80c15-dd01-4219-8f31-6904708408f7'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:18.752658 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-31f80c15-dd01-4219-8f31-6904708408f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47a7d98889e84676890525536cfafda6', 'request_id': 'req-31f80c15-dd01-4219-8f31-6904708408f7'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:18.764846 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-31f80c15-dd01-4219-8f31-6904708408f7 admin admin] The token cache is being invalidate because project 47a7d98889e84676890525536cfafda6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:01:18.765457 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-31f80c15-dd01-4219-8f31-6904708408f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:18.766036 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-31f80c15-dd01-4219-8f31-6904708408f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:18.767263 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1218/2402] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:01:18 2022] DELETE /identity/v3/projects/47a7d98889e84676890525536cfafda6 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:01:18.834897 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c55a5-5fc6-48ee-94d5-839b03e4102d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:18.835772 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c55a5-5fc6-48ee-94d5-839b03e4102d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:18.836061 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c55a5-5fc6-48ee-94d5-839b03e4102d admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:18.840974 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c55a5-5fc6-48ee-94d5-839b03e4102d admin admin] PATH_INFO: `/v3/projects/d6511f8bf1c9404682c76112ff82745b` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:18.842690 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2c55a5-5fc6-48ee-94d5-839b03e4102d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6511f8bf1c9404682c76112ff82745b)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:18.853496 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2c55a5-5fc6-48ee-94d5-839b03e4102d admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:18.993313 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-2a2c55a5-5fc6-48ee-94d5-839b03e4102d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6511f8bf1c9404682c76112ff82745b', 'request_id': 'req-2a2c55a5-5fc6-48ee-94d5-839b03e4102d'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:19.001223 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-2a2c55a5-5fc6-48ee-94d5-839b03e4102d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6511f8bf1c9404682c76112ff82745b', 'request_id': 'req-2a2c55a5-5fc6-48ee-94d5-839b03e4102d'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:19.018688 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-2a2c55a5-5fc6-48ee-94d5-839b03e4102d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6511f8bf1c9404682c76112ff82745b', 'request_id': 'req-2a2c55a5-5fc6-48ee-94d5-839b03e4102d'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:19.022267 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:19.035626 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-2a2c55a5-5fc6-48ee-94d5-839b03e4102d admin admin] The token cache is being invalidate because project d6511f8bf1c9404682c76112ff82745b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:01:19.036108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-2a2c55a5-5fc6-48ee-94d5-839b03e4102d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:19.037012 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-2a2c55a5-5fc6-48ee-94d5-839b03e4102d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:19.038878 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1185/2403] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:01:18 2022] DELETE /identity/v3/projects/d6511f8bf1c9404682c76112ff82745b => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:01:19.043486 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f80c15-dd01-4219-8f31-6904708408f7 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:19.045041 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-31f80c15-dd01-4219-8f31-6904708408f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:19.060807 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f80c15-dd01-4219-8f31-6904708408f7 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:19.084525 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:19.130591 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd087c21-df3b-49a3-80c7-7c2f0c9395f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:19.131301 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd087c21-df3b-49a3-80c7-7c2f0c9395f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:19.131593 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd087c21-df3b-49a3-80c7-7c2f0c9395f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:19.132263 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd087c21-df3b-49a3-80c7-7c2f0c9395f4 admin admin] PATH_INFO: `/v3/users/c163edfbac4a47a09a67936f31ee9a19` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:19.133673 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd087c21-df3b-49a3-80c7-7c2f0c9395f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c163edfbac4a47a09a67936f31ee9a19)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:19.135718 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd087c21-df3b-49a3-80c7-7c2f0c9395f4 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:19.195300 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-fd087c21-df3b-49a3-80c7-7c2f0c9395f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c163edfbac4a47a09a67936f31ee9a19'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:19.196077 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-fd087c21-df3b-49a3-80c7-7c2f0c9395f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c163edfbac4a47a09a67936f31ee9a19'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:19.206457 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-fd087c21-df3b-49a3-80c7-7c2f0c9395f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c163edfbac4a47a09a67936f31ee9a19'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:19.223770 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-fd087c21-df3b-49a3-80c7-7c2f0c9395f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c163edfbac4a47a09a67936f31ee9a19'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:19.236042 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-fd087c21-df3b-49a3-80c7-7c2f0c9395f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c163edfbac4a47a09a67936f31ee9a19'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:19.240521 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1219/2404] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:01:19 2022] DELETE /identity/v3/users/c163edfbac4a47a09a67936f31ee9a19 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:01:19.660586 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c55a5-5fc6-48ee-94d5-839b03e4102d admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:19.662079 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-2a2c55a5-5fc6-48ee-94d5-839b03e4102d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:19.674955 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c55a5-5fc6-48ee-94d5-839b03e4102d admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:19.759418 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe9f74-66db-47ba-ba7e-3d20f5ef66a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:19.760272 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe9f74-66db-47ba-ba7e-3d20f5ef66a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:19.760615 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe9f74-66db-47ba-ba7e-3d20f5ef66a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:19.761001 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe9f74-66db-47ba-ba7e-3d20f5ef66a2 admin admin] PATH_INFO: `/v3/projects/2449f9b81d0b4fe1b08de2257fd4f10c` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:19.763331 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe9f74-66db-47ba-ba7e-3d20f5ef66a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2449f9b81d0b4fe1b08de2257fd4f10c)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:19.765635 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe9f74-66db-47ba-ba7e-3d20f5ef66a2 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:19.825608 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-5cfe9f74-66db-47ba-ba7e-3d20f5ef66a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2449f9b81d0b4fe1b08de2257fd4f10c', 'request_id': 'req-5cfe9f74-66db-47ba-ba7e-3d20f5ef66a2'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:19.831081 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-5cfe9f74-66db-47ba-ba7e-3d20f5ef66a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2449f9b81d0b4fe1b08de2257fd4f10c', 'request_id': 'req-5cfe9f74-66db-47ba-ba7e-3d20f5ef66a2'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:19.842316 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-5cfe9f74-66db-47ba-ba7e-3d20f5ef66a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2449f9b81d0b4fe1b08de2257fd4f10c', 'request_id': 'req-5cfe9f74-66db-47ba-ba7e-3d20f5ef66a2'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:19.856415 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-5cfe9f74-66db-47ba-ba7e-3d20f5ef66a2 admin admin] The token cache is being invalidate because project 2449f9b81d0b4fe1b08de2257fd4f10c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:01:19.856738 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-5cfe9f74-66db-47ba-ba7e-3d20f5ef66a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:19.857675 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-5cfe9f74-66db-47ba-ba7e-3d20f5ef66a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:19.859258 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1186/2405] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:01:19 2022] DELETE /identity/v3/projects/2449f9b81d0b4fe1b08de2257fd4f10c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:01:19.864229 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013c9ce-7d19-49e4-bbdb-c281f4f8dc87 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:19.864761 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013c9ce-7d19-49e4-bbdb-c281f4f8dc87 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:19.865611 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013c9ce-7d19-49e4-bbdb-c281f4f8dc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:19.887770 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-f013c9ce-7d19-49e4-bbdb-c281f4f8dc87 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:01:19.889108 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-f013c9ce-7d19-49e4-bbdb-c281f4f8dc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:19.960200 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1220/2406] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:01:19.967906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6abba-0605-4c61-b073-10351468f4a9 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:19.968192 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6abba-0605-4c61-b073-10351468f4a9 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:19.968468 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6abba-0605-4c61-b073-10351468f4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:19.990548 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-73a6abba-0605-4c61-b073-10351468f4a9 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:01:19.991771 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-73a6abba-0605-4c61-b073-10351468f4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:20.001294 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1187/2407] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:01:20.005580 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013c9ce-7d19-49e4-bbdb-c281f4f8dc87 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:20.015804 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013c9ce-7d19-49e4-bbdb-c281f4f8dc87 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:20.020622 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d10629-3bbc-4490-b5d3-745c9a2e0ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:20.021273 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d10629-3bbc-4490-b5d3-745c9a2e0ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:20.021553 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d10629-3bbc-4490-b5d3-745c9a2e0ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:20.021826 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d10629-3bbc-4490-b5d3-745c9a2e0ce0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:20.022513 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d10629-3bbc-4490-b5d3-745c9a2e0ce0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:01:20.022817 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d10629-3bbc-4490-b5d3-745c9a2e0ce0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:20.024633 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d10629-3bbc-4490-b5d3-745c9a2e0ce0 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:20.036936 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1221/2408] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 16:01:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:01:20.051557 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6abba-0605-4c61-b073-10351468f4a9 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:20.079580 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6abba-0605-4c61-b073-10351468f4a9 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:20.085680 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958dc68-a8dd-4c89-a91d-5c26354a9069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:20.086859 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958dc68-a8dd-4c89-a91d-5c26354a9069 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:20.087152 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958dc68-a8dd-4c89-a91d-5c26354a9069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:20.087426 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958dc68-a8dd-4c89-a91d-5c26354a9069 admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:20.088616 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958dc68-a8dd-4c89-a91d-5c26354a9069 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:20.090781 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958dc68-a8dd-4c89-a91d-5c26354a9069 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:20.122349 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1188/2409] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:01:20 2022] POST /identity/v3/projects => generated 373 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:01:20.127580 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d10629-3bbc-4490-b5d3-745c9a2e0ce0 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:20.138046 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d10629-3bbc-4490-b5d3-745c9a2e0ce0 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:20.170896 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:20.202281 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412254c-db38-4a4b-baf3-d8c379d347d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:20.202882 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412254c-db38-4a4b-baf3-d8c379d347d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:20.203157 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412254c-db38-4a4b-baf3-d8c379d347d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:20.203424 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412254c-db38-4a4b-baf3-d8c379d347d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:20.204056 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1412254c-db38-4a4b-baf3-d8c379d347d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:20.205985 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1412254c-db38-4a4b-baf3-d8c379d347d0 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:20.229723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1222/2410] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:01:20 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:01:20.238109 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958dc68-a8dd-4c89-a91d-5c26354a9069 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:20.251871 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958dc68-a8dd-4c89-a91d-5c26354a9069 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:20.257485 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a62fd4-b6f6-431b-9cc5-1717da0558c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:20.258180 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a62fd4-b6f6-431b-9cc5-1717da0558c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:20.258538 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a62fd4-b6f6-431b-9cc5-1717da0558c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:20.258917 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a62fd4-b6f6-431b-9cc5-1717da0558c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:20.259919 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a62fd4-b6f6-431b-9cc5-1717da0558c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:20.263006 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a62fd4-b6f6-431b-9cc5-1717da0558c1 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:20.277486 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1189/2411] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:01:20.281304 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412254c-db38-4a4b-baf3-d8c379d347d0 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:20.295586 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412254c-db38-4a4b-baf3-d8c379d347d0 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:20.300811 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e4d19-ca93-4cd5-9d4f-ad78bf5c46b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:20.301450 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e4d19-ca93-4cd5-9d4f-ad78bf5c46b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:20.302459 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e4d19-ca93-4cd5-9d4f-ad78bf5c46b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:20.302758 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e4d19-ca93-4cd5-9d4f-ad78bf5c46b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:20.303413 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e4d19-ca93-4cd5-9d4f-ad78bf5c46b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:20.305462 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e4d19-ca93-4cd5-9d4f-ad78bf5c46b5 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:20.326795 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1223/2412] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:01:20.331407 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a62fd4-b6f6-431b-9cc5-1717da0558c1 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:20.341703 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a62fd4-b6f6-431b-9cc5-1717da0558c1 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:20.346325 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc80160-dc81-486b-83c6-62f5f0354c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:20.346973 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc80160-dc81-486b-83c6-62f5f0354c51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:20.347253 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc80160-dc81-486b-83c6-62f5f0354c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:20.347528 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc80160-dc81-486b-83c6-62f5f0354c51 admin admin] PATH_INFO: `/v3/projects/13ebf4b0c43946ccb069dfd851adc3c8/users/72d5fc35ab0543be908ed82bb8dda5fb/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:20.363157 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc80160-dc81-486b-83c6-62f5f0354c51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ebf4b0c43946ccb069dfd851adc3c8, user_id=72d5fc35ab0543be908ed82bb8dda5fb, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:20.365874 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc80160-dc81-486b-83c6-62f5f0354c51 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:20.382429 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1190/2413] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:01:20 2022] PUT /identity/v3/projects/13ebf4b0c43946ccb069dfd851adc3c8/users/72d5fc35ab0543be908ed82bb8dda5fb/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:01:20.394729 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7400c-69ef-45e4-9ec4-7ccf1da1d393 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:20.395038 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7400c-69ef-45e4-9ec4-7ccf1da1d393 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:20.395314 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7400c-69ef-45e4-9ec4-7ccf1da1d393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:20.426822 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-92b7400c-69ef-45e4-9ec4-7ccf1da1d393 None None] MFA Rules not processed for user `72d5fc35ab0543be908ed82bb8dda5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:01:20.428222 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-92b7400c-69ef-45e4-9ec4-7ccf1da1d393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:20.513406 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1224/2414] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:01:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:01:20.527048 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc80160-dc81-486b-83c6-62f5f0354c51 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:20.528440 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-acc80160-dc81-486b-83c6-62f5f0354c51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:20.557094 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:20.597323 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc80160-dc81-486b-83c6-62f5f0354c51 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:20.601281 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886975b9-7819-4703-b85e-dda339cbbc1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:20.601941 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886975b9-7819-4703-b85e-dda339cbbc1b service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:20.602234 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886975b9-7819-4703-b85e-dda339cbbc1b service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:20.602492 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886975b9-7819-4703-b85e-dda339cbbc1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:20.611680 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886975b9-7819-4703-b85e-dda339cbbc1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:20.613168 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886975b9-7819-4703-b85e-dda339cbbc1b service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:20.622651 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1191/2415] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:01:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:01:23.769666 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7400c-69ef-45e4-9ec4-7ccf1da1d393 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:23.868470 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7400c-69ef-45e4-9ec4-7ccf1da1d393 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:23.875578 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49698b54-b481-42ce-a1f4-35b9ff78793f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:23.876374 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49698b54-b481-42ce-a1f4-35b9ff78793f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:23.877165 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49698b54-b481-42ce-a1f4-35b9ff78793f admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:23.879216 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49698b54-b481-42ce-a1f4-35b9ff78793f admin admin] PATH_INFO: `/v3/users/72d5fc35ab0543be908ed82bb8dda5fb` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:23.879745 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49698b54-b481-42ce-a1f4-35b9ff78793f admin admin] RBAC: Authorizing `identity:delete_user(user_id=72d5fc35ab0543be908ed82bb8dda5fb)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:23.882750 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49698b54-b481-42ce-a1f4-35b9ff78793f admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:23.943800 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:23.950247 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-49698b54-b481-42ce-a1f4-35b9ff78793f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72d5fc35ab0543be908ed82bb8dda5fb'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:23.951062 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-49698b54-b481-42ce-a1f4-35b9ff78793f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72d5fc35ab0543be908ed82bb8dda5fb'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:23.969529 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-49698b54-b481-42ce-a1f4-35b9ff78793f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72d5fc35ab0543be908ed82bb8dda5fb'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:23.983971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-49698b54-b481-42ce-a1f4-35b9ff78793f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72d5fc35ab0543be908ed82bb8dda5fb'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:23.990963 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-49698b54-b481-42ce-a1f4-35b9ff78793f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72d5fc35ab0543be908ed82bb8dda5fb'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:23.997846 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1225/2416] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:01:23 2022] DELETE /identity/v3/users/72d5fc35ab0543be908ed82bb8dda5fb => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:01:24.002707 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b0cc0-6a37-42ad-bbda-006fef57139e None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:24.003216 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b0cc0-6a37-42ad-bbda-006fef57139e None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:24.003358 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b0cc0-6a37-42ad-bbda-006fef57139e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:24.023708 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-b73b0cc0-6a37-42ad-bbda-006fef57139e None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:01:24.024943 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-b73b0cc0-6a37-42ad-bbda-006fef57139e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:24.084584 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1192/2417] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:01:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:01:24.094271 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49698b54-b481-42ce-a1f4-35b9ff78793f admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:24.095716 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-49698b54-b481-42ce-a1f4-35b9ff78793f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:24.154500 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49698b54-b481-42ce-a1f4-35b9ff78793f admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:24.158165 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35840e9d-0912-4a28-a74a-c261cc37d558 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:24.158753 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35840e9d-0912-4a28-a74a-c261cc37d558 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:24.159095 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35840e9d-0912-4a28-a74a-c261cc37d558 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:24.159290 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35840e9d-0912-4a28-a74a-c261cc37d558 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:24.169257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35840e9d-0912-4a28-a74a-c261cc37d558 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:24.170763 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35840e9d-0912-4a28-a74a-c261cc37d558 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:24.180679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1226/2418] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:01:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:01:24.522729 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b0cc0-6a37-42ad-bbda-006fef57139e None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:24.524381 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-b73b0cc0-6a37-42ad-bbda-006fef57139e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:24.536805 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b0cc0-6a37-42ad-bbda-006fef57139e None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:24.542817 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5200c3-284a-4dde-9d2f-965332868a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:24.543458 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5200c3-284a-4dde-9d2f-965332868a31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:24.543737 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5200c3-284a-4dde-9d2f-965332868a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:24.544009 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5200c3-284a-4dde-9d2f-965332868a31 admin admin] PATH_INFO: `/v3/projects/13ebf4b0c43946ccb069dfd851adc3c8` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:24.545157 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5200c3-284a-4dde-9d2f-965332868a31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13ebf4b0c43946ccb069dfd851adc3c8)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:24.547144 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5200c3-284a-4dde-9d2f-965332868a31 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:24.594634 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-ba5200c3-284a-4dde-9d2f-965332868a31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13ebf4b0c43946ccb069dfd851adc3c8', 'request_id': 'req-ba5200c3-284a-4dde-9d2f-965332868a31'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:24.600126 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-ba5200c3-284a-4dde-9d2f-965332868a31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13ebf4b0c43946ccb069dfd851adc3c8', 'request_id': 'req-ba5200c3-284a-4dde-9d2f-965332868a31'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:24.608572 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-ba5200c3-284a-4dde-9d2f-965332868a31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13ebf4b0c43946ccb069dfd851adc3c8', 'request_id': 'req-ba5200c3-284a-4dde-9d2f-965332868a31'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:24.619661 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-ba5200c3-284a-4dde-9d2f-965332868a31 admin admin] The token cache is being invalidate because project 13ebf4b0c43946ccb069dfd851adc3c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:01:24.619948 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-ba5200c3-284a-4dde-9d2f-965332868a31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:24.620580 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-ba5200c3-284a-4dde-9d2f-965332868a31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:24.622080 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1193/2419] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:01:24 2022] DELETE /identity/v3/projects/13ebf4b0c43946ccb069dfd851adc3c8 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:01:24.626993 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce05e7-a0cc-4e2b-9674-9da28fa4d957 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:24.627255 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce05e7-a0cc-4e2b-9674-9da28fa4d957 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:24.627526 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce05e7-a0cc-4e2b-9674-9da28fa4d957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:24.647844 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-b3ce05e7-a0cc-4e2b-9674-9da28fa4d957 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:01:24.649100 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-b3ce05e7-a0cc-4e2b-9674-9da28fa4d957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:24.715723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1227/2420] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:01:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:01:24.724848 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff07bad-9986-47bb-8271-0117556189a7 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:24.725177 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff07bad-9986-47bb-8271-0117556189a7 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:24.725456 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff07bad-9986-47bb-8271-0117556189a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:24.747737 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-1ff07bad-9986-47bb-8271-0117556189a7 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:01:24.748972 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-1ff07bad-9986-47bb-8271-0117556189a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:24.757561 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1194/2421] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:01:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:01:24.762108 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce05e7-a0cc-4e2b-9674-9da28fa4d957 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:24.771926 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce05e7-a0cc-4e2b-9674-9da28fa4d957 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:24.777208 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba9dd3-c166-460c-9b2e-5bc80f0a07ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:24.777810 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba9dd3-c166-460c-9b2e-5bc80f0a07ff admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:24.778084 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba9dd3-c166-460c-9b2e-5bc80f0a07ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:24.778351 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba9dd3-c166-460c-9b2e-5bc80f0a07ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:24.779024 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba9dd3-c166-460c-9b2e-5bc80f0a07ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:01:24.779319 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba9dd3-c166-460c-9b2e-5bc80f0a07ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:24.780948 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba9dd3-c166-460c-9b2e-5bc80f0a07ff admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:24.793833 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1228/2422] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 16:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:01:24.798181 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff07bad-9986-47bb-8271-0117556189a7 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:24.807677 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff07bad-9986-47bb-8271-0117556189a7 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:24.812326 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252c4e4-c515-4c1d-985a-d2d569045e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:24.812963 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252c4e4-c515-4c1d-985a-d2d569045e76 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:24.813970 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252c4e4-c515-4c1d-985a-d2d569045e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:24.813970 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252c4e4-c515-4c1d-985a-d2d569045e76 admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:24.814160 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d252c4e4-c515-4c1d-985a-d2d569045e76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:24.816016 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d252c4e4-c515-4c1d-985a-d2d569045e76 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:24.845287 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1195/2423] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:01:24 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:01:24.849292 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba9dd3-c166-460c-9b2e-5bc80f0a07ff admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:24.859991 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba9dd3-c166-460c-9b2e-5bc80f0a07ff admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:24.917054 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:24.934865 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce232798-480f-43fc-b21e-66003154449e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:24.935877 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce232798-480f-43fc-b21e-66003154449e admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:24.935877 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce232798-480f-43fc-b21e-66003154449e admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:24.936266 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce232798-480f-43fc-b21e-66003154449e admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:24.936809 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce232798-480f-43fc-b21e-66003154449e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:24.938724 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce232798-480f-43fc-b21e-66003154449e admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:24.963196 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1229/2424] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:01:24 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:01:24.967146 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252c4e4-c515-4c1d-985a-d2d569045e76 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:24.977757 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252c4e4-c515-4c1d-985a-d2d569045e76 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:24.984172 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0b517-7832-4ae0-8c70-0db030210bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:24.984952 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0b517-7832-4ae0-8c70-0db030210bcf admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:24.985336 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0b517-7832-4ae0-8c70-0db030210bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:24.985706 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0b517-7832-4ae0-8c70-0db030210bcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:24.986454 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0b517-7832-4ae0-8c70-0db030210bcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:24.988336 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0b517-7832-4ae0-8c70-0db030210bcf admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:25.004123 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1196/2425] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:01:25.008475 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce232798-480f-43fc-b21e-66003154449e admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:25.019602 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce232798-480f-43fc-b21e-66003154449e admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:25.024298 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1b1cc-4596-44e2-a95a-c7f693c6fcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:25.025012 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1b1cc-4596-44e2-a95a-c7f693c6fcfc admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:25.026019 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1b1cc-4596-44e2-a95a-c7f693c6fcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:25.026585 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1b1cc-4596-44e2-a95a-c7f693c6fcfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:25.027346 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1b1cc-4596-44e2-a95a-c7f693c6fcfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:25.029079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1b1cc-4596-44e2-a95a-c7f693c6fcfc admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:25.040262 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1230/2426] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:01:25.044888 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0b517-7832-4ae0-8c70-0db030210bcf admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:25.055342 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0b517-7832-4ae0-8c70-0db030210bcf admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:25.060984 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95ecce-08b1-47a2-9240-a4506aa46692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:25.061653 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95ecce-08b1-47a2-9240-a4506aa46692 admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:25.061930 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95ecce-08b1-47a2-9240-a4506aa46692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:25.062205 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95ecce-08b1-47a2-9240-a4506aa46692 admin admin] PATH_INFO: `/v3/projects/1a7226600d354caf9c9ad5389fab39f7/users/ba19605883374156b0abbb7ceceda663/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:25.068199 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:25.091066 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d95ecce-08b1-47a2-9240-a4506aa46692 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a7226600d354caf9c9ad5389fab39f7, user_id=ba19605883374156b0abbb7ceceda663, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:25.094453 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d95ecce-08b1-47a2-9240-a4506aa46692 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:25.111565 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1197/2427] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:01:25 2022] PUT /identity/v3/projects/1a7226600d354caf9c9ad5389fab39f7/users/ba19605883374156b0abbb7ceceda663/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:01:25.122710 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be9ec7-64f8-4671-a888-a144f85ccacc None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:25.123074 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be9ec7-64f8-4671-a888-a144f85ccacc None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:25.123453 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be9ec7-64f8-4671-a888-a144f85ccacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:25.153668 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-47be9ec7-64f8-4671-a888-a144f85ccacc None None] MFA Rules not processed for user `ba19605883374156b0abbb7ceceda663`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:01:25.155199 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-47be9ec7-64f8-4671-a888-a144f85ccacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:25.227405 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1231/2428] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:01:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:01:25.241061 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95ecce-08b1-47a2-9240-a4506aa46692 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:25.242811 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-0d95ecce-08b1-47a2-9240-a4506aa46692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:25.361280 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95ecce-08b1-47a2-9240-a4506aa46692 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:25.380322 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf0263-dc77-4000-a497-dee1c070d44d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:25.380322 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf0263-dc77-4000-a497-dee1c070d44d service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:25.380322 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf0263-dc77-4000-a497-dee1c070d44d service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:25.380649 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf0263-dc77-4000-a497-dee1c070d44d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:25.397369 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf0263-dc77-4000-a497-dee1c070d44d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:25.399224 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf0263-dc77-4000-a497-dee1c070d44d service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:25.421142 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1198/2429] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:01:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:01:28.233320 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be9ec7-64f8-4671-a888-a144f85ccacc None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:28.299541 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be9ec7-64f8-4671-a888-a144f85ccacc None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:28.304216 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75385550-838c-4ce8-afb5-eb39188783e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:28.304887 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75385550-838c-4ce8-afb5-eb39188783e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:28.305174 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75385550-838c-4ce8-afb5-eb39188783e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:28.305445 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75385550-838c-4ce8-afb5-eb39188783e4 admin admin] PATH_INFO: `/v3/users/ba19605883374156b0abbb7ceceda663` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:28.306658 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75385550-838c-4ce8-afb5-eb39188783e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba19605883374156b0abbb7ceceda663)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:28.308614 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75385550-838c-4ce8-afb5-eb39188783e4 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:28.364593 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-75385550-838c-4ce8-afb5-eb39188783e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba19605883374156b0abbb7ceceda663'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:28.365291 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-75385550-838c-4ce8-afb5-eb39188783e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba19605883374156b0abbb7ceceda663'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:28.374128 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-75385550-838c-4ce8-afb5-eb39188783e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba19605883374156b0abbb7ceceda663'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:28.378701 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:28.389316 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-75385550-838c-4ce8-afb5-eb39188783e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba19605883374156b0abbb7ceceda663'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:28.396350 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-75385550-838c-4ce8-afb5-eb39188783e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba19605883374156b0abbb7ceceda663'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:28.402226 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1232/2430] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:01:28 2022] DELETE /identity/v3/users/ba19605883374156b0abbb7ceceda663 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:01:28.406849 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b9b0a-77cd-4cdc-bed7-34b4b786cd98 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:28.407570 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b9b0a-77cd-4cdc-bed7-34b4b786cd98 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:28.407766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b9b0a-77cd-4cdc-bed7-34b4b786cd98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:28.429108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-1f3b9b0a-77cd-4cdc-bed7-34b4b786cd98 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:01:28.430293 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-1f3b9b0a-77cd-4cdc-bed7-34b4b786cd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:28.492901 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1199/2431] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:01:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:01:28.503104 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75385550-838c-4ce8-afb5-eb39188783e4 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:28.504633 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-75385550-838c-4ce8-afb5-eb39188783e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:28.569690 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75385550-838c-4ce8-afb5-eb39188783e4 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:28.575035 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3bd200-19c1-4ce4-adc4-47e1dd973edc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:28.575723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bd200-19c1-4ce4-adc4-47e1dd973edc service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:28.575931 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bd200-19c1-4ce4-adc4-47e1dd973edc service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:28.576205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bd200-19c1-4ce4-adc4-47e1dd973edc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:28.593290 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3bd200-19c1-4ce4-adc4-47e1dd973edc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:28.595061 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3bd200-19c1-4ce4-adc4-47e1dd973edc service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:28.606645 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1233/2432] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:01:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:01:28.897747 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b9b0a-77cd-4cdc-bed7-34b4b786cd98 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:28.899275 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-1f3b9b0a-77cd-4cdc-bed7-34b4b786cd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:28.913554 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b9b0a-77cd-4cdc-bed7-34b4b786cd98 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:28.918952 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413735f-09fb-40f0-b418-8c4bd34088eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:28.919594 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413735f-09fb-40f0-b418-8c4bd34088eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:28.919878 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413735f-09fb-40f0-b418-8c4bd34088eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:28.920150 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413735f-09fb-40f0-b418-8c4bd34088eb admin admin] PATH_INFO: `/v3/projects/1a7226600d354caf9c9ad5389fab39f7` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:28.921336 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9413735f-09fb-40f0-b418-8c4bd34088eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a7226600d354caf9c9ad5389fab39f7)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:28.923268 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9413735f-09fb-40f0-b418-8c4bd34088eb admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:28.970136 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-9413735f-09fb-40f0-b418-8c4bd34088eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a7226600d354caf9c9ad5389fab39f7', 'request_id': 'req-9413735f-09fb-40f0-b418-8c4bd34088eb'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:28.976308 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-9413735f-09fb-40f0-b418-8c4bd34088eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a7226600d354caf9c9ad5389fab39f7', 'request_id': 'req-9413735f-09fb-40f0-b418-8c4bd34088eb'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:28.986812 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-9413735f-09fb-40f0-b418-8c4bd34088eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a7226600d354caf9c9ad5389fab39f7', 'request_id': 'req-9413735f-09fb-40f0-b418-8c4bd34088eb'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:28.999298 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-9413735f-09fb-40f0-b418-8c4bd34088eb admin admin] The token cache is being invalidate because project 1a7226600d354caf9c9ad5389fab39f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:01:28.999587 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-9413735f-09fb-40f0-b418-8c4bd34088eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:29.000234 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-9413735f-09fb-40f0-b418-8c4bd34088eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:29.001764 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1200/2433] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:01:28 2022] DELETE /identity/v3/projects/1a7226600d354caf9c9ad5389fab39f7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:01:29.007070 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea6e37-5d34-4780-aa68-73f2dc85187b None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:29.007407 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea6e37-5d34-4780-aa68-73f2dc85187b None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:29.007687 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea6e37-5d34-4780-aa68-73f2dc85187b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:29.027598 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-faea6e37-5d34-4780-aa68-73f2dc85187b None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:01:29.028840 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-faea6e37-5d34-4780-aa68-73f2dc85187b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:29.092324 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1234/2434] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:01:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:01:29.100181 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1fa513-fc2e-4e68-867d-03aa61ecf085 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:29.100470 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1fa513-fc2e-4e68-867d-03aa61ecf085 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:29.100748 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1fa513-fc2e-4e68-867d-03aa61ecf085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:29.121638 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-7d1fa513-fc2e-4e68-867d-03aa61ecf085 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:01:29.122854 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-7d1fa513-fc2e-4e68-867d-03aa61ecf085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:29.136252 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1201/2435] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:01:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:01:29.136394 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea6e37-5d34-4780-aa68-73f2dc85187b None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:29.145616 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea6e37-5d34-4780-aa68-73f2dc85187b None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:29.150641 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1c37b-736c-4edc-8ad1-be22e14a2042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:29.151231 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1c37b-736c-4edc-8ad1-be22e14a2042 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:29.151507 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1c37b-736c-4edc-8ad1-be22e14a2042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:29.151774 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1c37b-736c-4edc-8ad1-be22e14a2042 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:29.152411 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd1c37b-736c-4edc-8ad1-be22e14a2042 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:01:29.152706 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd1c37b-736c-4edc-8ad1-be22e14a2042 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:29.154306 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd1c37b-736c-4edc-8ad1-be22e14a2042 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:29.166744 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1235/2436] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 16:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:01:29.176611 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1fa513-fc2e-4e68-867d-03aa61ecf085 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:29.182538 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:29.186686 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1fa513-fc2e-4e68-867d-03aa61ecf085 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:29.192612 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4be374-1651-4b33-86c1-e42c6dfd036d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:29.193271 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4be374-1651-4b33-86c1-e42c6dfd036d admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:29.193613 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4be374-1651-4b33-86c1-e42c6dfd036d admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:29.193913 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4be374-1651-4b33-86c1-e42c6dfd036d admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:29.194658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4be374-1651-4b33-86c1-e42c6dfd036d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:29.196736 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4be374-1651-4b33-86c1-e42c6dfd036d admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:29.223691 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1202/2437] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:01:29 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:01:29.227987 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1c37b-736c-4edc-8ad1-be22e14a2042 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:29.239173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1c37b-736c-4edc-8ad1-be22e14a2042 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:29.295500 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e073517-54a9-4209-a264-fdc47ef040df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:29.296107 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e073517-54a9-4209-a264-fdc47ef040df admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:29.296382 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e073517-54a9-4209-a264-fdc47ef040df admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:29.296654 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e073517-54a9-4209-a264-fdc47ef040df admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:29.297598 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e073517-54a9-4209-a264-fdc47ef040df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:29.299703 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e073517-54a9-4209-a264-fdc47ef040df admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:29.311344 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:29.321745 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1236/2438] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:01:29 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:01:29.325864 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4be374-1651-4b33-86c1-e42c6dfd036d admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:29.336231 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4be374-1651-4b33-86c1-e42c6dfd036d admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:29.341872 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d7241-6206-49b3-9665-e10bbc584051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:29.342544 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d7241-6206-49b3-9665-e10bbc584051 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:29.342897 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d7241-6206-49b3-9665-e10bbc584051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:29.343172 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d7241-6206-49b3-9665-e10bbc584051 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:29.343963 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d7241-6206-49b3-9665-e10bbc584051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:29.355435 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d7241-6206-49b3-9665-e10bbc584051 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:29.378893 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1203/2439] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:01:29.380038 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e073517-54a9-4209-a264-fdc47ef040df admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:29.390702 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e073517-54a9-4209-a264-fdc47ef040df admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:29.395683 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a64e0-4f07-4304-9c4e-08c1be679823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:29.396296 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a64e0-4f07-4304-9c4e-08c1be679823 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:29.396576 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a64e0-4f07-4304-9c4e-08c1be679823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:29.396890 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a64e0-4f07-4304-9c4e-08c1be679823 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:29.397541 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a64e0-4f07-4304-9c4e-08c1be679823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:29.399124 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a64e0-4f07-4304-9c4e-08c1be679823 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:29.412225 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1237/2440] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:01:29.417561 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d7241-6206-49b3-9665-e10bbc584051 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:29.427779 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d7241-6206-49b3-9665-e10bbc584051 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:29.432983 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95906427-bc1b-4c73-b562-aa25c0ff269e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:29.433718 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95906427-bc1b-4c73-b562-aa25c0ff269e admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:29.433981 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95906427-bc1b-4c73-b562-aa25c0ff269e admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:29.434306 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95906427-bc1b-4c73-b562-aa25c0ff269e admin admin] PATH_INFO: `/v3/projects/f2999d756846440b8611bdadf25be0e9/users/0247cda461f643a793c2a11a3e86c469/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:29.450412 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95906427-bc1b-4c73-b562-aa25c0ff269e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2999d756846440b8611bdadf25be0e9, user_id=0247cda461f643a793c2a11a3e86c469, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:29.453804 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95906427-bc1b-4c73-b562-aa25c0ff269e admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:29.470514 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1204/2441] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:01:29 2022] PUT /identity/v3/projects/f2999d756846440b8611bdadf25be0e9/users/0247cda461f643a793c2a11a3e86c469/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:01:29.482567 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0600c4-e7a7-44ba-9d5c-dcc37095f2b2 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:29.482859 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0600c4-e7a7-44ba-9d5c-dcc37095f2b2 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:29.483132 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0600c4-e7a7-44ba-9d5c-dcc37095f2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:29.513368 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-9d0600c4-e7a7-44ba-9d5c-dcc37095f2b2 None None] MFA Rules not processed for user `0247cda461f643a793c2a11a3e86c469`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:01:29.514584 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-9d0600c4-e7a7-44ba-9d5c-dcc37095f2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:29.593185 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1238/2442] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:01:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:01:29.601043 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95906427-bc1b-4c73-b562-aa25c0ff269e admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:29.603111 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-95906427-bc1b-4c73-b562-aa25c0ff269e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:29.665133 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95906427-bc1b-4c73-b562-aa25c0ff269e admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:29.669137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f52b49-1923-49eb-b60e-51fe316c7aed service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9bd815f8fe54d7d99e00a47212ad9ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:29.669717 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f52b49-1923-49eb-b60e-51fe316c7aed service glance] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:29.670000 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f52b49-1923-49eb-b60e-51fe316c7aed service glance] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:29.670273 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f52b49-1923-49eb-b60e-51fe316c7aed service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:29.678684 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f52b49-1923-49eb-b60e-51fe316c7aed service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:29.680123 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f52b49-1923-49eb-b60e-51fe316c7aed service glance] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:29.689032 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1205/2443] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:01:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:01:33.266871 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80042ff-38da-414b-90e1-a62bf5de7d99 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:33.267352 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80042ff-38da-414b-90e1-a62bf5de7d99 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:33.267444 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80042ff-38da-414b-90e1-a62bf5de7d99 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:33.268963 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1239/2444] 10.222.0.25 () {54 vars in 921 bytes} [Tue Aug 30 16:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:01:33.360483 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c805d09-ec31-4e30-a139-656afb2c13ef None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:33.360483 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c805d09-ec31-4e30-a139-656afb2c13ef None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:33.360483 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c805d09-ec31-4e30-a139-656afb2c13ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:33.392777 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-4c805d09-ec31-4e30-a139-656afb2c13ef None None] MFA Rules not processed for user `2bba851e1a0d4601b5d4841662f645dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:01:33.394352 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-4c805d09-ec31-4e30-a139-656afb2c13ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:33.578940 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1206/2445] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Aug 30 16:01:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:01:33.590684 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80042ff-38da-414b-90e1-a62bf5de7d99 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:33.593313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-e80042ff-38da-414b-90e1-a62bf5de7d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:33.617841 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80042ff-38da-414b-90e1-a62bf5de7d99 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:33.631403 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f0a4e-c696-4e1b-b17c-f6e1e3d3857e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bba851e1a0d4601b5d4841662f645dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:33.633014 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f0a4e-c696-4e1b-b17c-f6e1e3d3857e service placement] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:33.633709 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f0a4e-c696-4e1b-b17c-f6e1e3d3857e service placement] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:33.634849 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f0a4e-c696-4e1b-b17c-f6e1e3d3857e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:33.651437 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f0a4e-c696-4e1b-b17c-f6e1e3d3857e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:33.653406 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f0a4e-c696-4e1b-b17c-f6e1e3d3857e service placement] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:33.677293 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1240/2446] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:01:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:01:34.097556 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c805d09-ec31-4e30-a139-656afb2c13ef None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:34.099236 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-4c805d09-ec31-4e30-a139-656afb2c13ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:34.156265 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:34.175910 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c805d09-ec31-4e30-a139-656afb2c13ef None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:34.182100 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad725eb-12c6-4668-9aa8-7897fe34eb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:34.182840 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad725eb-12c6-4668-9aa8-7897fe34eb4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:34.183116 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad725eb-12c6-4668-9aa8-7897fe34eb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:34.183388 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad725eb-12c6-4668-9aa8-7897fe34eb4e admin admin] PATH_INFO: `/v3/users/5d8a1e4ac4644274944267ab90d20eab` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:34.184544 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad725eb-12c6-4668-9aa8-7897fe34eb4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d8a1e4ac4644274944267ab90d20eab)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:34.186501 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad725eb-12c6-4668-9aa8-7897fe34eb4e admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:34.234268 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-aad725eb-12c6-4668-9aa8-7897fe34eb4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d8a1e4ac4644274944267ab90d20eab'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:34.252468 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-aad725eb-12c6-4668-9aa8-7897fe34eb4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d8a1e4ac4644274944267ab90d20eab'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:34.253302 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-aad725eb-12c6-4668-9aa8-7897fe34eb4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d8a1e4ac4644274944267ab90d20eab'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:34.253915 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-aad725eb-12c6-4668-9aa8-7897fe34eb4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d8a1e4ac4644274944267ab90d20eab'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:34.262159 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-aad725eb-12c6-4668-9aa8-7897fe34eb4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d8a1e4ac4644274944267ab90d20eab'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:34.274766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1207/2447] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:01:34 2022] DELETE /identity/v3/users/5d8a1e4ac4644274944267ab90d20eab => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:01:34.452839 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f0a4e-c696-4e1b-b17c-f6e1e3d3857e service placement] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:34.466706 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f0a4e-c696-4e1b-b17c-f6e1e3d3857e service placement] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:34.535126 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832cc0f1-3554-487b-bc67-5a52ca42ebb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:34.535783 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832cc0f1-3554-487b-bc67-5a52ca42ebb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:34.536060 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832cc0f1-3554-487b-bc67-5a52ca42ebb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:34.536325 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832cc0f1-3554-487b-bc67-5a52ca42ebb0 admin admin] PATH_INFO: `/v3/projects/2f70e24c3d9d4181be8a529d35e0a4c3` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:34.537553 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832cc0f1-3554-487b-bc67-5a52ca42ebb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f70e24c3d9d4181be8a529d35e0a4c3)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:34.539515 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832cc0f1-3554-487b-bc67-5a52ca42ebb0 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:34.590738 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-832cc0f1-3554-487b-bc67-5a52ca42ebb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f70e24c3d9d4181be8a529d35e0a4c3', 'request_id': 'req-832cc0f1-3554-487b-bc67-5a52ca42ebb0'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:34.598614 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-832cc0f1-3554-487b-bc67-5a52ca42ebb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f70e24c3d9d4181be8a529d35e0a4c3', 'request_id': 'req-832cc0f1-3554-487b-bc67-5a52ca42ebb0'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:34.607453 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-832cc0f1-3554-487b-bc67-5a52ca42ebb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f70e24c3d9d4181be8a529d35e0a4c3', 'request_id': 'req-832cc0f1-3554-487b-bc67-5a52ca42ebb0'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:34.609943 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:34.621790 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-832cc0f1-3554-487b-bc67-5a52ca42ebb0 admin admin] The token cache is being invalidate because project 2f70e24c3d9d4181be8a529d35e0a4c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:01:34.622159 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-832cc0f1-3554-487b-bc67-5a52ca42ebb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:34.622860 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-832cc0f1-3554-487b-bc67-5a52ca42ebb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:34.624417 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1241/2448] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:01:34 2022] DELETE /identity/v3/projects/2f70e24c3d9d4181be8a529d35e0a4c3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:01:34.628746 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad725eb-12c6-4668-9aa8-7897fe34eb4e admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:34.633416 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-aad725eb-12c6-4668-9aa8-7897fe34eb4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:34.646978 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad725eb-12c6-4668-9aa8-7897fe34eb4e admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:34.710703 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f7fdc-037e-4096-9881-7105a2236353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:34.711427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f7fdc-037e-4096-9881-7105a2236353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:34.711708 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f7fdc-037e-4096-9881-7105a2236353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:34.711993 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f7fdc-037e-4096-9881-7105a2236353 admin admin] PATH_INFO: `/v3/users/8c243e3da5df4f438a22366629f79326` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:34.714199 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f7fdc-037e-4096-9881-7105a2236353 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c243e3da5df4f438a22366629f79326)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:34.716137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f7fdc-037e-4096-9881-7105a2236353 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:34.767840 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-cf3f7fdc-037e-4096-9881-7105a2236353 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c243e3da5df4f438a22366629f79326'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:34.781111 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-cf3f7fdc-037e-4096-9881-7105a2236353 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c243e3da5df4f438a22366629f79326'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:34.781754 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-cf3f7fdc-037e-4096-9881-7105a2236353 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c243e3da5df4f438a22366629f79326'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:34.782348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-cf3f7fdc-037e-4096-9881-7105a2236353 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c243e3da5df4f438a22366629f79326'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:34.784968 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:34.790760 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-cf3f7fdc-037e-4096-9881-7105a2236353 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c243e3da5df4f438a22366629f79326'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:34.804423 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1208/2449] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:01:34 2022] DELETE /identity/v3/users/8c243e3da5df4f438a22366629f79326 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:01:34.986726 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832cc0f1-3554-487b-bc67-5a52ca42ebb0 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:34.990637 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-832cc0f1-3554-487b-bc67-5a52ca42ebb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:35.034000 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832cc0f1-3554-487b-bc67-5a52ca42ebb0 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:35.106864 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ccf1eb-bec4-4af9-a33f-638797966541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:35.107790 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ccf1eb-bec4-4af9-a33f-638797966541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:35.108080 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ccf1eb-bec4-4af9-a33f-638797966541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:35.108357 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ccf1eb-bec4-4af9-a33f-638797966541 admin admin] PATH_INFO: `/v3/projects/0bdf772e68394307b978424ae26e6cb8` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:35.109549 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ccf1eb-bec4-4af9-a33f-638797966541 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bdf772e68394307b978424ae26e6cb8)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:35.111629 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ccf1eb-bec4-4af9-a33f-638797966541 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:35.167580 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a7ccf1eb-bec4-4af9-a33f-638797966541 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bdf772e68394307b978424ae26e6cb8', 'request_id': 'req-a7ccf1eb-bec4-4af9-a33f-638797966541'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:35.176917 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a7ccf1eb-bec4-4af9-a33f-638797966541 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bdf772e68394307b978424ae26e6cb8', 'request_id': 'req-a7ccf1eb-bec4-4af9-a33f-638797966541'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:35.191298 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a7ccf1eb-bec4-4af9-a33f-638797966541 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bdf772e68394307b978424ae26e6cb8', 'request_id': 'req-a7ccf1eb-bec4-4af9-a33f-638797966541'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:35.206404 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a7ccf1eb-bec4-4af9-a33f-638797966541 admin admin] The token cache is being invalidate because project 0bdf772e68394307b978424ae26e6cb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:01:35.206697 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a7ccf1eb-bec4-4af9-a33f-638797966541 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:35.207371 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a7ccf1eb-bec4-4af9-a33f-638797966541 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:01:35.209054 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1242/2450] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:01:34 2022] DELETE /identity/v3/projects/0bdf772e68394307b978424ae26e6cb8 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:01:35.219044 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaacfe6-eecb-40c8-92bc-e28731b7cd1f None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:35.219338 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaacfe6-eecb-40c8-92bc-e28731b7cd1f None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:35.219622 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaacfe6-eecb-40c8-92bc-e28731b7cd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:35.247639 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-abaacfe6-eecb-40c8-92bc-e28731b7cd1f None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:01:35.252764 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-abaacfe6-eecb-40c8-92bc-e28731b7cd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:35.339217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1209/2451] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:01:35.347098 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2d513-6419-4815-a4a3-1a01fa565fb8 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:35.347381 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2d513-6419-4815-a4a3-1a01fa565fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:35.347714 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2d513-6419-4815-a4a3-1a01fa565fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:35.373493 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-3fa2d513-6419-4815-a4a3-1a01fa565fb8 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:01:35.374827 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-3fa2d513-6419-4815-a4a3-1a01fa565fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:35.387748 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1243/2452] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:01:35.392534 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaacfe6-eecb-40c8-92bc-e28731b7cd1f None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:35.404174 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaacfe6-eecb-40c8-92bc-e28731b7cd1f None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:35.410211 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e959b-d377-48b2-a5d9-6f5dc5d477fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:35.411265 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e959b-d377-48b2-a5d9-6f5dc5d477fb admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:35.411737 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e959b-d377-48b2-a5d9-6f5dc5d477fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:35.412196 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e959b-d377-48b2-a5d9-6f5dc5d477fb admin admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:35.413241 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e959b-d377-48b2-a5d9-6f5dc5d477fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:01:35.413652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e959b-d377-48b2-a5d9-6f5dc5d477fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:35.425334 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e959b-d377-48b2-a5d9-6f5dc5d477fb admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:35.458394 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1210/2453] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 16:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:01:35.459901 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2d513-6419-4815-a4a3-1a01fa565fb8 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:35.470976 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2d513-6419-4815-a4a3-1a01fa565fb8 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:35.479964 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcecdc8-154c-45c7-b250-263246c88757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:35.481136 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcecdc8-154c-45c7-b250-263246c88757 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:35.481430 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcecdc8-154c-45c7-b250-263246c88757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:35.482066 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcecdc8-154c-45c7-b250-263246c88757 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:35.482809 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcecdc8-154c-45c7-b250-263246c88757 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:35.485436 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcecdc8-154c-45c7-b250-263246c88757 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:35.534517 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1244/2454] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:01:35 2022] POST /identity/v3/projects => generated 363 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:01:35.538838 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e959b-d377-48b2-a5d9-6f5dc5d477fb admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:35.552985 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e959b-d377-48b2-a5d9-6f5dc5d477fb admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:35.628993 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b1c6e-1d2b-432c-a86c-91f05d2b8e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:35.629791 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b1c6e-1d2b-432c-a86c-91f05d2b8e6b admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:35.629920 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b1c6e-1d2b-432c-a86c-91f05d2b8e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:35.630154 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b1c6e-1d2b-432c-a86c-91f05d2b8e6b admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:35.630752 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b1c6e-1d2b-432c-a86c-91f05d2b8e6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:35.637101 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b1c6e-1d2b-432c-a86c-91f05d2b8e6b admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:35.673939 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1211/2455] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:01:35 2022] POST /identity/v3/users => generated 282 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:01:35.677287 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcecdc8-154c-45c7-b250-263246c88757 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:35.695913 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcecdc8-154c-45c7-b250-263246c88757 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:35.704042 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc43667-1f0d-4353-86d9-e343fa1a1dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:35.704668 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc43667-1f0d-4353-86d9-e343fa1a1dbe admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:35.704978 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc43667-1f0d-4353-86d9-e343fa1a1dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:35.705247 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc43667-1f0d-4353-86d9-e343fa1a1dbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:35.705896 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc43667-1f0d-4353-86d9-e343fa1a1dbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:35.707664 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc43667-1f0d-4353-86d9-e343fa1a1dbe admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:35.726645 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1245/2456] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:01:35.727073 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b1c6e-1d2b-432c-a86c-91f05d2b8e6b admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:35.741851 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b1c6e-1d2b-432c-a86c-91f05d2b8e6b admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:35.751135 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf488ec-4a95-45a6-87ec-d1c9d208ae85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:35.751135 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf488ec-4a95-45a6-87ec-d1c9d208ae85 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:35.751135 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf488ec-4a95-45a6-87ec-d1c9d208ae85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:35.752113 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf488ec-4a95-45a6-87ec-d1c9d208ae85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:35.752808 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf488ec-4a95-45a6-87ec-d1c9d208ae85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:35.754415 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf488ec-4a95-45a6-87ec-d1c9d208ae85 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:35.772336 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1212/2457] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:01:35.781275 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc43667-1f0d-4353-86d9-e343fa1a1dbe admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:35.796612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc43667-1f0d-4353-86d9-e343fa1a1dbe admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:35.802233 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab2cd3-7dd7-4287-ad81-83a70ab9aad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:35.803031 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab2cd3-7dd7-4287-ad81-83a70ab9aad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:35.803400 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab2cd3-7dd7-4287-ad81-83a70ab9aad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:35.803564 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab2cd3-7dd7-4287-ad81-83a70ab9aad3 admin admin] PATH_INFO: `/v3/projects/084f0b44eaa847fcaa5c3a7a956cd526/users/6c8d579d699a416a947cbb11b0e8983d/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:35.827930 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab2cd3-7dd7-4287-ad81-83a70ab9aad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=084f0b44eaa847fcaa5c3a7a956cd526, user_id=6c8d579d699a416a947cbb11b0e8983d, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:35.831339 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab2cd3-7dd7-4287-ad81-83a70ab9aad3 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:35.853563 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1246/2458] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:01:35 2022] PUT /identity/v3/projects/084f0b44eaa847fcaa5c3a7a956cd526/users/6c8d579d699a416a947cbb11b0e8983d/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:01:35.865020 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68c4c7-7c84-4d84-b52f-eeeffcd935ce None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:35.865309 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68c4c7-7c84-4d84-b52f-eeeffcd935ce None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:35.865581 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68c4c7-7c84-4d84-b52f-eeeffcd935ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:35.909453 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-4c68c4c7-7c84-4d84-b52f-eeeffcd935ce None None] MFA Rules not processed for user `6c8d579d699a416a947cbb11b0e8983d`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:01:35.911079 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-4c68c4c7-7c84-4d84-b52f-eeeffcd935ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:35.984675 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:36.030288 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1213/2459] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:01:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:01:36.095453 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab2cd3-7dd7-4287-ad81-83a70ab9aad3 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:36.096813 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-8cab2cd3-7dd7-4287-ad81-83a70ab9aad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:36.127727 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:36.185278 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab2cd3-7dd7-4287-ad81-83a70ab9aad3 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:36.189253 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d65d00-f7b8-4e2a-b279-44b84caf15c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:36.190047 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d65d00-f7b8-4e2a-b279-44b84caf15c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:36.190240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d65d00-f7b8-4e2a-b279-44b84caf15c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:36.190511 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d65d00-f7b8-4e2a-b279-44b84caf15c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:36.205745 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d65d00-f7b8-4e2a-b279-44b84caf15c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:36.207504 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d65d00-f7b8-4e2a-b279-44b84caf15c1 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:36.230597 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1247/2460] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:01:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:01:36.522451 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ce467-d8f1-46aa-ba4c-577f82dde43e None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:36.522747 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ce467-d8f1-46aa-ba4c-577f82dde43e None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:36.523020 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ce467-d8f1-46aa-ba4c-577f82dde43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:36.534271 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb92d70-8acc-4879-804d-027f67f4089a None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:36.534742 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb92d70-8acc-4879-804d-027f67f4089a None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:36.535117 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb92d70-8acc-4879-804d-027f67f4089a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:36.558749 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-bf8ce467-d8f1-46aa-ba4c-577f82dde43e None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:01:36.560159 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-bf8ce467-d8f1-46aa-ba4c-577f82dde43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:36.561970 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-3eb92d70-8acc-4879-804d-027f67f4089a None None] MFA Rules not processed for user `041323d39916493aa4318309904f4ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:01:36.563204 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-3eb92d70-8acc-4879-804d-027f67f4089a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:36.638140 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1248/2461] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:01:36 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:01:36.647363 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1214/2462] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Aug 30 16:01:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:01:36.676796 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb92d70-8acc-4879-804d-027f67f4089a None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:36.678191 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-3eb92d70-8acc-4879-804d-027f67f4089a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:36.761350 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb92d70-8acc-4879-804d-027f67f4089a None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:36.766917 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053713e-6a72-485e-b554-54759148576f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:36.767517 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053713e-6a72-485e-b554-54759148576f service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:36.767795 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053713e-6a72-485e-b554-54759148576f service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:36.768065 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053713e-6a72-485e-b554-54759148576f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:36.780157 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053713e-6a72-485e-b554-54759148576f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:36.782160 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053713e-6a72-485e-b554-54759148576f service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:36.795339 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1249/2463] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:01:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:01:37.539072 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc1934-571e-47e1-aa35-b340d6ff5667 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:37.539369 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc1934-571e-47e1-aa35-b340d6ff5667 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:37.539649 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc1934-571e-47e1-aa35-b340d6ff5667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:37.560473 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-e5fc1934-571e-47e1-aa35-b340d6ff5667 None None] MFA Rules not processed for user `d7958b395d5e4f5da37927536b1856ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:01:37.562271 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-e5fc1934-571e-47e1-aa35-b340d6ff5667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:37.663260 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1215/2464] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Aug 30 16:01:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:01:37.677910 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053713e-6a72-485e-b554-54759148576f service nova] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:37.686147 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c053713e-6a72-485e-b554-54759148576f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:37.748975 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:37.767947 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053713e-6a72-485e-b554-54759148576f service nova] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:37.773039 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b268ba1-83b2-4675-bade-75c619af5804 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94765f224c734beabe83b4dc0c5e511f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:37.773654 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b268ba1-83b2-4675-bade-75c619af5804 service swift] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:37.773990 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b268ba1-83b2-4675-bade-75c619af5804 service swift] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:37.774266 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b268ba1-83b2-4675-bade-75c619af5804 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:37.783621 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b268ba1-83b2-4675-bade-75c619af5804 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:37.785331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b268ba1-83b2-4675-bade-75c619af5804 service swift] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:37.794979 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1250/2465] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Aug 30 16:01:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 16:01:41.044121 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb780b-f1b9-4795-a78f-75e8a42ba64a None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:41.045262 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb780b-f1b9-4795-a78f-75e8a42ba64a None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:41.045650 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb780b-f1b9-4795-a78f-75e8a42ba64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:41.069951 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-c7eb780b-f1b9-4795-a78f-75e8a42ba64a None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:01:41.071239 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-c7eb780b-f1b9-4795-a78f-75e8a42ba64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:41.080959 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1216/2466] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Aug 30 16:01:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:01:41.111565 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b268ba1-83b2-4675-bade-75c619af5804 service swift] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:41.129395 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b268ba1-83b2-4675-bade-75c619af5804 service swift] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:41.135836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d11e8b-1eb8-4ac3-ad33-06f79739d487 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:41.136473 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d11e8b-1eb8-4ac3-ad33-06f79739d487 service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:41.136746 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d11e8b-1eb8-4ac3-ad33-06f79739d487 service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:41.137046 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d11e8b-1eb8-4ac3-ad33-06f79739d487 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:41.145713 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d11e8b-1eb8-4ac3-ad33-06f79739d487 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:41.147419 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d11e8b-1eb8-4ac3-ad33-06f79739d487 service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:41.159239 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1251/2467] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:01:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:01:44.490125 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd2c61-67d0-4636-92a9-9f861e3fd771 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:44.490656 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd2c61-67d0-4636-92a9-9f861e3fd771 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:44.490760 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd2c61-67d0-4636-92a9-9f861e3fd771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:44.513088 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-f9dd2c61-67d0-4636-92a9-9f861e3fd771 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:01:44.514341 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-f9dd2c61-67d0-4636-92a9-9f861e3fd771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:44.523310 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1217/2468] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Aug 30 16:01:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:01:44.546658 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d11e8b-1eb8-4ac3-ad33-06f79739d487 service nova] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:44.558376 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d11e8b-1eb8-4ac3-ad33-06f79739d487 service nova] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:44.565635 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c89360-c1fb-4a88-bf14-3b5ca2adee87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:44.566162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c89360-c1fb-4a88-bf14-3b5ca2adee87 service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:44.566626 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c89360-c1fb-4a88-bf14-3b5ca2adee87 service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:44.566908 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c89360-c1fb-4a88-bf14-3b5ca2adee87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:44.577953 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c89360-c1fb-4a88-bf14-3b5ca2adee87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:44.582205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c89360-c1fb-4a88-bf14-3b5ca2adee87 service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:44.609048 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1252/2469] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:01:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:01:47.381630 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de17f19-525d-4fc7-a654-74987a7c6063 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:47.382470 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de17f19-525d-4fc7-a654-74987a7c6063 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:47.382746 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de17f19-525d-4fc7-a654-74987a7c6063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:47.402994 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-3de17f19-525d-4fc7-a654-74987a7c6063 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:01:47.404503 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-3de17f19-525d-4fc7-a654-74987a7c6063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:47.412608 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1218/2470] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Aug 30 16:01:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:01:47.443777 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c89360-c1fb-4a88-bf14-3b5ca2adee87 service nova] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:47.455962 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c89360-c1fb-4a88-bf14-3b5ca2adee87 service nova] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:47.462594 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f94a9f-b50b-43e5-ad36-8654cef27a2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:47.463503 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f94a9f-b50b-43e5-ad36-8654cef27a2e service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:47.463987 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f94a9f-b50b-43e5-ad36-8654cef27a2e service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:47.464332 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f94a9f-b50b-43e5-ad36-8654cef27a2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:47.473563 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f94a9f-b50b-43e5-ad36-8654cef27a2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:47.475170 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f94a9f-b50b-43e5-ad36-8654cef27a2e service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:47.503896 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1253/2471] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:01:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:01:50.519364 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd798c-d0e9-4d8a-bac3-820bac54d2b1 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:50.519864 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd798c-d0e9-4d8a-bac3-820bac54d2b1 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:50.519979 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd798c-d0e9-4d8a-bac3-820bac54d2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:50.541467 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-60fd798c-d0e9-4d8a-bac3-820bac54d2b1 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:01:50.542774 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-60fd798c-d0e9-4d8a-bac3-820bac54d2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:50.551083 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1219/2472] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Aug 30 16:01:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:01:50.576575 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f94a9f-b50b-43e5-ad36-8654cef27a2e service nova] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:50.579107 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-f4f94a9f-b50b-43e5-ad36-8654cef27a2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:50.596447 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f94a9f-b50b-43e5-ad36-8654cef27a2e service nova] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:50.603785 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f947398-85cf-4d05-99a4-69936a26ac3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:50.604925 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f947398-85cf-4d05-99a4-69936a26ac3e service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:50.605311 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f947398-85cf-4d05-99a4-69936a26ac3e service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:50.605792 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f947398-85cf-4d05-99a4-69936a26ac3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:50.615356 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f947398-85cf-4d05-99a4-69936a26ac3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:50.617204 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f947398-85cf-4d05-99a4-69936a26ac3e service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:50.628014 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1254/2473] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:01:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:01:53.751085 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0fe419-1fe3-41d2-9351-389c5ecbb6a6 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:53.751672 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0fe419-1fe3-41d2-9351-389c5ecbb6a6 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:53.751772 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0fe419-1fe3-41d2-9351-389c5ecbb6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:53.773108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-7f0fe419-1fe3-41d2-9351-389c5ecbb6a6 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:01:53.775398 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-7f0fe419-1fe3-41d2-9351-389c5ecbb6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:01:53.783947 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1220/2474] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Aug 30 16:01:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:01:53.816041 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f947398-85cf-4d05-99a4-69936a26ac3e service nova] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:01:53.828686 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f947398-85cf-4d05-99a4-69936a26ac3e service nova] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:01:53.839360 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194f624-41cd-41fd-8b76-e8d281cd69a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:01:53.840167 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194f624-41cd-41fd-8b76-e8d281cd69a8 service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:01:53.840747 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194f624-41cd-41fd-8b76-e8d281cd69a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:01:53.841127 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194f624-41cd-41fd-8b76-e8d281cd69a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:01:53.851040 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194f624-41cd-41fd-8b76-e8d281cd69a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:01:53.853151 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194f624-41cd-41fd-8b76-e8d281cd69a8 service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:01:53.865117 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1255/2475] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:01:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:02:03.766920 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=76 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:03.860013 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=39 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:11.371426 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0199c1-bdcb-45ec-94e2-22b93b3a11eb None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:11.371980 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0199c1-bdcb-45ec-94e2-22b93b3a11eb None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:11.371980 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0199c1-bdcb-45ec-94e2-22b93b3a11eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:11.391733 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-eb0199c1-bdcb-45ec-94e2-22b93b3a11eb None None] MFA Rules not processed for user `d7958b395d5e4f5da37927536b1856ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:02:11.393057 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-eb0199c1-bdcb-45ec-94e2-22b93b3a11eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:11.400070 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1221/2476] 10.222.0.25 () {58 vars in 967 bytes} [Tue Aug 30 16:02:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:02:11.413052 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194f624-41cd-41fd-8b76-e8d281cd69a8 service nova] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:11.424112 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194f624-41cd-41fd-8b76-e8d281cd69a8 service nova] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:11.429687 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db75098-48e1-4630-9874-86fc6bc54197 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94765f224c734beabe83b4dc0c5e511f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:11.430279 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db75098-48e1-4630-9874-86fc6bc54197 service swift] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:11.430556 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db75098-48e1-4630-9874-86fc6bc54197 service swift] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:11.430827 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db75098-48e1-4630-9874-86fc6bc54197 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:11.438690 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db75098-48e1-4630-9874-86fc6bc54197 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:11.440251 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db75098-48e1-4630-9874-86fc6bc54197 service swift] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:11.448825 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1256/2477] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Aug 30 16:02:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 16:02:11.803347 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03741b5-1ec5-41b1-b3e8-5c336916a4ef None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:11.803713 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03741b5-1ec5-41b1-b3e8-5c336916a4ef None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:11.804681 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03741b5-1ec5-41b1-b3e8-5c336916a4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:11.824925 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-c03741b5-1ec5-41b1-b3e8-5c336916a4ef None None] MFA Rules not processed for user `9ab9f971cab5489fab98b71656569e07`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:02:11.826505 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-c03741b5-1ec5-41b1-b3e8-5c336916a4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:11.882448 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1222/2478] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:02:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:02:13.425354 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db75098-48e1-4630-9874-86fc6bc54197 service swift] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:13.426853 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-4db75098-48e1-4630-9874-86fc6bc54197 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:13.441692 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db75098-48e1-4630-9874-86fc6bc54197 service swift] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:13.447158 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c312f8-0e78-4cb9-bff2-918394f7607c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:13.447789 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c312f8-0e78-4cb9-bff2-918394f7607c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:13.448097 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c312f8-0e78-4cb9-bff2-918394f7607c admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:13.448370 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c312f8-0e78-4cb9-bff2-918394f7607c admin admin] PATH_INFO: `/v3/users/45d624c90b2b448595cf0f5eebbb2307` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:13.449520 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c312f8-0e78-4cb9-bff2-918394f7607c admin admin] RBAC: Authorizing `identity:delete_user(user_id=45d624c90b2b448595cf0f5eebbb2307)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:13.451418 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c312f8-0e78-4cb9-bff2-918394f7607c admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:13.495928 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-80c312f8-0e78-4cb9-bff2-918394f7607c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45d624c90b2b448595cf0f5eebbb2307'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:02:13.496578 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-80c312f8-0e78-4cb9-bff2-918394f7607c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45d624c90b2b448595cf0f5eebbb2307'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:02:13.504364 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-80c312f8-0e78-4cb9-bff2-918394f7607c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45d624c90b2b448595cf0f5eebbb2307'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:02:13.517988 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-80c312f8-0e78-4cb9-bff2-918394f7607c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45d624c90b2b448595cf0f5eebbb2307'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:02:13.525747 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-80c312f8-0e78-4cb9-bff2-918394f7607c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45d624c90b2b448595cf0f5eebbb2307'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:02:13.532452 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1257/2479] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:02:13 2022] DELETE /identity/v3/users/45d624c90b2b448595cf0f5eebbb2307 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:02:13.739144 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03741b5-1ec5-41b1-b3e8-5c336916a4ef None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:13.751343 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03741b5-1ec5-41b1-b3e8-5c336916a4ef None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:13.845208 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6495688-502c-4fa3-89ef-9853227ef95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:13.845970 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6495688-502c-4fa3-89ef-9853227ef95e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:13.846537 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6495688-502c-4fa3-89ef-9853227ef95e admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:13.847061 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6495688-502c-4fa3-89ef-9853227ef95e admin admin] PATH_INFO: `/v3/projects/a2542aac3db74869b7f011ee6a15309a` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:13.848833 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6495688-502c-4fa3-89ef-9853227ef95e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2542aac3db74869b7f011ee6a15309a)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:13.851918 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6495688-502c-4fa3-89ef-9853227ef95e admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:13.923446 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-e6495688-502c-4fa3-89ef-9853227ef95e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2542aac3db74869b7f011ee6a15309a', 'request_id': 'req-e6495688-502c-4fa3-89ef-9853227ef95e'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:02:13.932543 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-e6495688-502c-4fa3-89ef-9853227ef95e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2542aac3db74869b7f011ee6a15309a', 'request_id': 'req-e6495688-502c-4fa3-89ef-9853227ef95e'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:02:13.944703 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-e6495688-502c-4fa3-89ef-9853227ef95e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2542aac3db74869b7f011ee6a15309a', 'request_id': 'req-e6495688-502c-4fa3-89ef-9853227ef95e'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:02:13.961203 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-e6495688-502c-4fa3-89ef-9853227ef95e admin admin] The token cache is being invalidate because project a2542aac3db74869b7f011ee6a15309a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:02:13.961495 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-e6495688-502c-4fa3-89ef-9853227ef95e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:02:13.962155 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-e6495688-502c-4fa3-89ef-9853227ef95e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:02:13.963835 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1223/2480] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:02:13 2022] DELETE /identity/v3/projects/a2542aac3db74869b7f011ee6a15309a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:02:13.969497 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff4d3f-b8f5-4950-8605-888c4111bd05 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:13.969788 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff4d3f-b8f5-4950-8605-888c4111bd05 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:13.972188 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff4d3f-b8f5-4950-8605-888c4111bd05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:14.001336 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-a7ff4d3f-b8f5-4950-8605-888c4111bd05 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:02:14.002660 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-a7ff4d3f-b8f5-4950-8605-888c4111bd05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:14.096969 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1258/2481] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:02:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:02:14.105512 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6183452-f61f-49ac-93de-2bf066ac6f3f None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:14.105799 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6183452-f61f-49ac-93de-2bf066ac6f3f None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:14.106099 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6183452-f61f-49ac-93de-2bf066ac6f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:14.125967 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-f6183452-f61f-49ac-93de-2bf066ac6f3f None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:02:14.127223 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-f6183452-f61f-49ac-93de-2bf066ac6f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:14.135761 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1224/2482] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:02:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:02:14.140101 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff4d3f-b8f5-4950-8605-888c4111bd05 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:14.150750 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff4d3f-b8f5-4950-8605-888c4111bd05 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:14.157557 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf5a65-6f2a-4ea5-800c-d1ecfa574b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:14.157557 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf5a65-6f2a-4ea5-800c-d1ecfa574b52 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:14.157820 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf5a65-6f2a-4ea5-800c-d1ecfa574b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:14.158142 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf5a65-6f2a-4ea5-800c-d1ecfa574b52 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:14.161818 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf5a65-6f2a-4ea5-800c-d1ecfa574b52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:02:14.162273 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf5a65-6f2a-4ea5-800c-d1ecfa574b52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:14.165114 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf5a65-6f2a-4ea5-800c-d1ecfa574b52 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:14.185469 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1259/2483] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 16:02:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:02:14.187061 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6183452-f61f-49ac-93de-2bf066ac6f3f None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:14.197634 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6183452-f61f-49ac-93de-2bf066ac6f3f None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:14.203319 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f21de6-cf10-4355-a9dc-7ce113f4cf21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:14.203975 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f21de6-cf10-4355-a9dc-7ce113f4cf21 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:14.204255 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f21de6-cf10-4355-a9dc-7ce113f4cf21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:14.204526 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f21de6-cf10-4355-a9dc-7ce113f4cf21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:14.205696 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f21de6-cf10-4355-a9dc-7ce113f4cf21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:14.220191 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f21de6-cf10-4355-a9dc-7ce113f4cf21 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:14.243693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:14.252768 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1225/2484] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:02:14 2022] POST /identity/v3/projects => generated 399 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:02:14.257836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf5a65-6f2a-4ea5-800c-d1ecfa574b52 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:14.267853 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf5a65-6f2a-4ea5-800c-d1ecfa574b52 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:14.313657 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:14.329736 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3dd423-9e10-47a0-b99c-85f0ae228948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:14.330358 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3dd423-9e10-47a0-b99c-85f0ae228948 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:14.330627 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3dd423-9e10-47a0-b99c-85f0ae228948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:14.330891 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3dd423-9e10-47a0-b99c-85f0ae228948 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:14.331634 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3dd423-9e10-47a0-b99c-85f0ae228948 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:14.333444 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3dd423-9e10-47a0-b99c-85f0ae228948 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:14.358780 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1260/2485] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:02:14 2022] POST /identity/v3/users => generated 300 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:02:14.359891 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f21de6-cf10-4355-a9dc-7ce113f4cf21 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:14.372949 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f21de6-cf10-4355-a9dc-7ce113f4cf21 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:14.378468 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5a645-2787-44ad-8a18-fc9e63c6c805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:14.379226 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5a645-2787-44ad-8a18-fc9e63c6c805 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:14.379659 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5a645-2787-44ad-8a18-fc9e63c6c805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:14.380107 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5a645-2787-44ad-8a18-fc9e63c6c805 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:14.381152 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c5a645-2787-44ad-8a18-fc9e63c6c805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:14.383487 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c5a645-2787-44ad-8a18-fc9e63c6c805 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:14.396770 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1226/2486] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:02:14.398266 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3dd423-9e10-47a0-b99c-85f0ae228948 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:14.408389 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3dd423-9e10-47a0-b99c-85f0ae228948 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:14.413175 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a75969-10a0-49c8-8a3d-abf22646a772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:14.413889 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a75969-10a0-49c8-8a3d-abf22646a772 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:14.414057 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a75969-10a0-49c8-8a3d-abf22646a772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:14.414328 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a75969-10a0-49c8-8a3d-abf22646a772 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:14.414974 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a75969-10a0-49c8-8a3d-abf22646a772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:14.416566 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a75969-10a0-49c8-8a3d-abf22646a772 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:14.432980 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1261/2487] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:02:14.434080 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5a645-2787-44ad-8a18-fc9e63c6c805 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:14.443970 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5a645-2787-44ad-8a18-fc9e63c6c805 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:14.449594 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb92307-4311-4523-a0b6-dae4c101e92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:14.450244 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb92307-4311-4523-a0b6-dae4c101e92a admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:14.450519 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb92307-4311-4523-a0b6-dae4c101e92a admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:14.450803 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb92307-4311-4523-a0b6-dae4c101e92a admin admin] PATH_INFO: `/v3/projects/e1753952741140e8a4605670b9493cf5/users/9786df9239724575934693f7acc36ec2/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:14.468000 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb92307-4311-4523-a0b6-dae4c101e92a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1753952741140e8a4605670b9493cf5, user_id=9786df9239724575934693f7acc36ec2, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:14.470784 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb92307-4311-4523-a0b6-dae4c101e92a admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:14.485481 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1227/2488] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:02:14 2022] PUT /identity/v3/projects/e1753952741140e8a4605670b9493cf5/users/9786df9239724575934693f7acc36ec2/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:02:14.497792 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff005b7-aced-4c3e-9e8a-36eb803cfec7 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:14.498085 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff005b7-aced-4c3e-9e8a-36eb803cfec7 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:14.498366 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff005b7-aced-4c3e-9e8a-36eb803cfec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:14.526600 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-aff005b7-aced-4c3e-9e8a-36eb803cfec7 None None] MFA Rules not processed for user `9786df9239724575934693f7acc36ec2`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:02:14.527863 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-aff005b7-aced-4c3e-9e8a-36eb803cfec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:14.595519 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1262/2489] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:02:14 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:02:14.608500 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb92307-4311-4523-a0b6-dae4c101e92a admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:14.610417 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-4eb92307-4311-4523-a0b6-dae4c101e92a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:14.678345 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb92307-4311-4523-a0b6-dae4c101e92a admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:14.683297 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f74483-25bd-4645-acaf-a7e0409900e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:14.683916 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f74483-25bd-4645-acaf-a7e0409900e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:14.684192 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f74483-25bd-4645-acaf-a7e0409900e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:14.684459 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f74483-25bd-4645-acaf-a7e0409900e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:14.694736 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f74483-25bd-4645-acaf-a7e0409900e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:14.697012 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f74483-25bd-4645-acaf-a7e0409900e1 service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:14.708574 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1228/2490] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:02:14 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:02:19.817365 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff005b7-aced-4c3e-9e8a-36eb803cfec7 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:19.879842 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff005b7-aced-4c3e-9e8a-36eb803cfec7 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:19.885199 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2baa94f-7415-416d-899e-14cb90857681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:19.885822 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2baa94f-7415-416d-899e-14cb90857681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:19.886099 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2baa94f-7415-416d-899e-14cb90857681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:19.886365 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2baa94f-7415-416d-899e-14cb90857681 admin admin] PATH_INFO: `/v3/users/9786df9239724575934693f7acc36ec2` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:19.887483 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2baa94f-7415-416d-899e-14cb90857681 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9786df9239724575934693f7acc36ec2)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:19.889429 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2baa94f-7415-416d-899e-14cb90857681 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:19.935948 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f2baa94f-7415-416d-899e-14cb90857681 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9786df9239724575934693f7acc36ec2'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:02:19.936594 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f2baa94f-7415-416d-899e-14cb90857681 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9786df9239724575934693f7acc36ec2'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:02:19.943712 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f2baa94f-7415-416d-899e-14cb90857681 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9786df9239724575934693f7acc36ec2'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:02:19.945819 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:19.958363 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f2baa94f-7415-416d-899e-14cb90857681 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9786df9239724575934693f7acc36ec2'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:02:19.965750 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f2baa94f-7415-416d-899e-14cb90857681 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9786df9239724575934693f7acc36ec2'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:02:19.971714 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1263/2491] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:02:19 2022] DELETE /identity/v3/users/9786df9239724575934693f7acc36ec2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:02:19.976942 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf38397-4179-4240-8bcb-504a5d164d68 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:19.977410 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf38397-4179-4240-8bcb-504a5d164d68 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:19.977502 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf38397-4179-4240-8bcb-504a5d164d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:19.997278 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-8bf38397-4179-4240-8bcb-504a5d164d68 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:02:19.998461 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-8bf38397-4179-4240-8bcb-504a5d164d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:20.060834 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1229/2492] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:02:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:02:20.070681 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2baa94f-7415-416d-899e-14cb90857681 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:20.072070 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-f2baa94f-7415-416d-899e-14cb90857681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:20.129104 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2baa94f-7415-416d-899e-14cb90857681 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:20.133316 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426c152-6fbb-4e22-a3bc-b0db2ea835fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:20.133911 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426c152-6fbb-4e22-a3bc-b0db2ea835fc service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:20.134189 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426c152-6fbb-4e22-a3bc-b0db2ea835fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:20.134460 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426c152-6fbb-4e22-a3bc-b0db2ea835fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:20.143239 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426c152-6fbb-4e22-a3bc-b0db2ea835fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:20.144647 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426c152-6fbb-4e22-a3bc-b0db2ea835fc service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:20.154697 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1264/2493] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:02:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:02:20.416608 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf38397-4179-4240-8bcb-504a5d164d68 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:20.418180 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-8bf38397-4179-4240-8bcb-504a5d164d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:20.431322 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf38397-4179-4240-8bcb-504a5d164d68 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:20.437491 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e13c207-25c3-4aa9-8d7b-9b5267ed6af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:20.438276 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13c207-25c3-4aa9-8d7b-9b5267ed6af4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:20.438627 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13c207-25c3-4aa9-8d7b-9b5267ed6af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:20.438973 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13c207-25c3-4aa9-8d7b-9b5267ed6af4 admin admin] PATH_INFO: `/v3/users/6c8d579d699a416a947cbb11b0e8983d` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:20.440293 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e13c207-25c3-4aa9-8d7b-9b5267ed6af4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c8d579d699a416a947cbb11b0e8983d)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:20.442375 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e13c207-25c3-4aa9-8d7b-9b5267ed6af4 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:20.469892 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426c152-6fbb-4e22-a3bc-b0db2ea835fc service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:20.471465 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-9426c152-6fbb-4e22-a3bc-b0db2ea835fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:20.498772 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426c152-6fbb-4e22-a3bc-b0db2ea835fc service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:20.506664 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d261c-27ba-45a0-98d9-78f10f2790e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:20.507197 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d261c-27ba-45a0-98d9-78f10f2790e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:20.507479 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d261c-27ba-45a0-98d9-78f10f2790e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:20.507750 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d261c-27ba-45a0-98d9-78f10f2790e1 admin admin] PATH_INFO: `/v3/projects/e1753952741140e8a4605670b9493cf5` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:20.509135 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764d261c-27ba-45a0-98d9-78f10f2790e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1753952741140e8a4605670b9493cf5)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:20.511057 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764d261c-27ba-45a0-98d9-78f10f2790e1 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:20.523743 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-3e13c207-25c3-4aa9-8d7b-9b5267ed6af4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c8d579d699a416a947cbb11b0e8983d'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:02:20.548458 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:20.550751 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-3e13c207-25c3-4aa9-8d7b-9b5267ed6af4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c8d579d699a416a947cbb11b0e8983d'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:02:20.551861 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-3e13c207-25c3-4aa9-8d7b-9b5267ed6af4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c8d579d699a416a947cbb11b0e8983d'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:02:20.552542 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-3e13c207-25c3-4aa9-8d7b-9b5267ed6af4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c8d579d699a416a947cbb11b0e8983d'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:02:20.568195 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-3e13c207-25c3-4aa9-8d7b-9b5267ed6af4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c8d579d699a416a947cbb11b0e8983d'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:02:20.582710 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1230/2494] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:02:20 2022] DELETE /identity/v3/users/6c8d579d699a416a947cbb11b0e8983d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:02:20.587140 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c67c5-a559-4151-afd5-1058a24892a1 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:20.587572 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c67c5-a559-4151-afd5-1058a24892a1 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:20.588028 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c67c5-a559-4151-afd5-1058a24892a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:20.589972 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-764d261c-27ba-45a0-98d9-78f10f2790e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1753952741140e8a4605670b9493cf5', 'request_id': 'req-764d261c-27ba-45a0-98d9-78f10f2790e1'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:02:20.598702 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-764d261c-27ba-45a0-98d9-78f10f2790e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1753952741140e8a4605670b9493cf5', 'request_id': 'req-764d261c-27ba-45a0-98d9-78f10f2790e1'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:02:20.609037 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-764d261c-27ba-45a0-98d9-78f10f2790e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1753952741140e8a4605670b9493cf5', 'request_id': 'req-764d261c-27ba-45a0-98d9-78f10f2790e1'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:02:20.631364 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-860c67c5-a559-4151-afd5-1058a24892a1 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:02:20.632371 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-764d261c-27ba-45a0-98d9-78f10f2790e1 admin admin] The token cache is being invalidate because project e1753952741140e8a4605670b9493cf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:02:20.632663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-764d261c-27ba-45a0-98d9-78f10f2790e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:02:20.633039 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-860c67c5-a559-4151-afd5-1058a24892a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:20.633479 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-764d261c-27ba-45a0-98d9-78f10f2790e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:02:20.636108 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1265/2495] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:02:20 2022] DELETE /identity/v3/projects/e1753952741140e8a4605670b9493cf5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:02:20.641382 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4758ad4-9277-4e2a-b3c2-b8d3581dc933 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:20.641382 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4758ad4-9277-4e2a-b3c2-b8d3581dc933 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:20.641769 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4758ad4-9277-4e2a-b3c2-b8d3581dc933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:20.665240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-e4758ad4-9277-4e2a-b3c2-b8d3581dc933 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:02:20.666589 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-e4758ad4-9277-4e2a-b3c2-b8d3581dc933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:20.727863 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1231/2496] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:02:20.738238 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c67c5-a559-4151-afd5-1058a24892a1 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:20.739650 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-860c67c5-a559-4151-afd5-1058a24892a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:20.744551 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:20.754120 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1266/2497] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:02:20.761771 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f75d0b-8082-45dd-bf38-4dd46f559a99 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:20.762051 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f75d0b-8082-45dd-bf38-4dd46f559a99 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:20.762325 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f75d0b-8082-45dd-bf38-4dd46f559a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:20.782312 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-32f75d0b-8082-45dd-bf38-4dd46f559a99 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:02:20.783984 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-32f75d0b-8082-45dd-bf38-4dd46f559a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:20.793093 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1267/2498] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:02:20.797548 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f75d0b-8082-45dd-bf38-4dd46f559a99 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:20.808725 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f75d0b-8082-45dd-bf38-4dd46f559a99 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:20.813976 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a565f-d4c6-467a-9eb2-c17e3635c7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:20.814590 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a565f-d4c6-467a-9eb2-c17e3635c7fd admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:20.814866 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a565f-d4c6-467a-9eb2-c17e3635c7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:20.815136 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a565f-d4c6-467a-9eb2-c17e3635c7fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:20.815792 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a565f-d4c6-467a-9eb2-c17e3635c7fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:02:20.816092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a565f-d4c6-467a-9eb2-c17e3635c7fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:20.817737 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a565f-d4c6-467a-9eb2-c17e3635c7fd admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:20.818323 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c67c5-a559-4151-afd5-1058a24892a1 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:20.822481 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0ccae-9764-4d54-91a2-db08186428af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:20.823206 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0ccae-9764-4d54-91a2-db08186428af service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:20.823646 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0ccae-9764-4d54-91a2-db08186428af service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:20.823927 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0ccae-9764-4d54-91a2-db08186428af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:20.831937 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1268/2499] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 16:02:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:02:20.834087 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0ccae-9764-4d54-91a2-db08186428af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:20.836171 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a565f-d4c6-467a-9eb2-c17e3635c7fd admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:20.836676 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0ccae-9764-4d54-91a2-db08186428af service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:20.846426 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a565f-d4c6-467a-9eb2-c17e3635c7fd admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:20.847270 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1232/2500] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:02:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:02:20.852247 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca4f02-1d1d-4ea8-a95e-6a0a4af94b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:20.852939 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca4f02-1d1d-4ea8-a95e-6a0a4af94b22 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:20.853053 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca4f02-1d1d-4ea8-a95e-6a0a4af94b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:20.853334 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca4f02-1d1d-4ea8-a95e-6a0a4af94b22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:20.853983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca4f02-1d1d-4ea8-a95e-6a0a4af94b22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:20.855878 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca4f02-1d1d-4ea8-a95e-6a0a4af94b22 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:20.885699 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1269/2501] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:02:20 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:02:20.890802 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0ccae-9764-4d54-91a2-db08186428af service neutron] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:20.902401 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0ccae-9764-4d54-91a2-db08186428af service neutron] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:20.969116 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e876cb-8b22-4173-ad0d-5e32b7187bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:20.969841 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e876cb-8b22-4173-ad0d-5e32b7187bf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:20.970127 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e876cb-8b22-4173-ad0d-5e32b7187bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:20.970396 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e876cb-8b22-4173-ad0d-5e32b7187bf4 admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:20.971063 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e876cb-8b22-4173-ad0d-5e32b7187bf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:20.973076 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e876cb-8b22-4173-ad0d-5e32b7187bf4 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:20.997086 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1233/2502] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:02:20 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:02:21.001261 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca4f02-1d1d-4ea8-a95e-6a0a4af94b22 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:21.013602 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca4f02-1d1d-4ea8-a95e-6a0a4af94b22 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:21.023933 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736cbcbf-6536-4f81-82ec-64d2fe1998d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:21.025684 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736cbcbf-6536-4f81-82ec-64d2fe1998d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:21.027302 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736cbcbf-6536-4f81-82ec-64d2fe1998d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:21.028018 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736cbcbf-6536-4f81-82ec-64d2fe1998d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:21.029055 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736cbcbf-6536-4f81-82ec-64d2fe1998d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:21.031510 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736cbcbf-6536-4f81-82ec-64d2fe1998d9 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:21.059810 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1270/2503] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:02:21.063994 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e876cb-8b22-4173-ad0d-5e32b7187bf4 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:21.075799 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e876cb-8b22-4173-ad0d-5e32b7187bf4 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:21.081536 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dff9d2-b7c8-4b63-82f0-38e85f326b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:21.082262 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dff9d2-b7c8-4b63-82f0-38e85f326b4d admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:21.082839 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dff9d2-b7c8-4b63-82f0-38e85f326b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:21.083342 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dff9d2-b7c8-4b63-82f0-38e85f326b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:21.084145 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dff9d2-b7c8-4b63-82f0-38e85f326b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:21.086522 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dff9d2-b7c8-4b63-82f0-38e85f326b4d admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:21.100713 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1234/2504] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:02:21.105258 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736cbcbf-6536-4f81-82ec-64d2fe1998d9 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:21.116444 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736cbcbf-6536-4f81-82ec-64d2fe1998d9 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:21.121524 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180eb2af-3cad-4afd-a7cd-7a3559d7f321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:21.122206 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180eb2af-3cad-4afd-a7cd-7a3559d7f321 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:21.122485 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180eb2af-3cad-4afd-a7cd-7a3559d7f321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:21.122759 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180eb2af-3cad-4afd-a7cd-7a3559d7f321 admin admin] PATH_INFO: `/v3/projects/f1592085bae240919c3441fd37778228/users/d249e88d0d3944f482b26914ca4ea65e/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:21.143788 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180eb2af-3cad-4afd-a7cd-7a3559d7f321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1592085bae240919c3441fd37778228, user_id=d249e88d0d3944f482b26914ca4ea65e, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:21.147357 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180eb2af-3cad-4afd-a7cd-7a3559d7f321 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:21.166203 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1271/2505] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:02:21 2022] PUT /identity/v3/projects/f1592085bae240919c3441fd37778228/users/d249e88d0d3944f482b26914ca4ea65e/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:02:21.172357 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cac227-ec5d-4a20-aa95-ebe31bdf4337 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:21.172568 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180eb2af-3cad-4afd-a7cd-7a3559d7f321 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:21.172822 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cac227-ec5d-4a20-aa95-ebe31bdf4337 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:21.173253 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cac227-ec5d-4a20-aa95-ebe31bdf4337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:21.175297 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-180eb2af-3cad-4afd-a7cd-7a3559d7f321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:21.183740 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:21.211978 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-24cac227-ec5d-4a20-aa95-ebe31bdf4337 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:02:21.213408 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-24cac227-ec5d-4a20-aa95-ebe31bdf4337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:21.271939 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180eb2af-3cad-4afd-a7cd-7a3559d7f321 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:21.279022 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ff73a-d24a-4c1d-b5a0-86467b19f703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:21.279778 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ff73a-d24a-4c1d-b5a0-86467b19f703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:21.280140 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ff73a-d24a-4c1d-b5a0-86467b19f703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:21.280333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ff73a-d24a-4c1d-b5a0-86467b19f703 admin admin] PATH_INFO: `/v3/projects/084f0b44eaa847fcaa5c3a7a956cd526` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:21.281611 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ff73a-d24a-4c1d-b5a0-86467b19f703 admin admin] RBAC: Authorizing `identity:delete_project(project_id=084f0b44eaa847fcaa5c3a7a956cd526)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:21.283538 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ff73a-d24a-4c1d-b5a0-86467b19f703 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:21.302371 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1235/2506] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:02:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:02:21.314448 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cac227-ec5d-4a20-aa95-ebe31bdf4337 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:21.351879 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-aa6ff73a-d24a-4c1d-b5a0-86467b19f703 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '084f0b44eaa847fcaa5c3a7a956cd526', 'request_id': 'req-aa6ff73a-d24a-4c1d-b5a0-86467b19f703'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:02:21.360923 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-aa6ff73a-d24a-4c1d-b5a0-86467b19f703 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '084f0b44eaa847fcaa5c3a7a956cd526', 'request_id': 'req-aa6ff73a-d24a-4c1d-b5a0-86467b19f703'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:02:21.368945 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-aa6ff73a-d24a-4c1d-b5a0-86467b19f703 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '084f0b44eaa847fcaa5c3a7a956cd526', 'request_id': 'req-aa6ff73a-d24a-4c1d-b5a0-86467b19f703'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:02:21.382675 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-aa6ff73a-d24a-4c1d-b5a0-86467b19f703 admin admin] The token cache is being invalidate because project 084f0b44eaa847fcaa5c3a7a956cd526 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:02:21.382967 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-aa6ff73a-d24a-4c1d-b5a0-86467b19f703 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:02:21.383670 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-aa6ff73a-d24a-4c1d-b5a0-86467b19f703 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:02:21.385527 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1272/2507] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:02:21 2022] DELETE /identity/v3/projects/084f0b44eaa847fcaa5c3a7a956cd526 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:02:21.394593 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cac227-ec5d-4a20-aa95-ebe31bdf4337 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:21.487591 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a56c3ba-39f4-421b-9d2a-56b39e3cf02b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:21.489661 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56c3ba-39f4-421b-9d2a-56b39e3cf02b service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:21.490014 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56c3ba-39f4-421b-9d2a-56b39e3cf02b service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:21.490373 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56c3ba-39f4-421b-9d2a-56b39e3cf02b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:21.493850 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-6a56c3ba-39f4-421b-9d2a-56b39e3cf02b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:21.597526 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a56c3ba-39f4-421b-9d2a-56b39e3cf02b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:21.599153 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a56c3ba-39f4-421b-9d2a-56b39e3cf02b service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:21.611642 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1236/2508] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:02:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:02:22.601997 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ff73a-d24a-4c1d-b5a0-86467b19f703 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:22.606465 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-aa6ff73a-d24a-4c1d-b5a0-86467b19f703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:22.630740 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ff73a-d24a-4c1d-b5a0-86467b19f703 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:22.637954 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc106cb-3909-417c-b8df-2580043f1f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:22.639233 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc106cb-3909-417c-b8df-2580043f1f85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:22.639651 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc106cb-3909-417c-b8df-2580043f1f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:22.640021 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc106cb-3909-417c-b8df-2580043f1f85 admin admin] PATH_INFO: `/v3/users/0247cda461f643a793c2a11a3e86c469` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:22.642131 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc106cb-3909-417c-b8df-2580043f1f85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0247cda461f643a793c2a11a3e86c469)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:22.644688 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc106cb-3909-417c-b8df-2580043f1f85 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:22.652129 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:22.714042 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-fdc106cb-3909-417c-b8df-2580043f1f85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0247cda461f643a793c2a11a3e86c469'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:02:22.714721 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-fdc106cb-3909-417c-b8df-2580043f1f85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0247cda461f643a793c2a11a3e86c469'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:02:22.744029 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-fdc106cb-3909-417c-b8df-2580043f1f85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0247cda461f643a793c2a11a3e86c469'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:02:22.759688 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-fdc106cb-3909-417c-b8df-2580043f1f85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0247cda461f643a793c2a11a3e86c469'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:02:22.793450 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-fdc106cb-3909-417c-b8df-2580043f1f85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0247cda461f643a793c2a11a3e86c469'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:02:22.801846 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1273/2509] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:02:22 2022] DELETE /identity/v3/users/0247cda461f643a793c2a11a3e86c469 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:02:22.806909 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d2356-9457-4413-99b8-2c6ae6710355 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:22.807395 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d2356-9457-4413-99b8-2c6ae6710355 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:22.807518 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d2356-9457-4413-99b8-2c6ae6710355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:22.829622 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-bf7d2356-9457-4413-99b8-2c6ae6710355 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:02:22.830972 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-bf7d2356-9457-4413-99b8-2c6ae6710355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:22.836138 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:22.903950 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1237/2510] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:02:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:02:22.914727 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc106cb-3909-417c-b8df-2580043f1f85 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:22.917008 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-fdc106cb-3909-417c-b8df-2580043f1f85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:22.998142 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc106cb-3909-417c-b8df-2580043f1f85 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:23.004974 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf8bb9-6f18-4911-9168-3941f8758bc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:23.005975 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf8bb9-6f18-4911-9168-3941f8758bc5 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:23.007106 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf8bb9-6f18-4911-9168-3941f8758bc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:23.007462 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf8bb9-6f18-4911-9168-3941f8758bc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:23.024800 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbf8bb9-6f18-4911-9168-3941f8758bc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:23.029064 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbf8bb9-6f18-4911-9168-3941f8758bc5 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:23.041546 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1274/2511] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:02:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:02:23.414346 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d2356-9457-4413-99b8-2c6ae6710355 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:23.416769 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-bf7d2356-9457-4413-99b8-2c6ae6710355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:23.441677 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d2356-9457-4413-99b8-2c6ae6710355 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:23.448747 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c227ccd-95a1-4505-b8a7-be80a5ba8698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:23.449591 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c227ccd-95a1-4505-b8a7-be80a5ba8698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:23.449967 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c227ccd-95a1-4505-b8a7-be80a5ba8698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:23.451069 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c227ccd-95a1-4505-b8a7-be80a5ba8698 admin admin] PATH_INFO: `/v3/projects/f2999d756846440b8611bdadf25be0e9` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:23.451895 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c227ccd-95a1-4505-b8a7-be80a5ba8698 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2999d756846440b8611bdadf25be0e9)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:23.457188 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c227ccd-95a1-4505-b8a7-be80a5ba8698 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:23.519943 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4c227ccd-95a1-4505-b8a7-be80a5ba8698 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2999d756846440b8611bdadf25be0e9', 'request_id': 'req-4c227ccd-95a1-4505-b8a7-be80a5ba8698'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:02:23.527520 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4c227ccd-95a1-4505-b8a7-be80a5ba8698 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2999d756846440b8611bdadf25be0e9', 'request_id': 'req-4c227ccd-95a1-4505-b8a7-be80a5ba8698'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:02:23.537038 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4c227ccd-95a1-4505-b8a7-be80a5ba8698 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2999d756846440b8611bdadf25be0e9', 'request_id': 'req-4c227ccd-95a1-4505-b8a7-be80a5ba8698'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:02:23.551878 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4c227ccd-95a1-4505-b8a7-be80a5ba8698 admin admin] The token cache is being invalidate because project f2999d756846440b8611bdadf25be0e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:02:23.552181 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4c227ccd-95a1-4505-b8a7-be80a5ba8698 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:02:23.552916 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4c227ccd-95a1-4505-b8a7-be80a5ba8698 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:02:23.555204 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1238/2512] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:02:23 2022] DELETE /identity/v3/projects/f2999d756846440b8611bdadf25be0e9 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:02:26.765814 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147952a-4f8f-496b-9226-484f8e72f54d None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:26.766325 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147952a-4f8f-496b-9226-484f8e72f54d None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:26.766325 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147952a-4f8f-496b-9226-484f8e72f54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:26.818425 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-8147952a-4f8f-496b-9226-484f8e72f54d None None] MFA Rules not processed for user `d249e88d0d3944f482b26914ca4ea65e`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:02:26.819925 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-8147952a-4f8f-496b-9226-484f8e72f54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:26.899660 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1275/2513] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:02:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:02:26.904281 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c227ccd-95a1-4505-b8a7-be80a5ba8698 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:26.905970 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-4c227ccd-95a1-4505-b8a7-be80a5ba8698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:26.981848 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c227ccd-95a1-4505-b8a7-be80a5ba8698 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:26.986978 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1691a933-d721-42a3-9748-bcda7a9846f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:26.987593 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691a933-d721-42a3-9748-bcda7a9846f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:26.987869 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691a933-d721-42a3-9748-bcda7a9846f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:26.988132 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691a933-d721-42a3-9748-bcda7a9846f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:26.988775 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1691a933-d721-42a3-9748-bcda7a9846f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:26.991273 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1691a933-d721-42a3-9748-bcda7a9846f3 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:27.020916 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1239/2514] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:02:26 2022] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:02:27.025581 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8147952a-4f8f-496b-9226-484f8e72f54d None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:27.036202 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8147952a-4f8f-496b-9226-484f8e72f54d None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:27.049210 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:27.096765 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624406e9-0f06-459c-bf4d-d59908cd2867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:27.097403 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624406e9-0f06-459c-bf4d-d59908cd2867 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:27.097686 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624406e9-0f06-459c-bf4d-d59908cd2867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:27.097964 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624406e9-0f06-459c-bf4d-d59908cd2867 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:27.098592 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624406e9-0f06-459c-bf4d-d59908cd2867 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:27.100668 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624406e9-0f06-459c-bf4d-d59908cd2867 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:27.124607 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1276/2515] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:02:27 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:02:27.128509 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1691a933-d721-42a3-9748-bcda7a9846f3 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:27.140527 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1691a933-d721-42a3-9748-bcda7a9846f3 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:27.145839 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757d75b-41f1-47c5-99aa-a47a0f564e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:27.146458 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757d75b-41f1-47c5-99aa-a47a0f564e29 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:27.146721 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757d75b-41f1-47c5-99aa-a47a0f564e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:27.147053 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757d75b-41f1-47c5-99aa-a47a0f564e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:27.148015 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4757d75b-41f1-47c5-99aa-a47a0f564e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:27.149655 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4757d75b-41f1-47c5-99aa-a47a0f564e29 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:27.161956 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1240/2516] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:02:27.165951 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624406e9-0f06-459c-bf4d-d59908cd2867 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:27.179340 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624406e9-0f06-459c-bf4d-d59908cd2867 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:27.185129 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea125c0d-1b65-4143-b0f7-7d0a9ea56cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:27.186022 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea125c0d-1b65-4143-b0f7-7d0a9ea56cf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:27.186512 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea125c0d-1b65-4143-b0f7-7d0a9ea56cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:27.186862 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea125c0d-1b65-4143-b0f7-7d0a9ea56cf9 admin admin] PATH_INFO: `/v3/projects/839f5f57317141c0b36239d90759d67c/users/3b2cc89ac50b43e9af2e0e010e9fb688/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:27.205782 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea125c0d-1b65-4143-b0f7-7d0a9ea56cf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=839f5f57317141c0b36239d90759d67c, user_id=3b2cc89ac50b43e9af2e0e010e9fb688, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:27.208595 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea125c0d-1b65-4143-b0f7-7d0a9ea56cf9 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:27.221832 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1277/2517] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:02:27 2022] PUT /identity/v3/projects/839f5f57317141c0b36239d90759d67c/users/3b2cc89ac50b43e9af2e0e010e9fb688/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:02:27.226498 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757d75b-41f1-47c5-99aa-a47a0f564e29 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:27.236869 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757d75b-41f1-47c5-99aa-a47a0f564e29 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:27.240445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:27.304431 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965e940-d5d2-47a7-9a25-fdb195beb038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:27.305067 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965e940-d5d2-47a7-9a25-fdb195beb038 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:27.305339 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965e940-d5d2-47a7-9a25-fdb195beb038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:27.305622 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965e940-d5d2-47a7-9a25-fdb195beb038 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:27.306257 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5965e940-d5d2-47a7-9a25-fdb195beb038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:27.307855 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5965e940-d5d2-47a7-9a25-fdb195beb038 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:27.320861 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1241/2518] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:02:27.323451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea125c0d-1b65-4143-b0f7-7d0a9ea56cf9 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:27.334940 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea125c0d-1b65-4143-b0f7-7d0a9ea56cf9 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:27.342161 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f8613-c623-4086-bb29-eea12d86c2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:27.342830 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f8613-c623-4086-bb29-eea12d86c2ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:27.343106 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f8613-c623-4086-bb29-eea12d86c2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:27.343400 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f8613-c623-4086-bb29-eea12d86c2ce admin admin] PATH_INFO: `/v3/projects/839f5f57317141c0b36239d90759d67c/users/3b2cc89ac50b43e9af2e0e010e9fb688/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:27.345371 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f8613-c623-4086-bb29-eea12d86c2ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=839f5f57317141c0b36239d90759d67c, user_id=3b2cc89ac50b43e9af2e0e010e9fb688, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:27.348041 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f8613-c623-4086-bb29-eea12d86c2ce admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:27.361319 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1278/2519] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:02:27 2022] PUT /identity/v3/projects/839f5f57317141c0b36239d90759d67c/users/3b2cc89ac50b43e9af2e0e010e9fb688/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:02:27.751379 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91993de3-7022-4456-adb2-137fb4577250 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:27.751668 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91993de3-7022-4456-adb2-137fb4577250 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:27.752431 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91993de3-7022-4456-adb2-137fb4577250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:27.775585 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-91993de3-7022-4456-adb2-137fb4577250 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:02:27.776833 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-91993de3-7022-4456-adb2-137fb4577250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:27.869037 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1242/2520] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Aug 30 16:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:02:27.894943 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f8613-c623-4086-bb29-eea12d86c2ce admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:27.897761 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-305f8613-c623-4086-bb29-eea12d86c2ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:27.992392 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f8613-c623-4086-bb29-eea12d86c2ce admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:27.998782 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19553032-7e9b-4993-8629-6d4e17d33aae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:27.999476 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19553032-7e9b-4993-8629-6d4e17d33aae service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:27.999820 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19553032-7e9b-4993-8629-6d4e17d33aae service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:28.000174 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19553032-7e9b-4993-8629-6d4e17d33aae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:28.011321 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19553032-7e9b-4993-8629-6d4e17d33aae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:28.013030 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19553032-7e9b-4993-8629-6d4e17d33aae service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:28.027970 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1279/2521] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:02:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:02:31.026688 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50880c-cd18-4069-8030-684a7e73c52a None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:31.027666 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50880c-cd18-4069-8030-684a7e73c52a None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:31.028165 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50880c-cd18-4069-8030-684a7e73c52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:31.057928 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-4a50880c-cd18-4069-8030-684a7e73c52a None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:02:31.057928 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-4a50880c-cd18-4069-8030-684a7e73c52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:31.068016 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1243/2522] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Aug 30 16:02:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:02:31.088582 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19553032-7e9b-4993-8629-6d4e17d33aae service nova] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:31.090738 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-19553032-7e9b-4993-8629-6d4e17d33aae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:31.117028 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19553032-7e9b-4993-8629-6d4e17d33aae service nova] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:31.123557 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f20d0-da49-47b7-b5c5-0921a87d8ec6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:31.124221 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f20d0-da49-47b7-b5c5-0921a87d8ec6 service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:31.124610 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f20d0-da49-47b7-b5c5-0921a87d8ec6 service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:31.124957 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f20d0-da49-47b7-b5c5-0921a87d8ec6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:31.136218 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f20d0-da49-47b7-b5c5-0921a87d8ec6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:31.138562 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f20d0-da49-47b7-b5c5-0921a87d8ec6 service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:31.157995 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1280/2523] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:02:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:02:32.066303 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208b92e-bc53-4163-85d7-970853895e0f None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:32.066916 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208b92e-bc53-4163-85d7-970853895e0f None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:32.073244 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208b92e-bc53-4163-85d7-970853895e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:32.107092 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-4208b92e-bc53-4163-85d7-970853895e0f None None] MFA Rules not processed for user `3b2cc89ac50b43e9af2e0e010e9fb688`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:02:32.108655 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-4208b92e-bc53-4163-85d7-970853895e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:32.196566 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1244/2524] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:02:32 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:02:32.213887 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f20d0-da49-47b7-b5c5-0921a87d8ec6 service nova] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:32.228474 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f20d0-da49-47b7-b5c5-0921a87d8ec6 service nova] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:32.234633 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160785b5-00df-4f37-9502-a5c5cd792882 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:32.235248 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160785b5-00df-4f37-9502-a5c5cd792882 service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:32.235533 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160785b5-00df-4f37-9502-a5c5cd792882 service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:32.235804 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160785b5-00df-4f37-9502-a5c5cd792882 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:32.297446 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:32.326293 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160785b5-00df-4f37-9502-a5c5cd792882 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:32.328056 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160785b5-00df-4f37-9502-a5c5cd792882 service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:32.338173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1281/2525] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:02:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:02:33.544239 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5b249-df61-47d7-bb80-9daf949485c9 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:33.544734 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5b249-df61-47d7-bb80-9daf949485c9 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:33.544877 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5b249-df61-47d7-bb80-9daf949485c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:33.565484 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-20f5b249-df61-47d7-bb80-9daf949485c9 None None] MFA Rules not processed for user `d249e88d0d3944f482b26914ca4ea65e`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:02:33.566699 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-20f5b249-df61-47d7-bb80-9daf949485c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:33.577628 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1245/2526] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:02:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:02:34.260615 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24949ebc-4c3d-4389-be2b-63be163bddf2 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:34.261131 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24949ebc-4c3d-4389-be2b-63be163bddf2 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:34.261621 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24949ebc-4c3d-4389-be2b-63be163bddf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:34.286746 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-24949ebc-4c3d-4389-be2b-63be163bddf2 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:02:34.288093 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-24949ebc-4c3d-4389-be2b-63be163bddf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:34.297624 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1282/2527] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Aug 30 16:02:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:02:34.323942 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5b249-df61-47d7-bb80-9daf949485c9 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:34.338766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5b249-df61-47d7-bb80-9daf949485c9 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:34.344274 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c571015-a72d-4da5-a687-85308ae94847 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:34.344915 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c571015-a72d-4da5-a687-85308ae94847 service nova] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:34.345200 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c571015-a72d-4da5-a687-85308ae94847 service nova] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:34.345474 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c571015-a72d-4da5-a687-85308ae94847 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:34.353908 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c571015-a72d-4da5-a687-85308ae94847 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:34.355528 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c571015-a72d-4da5-a687-85308ae94847 service nova] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:34.366205 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1246/2528] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:02:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:02:37.334155 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ae3ba-cc2a-4135-a474-daabcb29eaf9 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:37.335248 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ae3ba-cc2a-4135-a474-daabcb29eaf9 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:37.335364 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ae3ba-cc2a-4135-a474-daabcb29eaf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:37.361385 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-9d6ae3ba-cc2a-4135-a474-daabcb29eaf9 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:02:37.362982 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-9d6ae3ba-cc2a-4135-a474-daabcb29eaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:37.371189 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1283/2529] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Aug 30 16:02:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:02:37.393549 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c571015-a72d-4da5-a687-85308ae94847 service nova] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:37.400192 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:37.406739 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c571015-a72d-4da5-a687-85308ae94847 service nova] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:37.412441 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f704dd9-b4c5-4a9c-9746-a5d46457e722 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:37.413751 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f704dd9-b4c5-4a9c-9746-a5d46457e722 service nova] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:37.414026 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f704dd9-b4c5-4a9c-9746-a5d46457e722 service nova] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:37.414291 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f704dd9-b4c5-4a9c-9746-a5d46457e722 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:37.423201 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f704dd9-b4c5-4a9c-9746-a5d46457e722 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:37.424831 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f704dd9-b4c5-4a9c-9746-a5d46457e722 service nova] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:37.436165 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1247/2530] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:02:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:02:41.527401 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c7d1e-a734-4ae9-bf31-caae792a931b None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:41.527963 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c7d1e-a734-4ae9-bf31-caae792a931b None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:41.527963 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c7d1e-a734-4ae9-bf31-caae792a931b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:41.548336 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-706c7d1e-a734-4ae9-bf31-caae792a931b None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:02:41.549632 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-706c7d1e-a734-4ae9-bf31-caae792a931b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:41.558048 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1284/2531] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Aug 30 16:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:02:41.582766 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f704dd9-b4c5-4a9c-9746-a5d46457e722 service nova] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:41.594794 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f704dd9-b4c5-4a9c-9746-a5d46457e722 service nova] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:41.600361 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89c26b-8c64-45a7-8734-08909592c343 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:41.600989 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89c26b-8c64-45a7-8734-08909592c343 service nova] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:41.601270 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89c26b-8c64-45a7-8734-08909592c343 service nova] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:41.601542 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89c26b-8c64-45a7-8734-08909592c343 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:41.609545 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca89c26b-8c64-45a7-8734-08909592c343 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:41.611132 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca89c26b-8c64-45a7-8734-08909592c343 service nova] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:41.620633 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1248/2532] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:02:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:02:50.912079 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c7d1e-a734-4ae9-bf31-caae792a931b None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:50.913481 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-706c7d1e-a734-4ae9-bf31-caae792a931b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:50.983680 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c7d1e-a734-4ae9-bf31-caae792a931b None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:50.988638 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f88e04-1e16-4e86-b6f5-d9a633d8e9cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bba851e1a0d4601b5d4841662f645dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:50.989286 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f88e04-1e16-4e86-b6f5-d9a633d8e9cd service placement] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:50.989560 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f88e04-1e16-4e86-b6f5-d9a633d8e9cd service placement] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:50.989827 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f88e04-1e16-4e86-b6f5-d9a633d8e9cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:50.991588 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-07f88e04-1e16-4e86-b6f5-d9a633d8e9cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:51.003050 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f88e04-1e16-4e86-b6f5-d9a633d8e9cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:51.005178 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f88e04-1e16-4e86-b6f5-d9a633d8e9cd service placement] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:51.015991 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1285/2533] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:02:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:02:51.616195 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=11 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:01.010961 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=50 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:01.429594 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89c26b-8c64-45a7-8734-08909592c343 service nova] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:01.431033 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-ca89c26b-8c64-45a7-8734-08909592c343 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:01.491630 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89c26b-8c64-45a7-8734-08909592c343 service nova] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:01.495248 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae96c7-9642-4d18-8e26-2f8c24781104 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:01.495862 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae96c7-9642-4d18-8e26-2f8c24781104 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:01.496144 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae96c7-9642-4d18-8e26-2f8c24781104 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:01.496417 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae96c7-9642-4d18-8e26-2f8c24781104 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:01.505774 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae96c7-9642-4d18-8e26-2f8c24781104 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:01.507203 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae96c7-9642-4d18-8e26-2f8c24781104 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:01.517199 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1249/2534] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:03:01 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:03:11.175523 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f88e04-1e16-4e86-b6f5-d9a633d8e9cd service placement] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:11.177607 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-07f88e04-1e16-4e86-b6f5-d9a633d8e9cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:11.193105 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f88e04-1e16-4e86-b6f5-d9a633d8e9cd service placement] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:11.197509 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57820dc6-14a1-4949-a680-8196d9f6afd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:11.198130 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57820dc6-14a1-4949-a680-8196d9f6afd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:11.198406 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57820dc6-14a1-4949-a680-8196d9f6afd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:11.198673 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57820dc6-14a1-4949-a680-8196d9f6afd7 admin admin] PATH_INFO: `/v3/users/9ab9f971cab5489fab98b71656569e07` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:11.199762 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57820dc6-14a1-4949-a680-8196d9f6afd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ab9f971cab5489fab98b71656569e07)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:11.202419 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57820dc6-14a1-4949-a680-8196d9f6afd7 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:11.248170 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-57820dc6-14a1-4949-a680-8196d9f6afd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ab9f971cab5489fab98b71656569e07'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:03:11.248935 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-57820dc6-14a1-4949-a680-8196d9f6afd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ab9f971cab5489fab98b71656569e07'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:03:11.256236 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-57820dc6-14a1-4949-a680-8196d9f6afd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ab9f971cab5489fab98b71656569e07'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:03:11.268381 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-57820dc6-14a1-4949-a680-8196d9f6afd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ab9f971cab5489fab98b71656569e07'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:03:11.275200 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-57820dc6-14a1-4949-a680-8196d9f6afd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ab9f971cab5489fab98b71656569e07'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:03:11.281409 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1286/2535] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:03:11 2022] DELETE /identity/v3/users/9ab9f971cab5489fab98b71656569e07 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:03:11.451269 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae96c7-9642-4d18-8e26-2f8c24781104 service neutron] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:11.462318 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae96c7-9642-4d18-8e26-2f8c24781104 service neutron] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:11.521730 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1e380-5cec-48c0-8fc3-42982d95b426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:11.522441 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1e380-5cec-48c0-8fc3-42982d95b426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:11.522793 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1e380-5cec-48c0-8fc3-42982d95b426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:11.523068 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1e380-5cec-48c0-8fc3-42982d95b426 admin admin] PATH_INFO: `/v3/projects/ff02e1b08333461d98ec516b3621e986` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:11.524192 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa1e380-5cec-48c0-8fc3-42982d95b426 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff02e1b08333461d98ec516b3621e986)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:11.526140 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa1e380-5cec-48c0-8fc3-42982d95b426 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:11.574671 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-cfa1e380-5cec-48c0-8fc3-42982d95b426 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff02e1b08333461d98ec516b3621e986', 'request_id': 'req-cfa1e380-5cec-48c0-8fc3-42982d95b426'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:03:11.580287 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-cfa1e380-5cec-48c0-8fc3-42982d95b426 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff02e1b08333461d98ec516b3621e986', 'request_id': 'req-cfa1e380-5cec-48c0-8fc3-42982d95b426'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:03:11.587967 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-cfa1e380-5cec-48c0-8fc3-42982d95b426 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff02e1b08333461d98ec516b3621e986', 'request_id': 'req-cfa1e380-5cec-48c0-8fc3-42982d95b426'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:03:11.599445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-cfa1e380-5cec-48c0-8fc3-42982d95b426 admin admin] The token cache is being invalidate because project ff02e1b08333461d98ec516b3621e986 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:03:11.599741 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-cfa1e380-5cec-48c0-8fc3-42982d95b426 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:03:11.600386 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-cfa1e380-5cec-48c0-8fc3-42982d95b426 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:03:11.602181 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1250/2536] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:03:11 2022] DELETE /identity/v3/projects/ff02e1b08333461d98ec516b3621e986 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:03:11.607221 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a772593-b09a-4fa5-8d84-bcd27870d7f2 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:11.607722 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a772593-b09a-4fa5-8d84-bcd27870d7f2 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:11.608380 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a772593-b09a-4fa5-8d84-bcd27870d7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:11.630853 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-3a772593-b09a-4fa5-8d84-bcd27870d7f2 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:11.632064 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-3a772593-b09a-4fa5-8d84-bcd27870d7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:11.698785 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1287/2537] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:03:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:03:11.707113 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986e4db-6c32-46ff-8d19-4e75e03ac433 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:11.707400 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986e4db-6c32-46ff-8d19-4e75e03ac433 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:11.707694 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986e4db-6c32-46ff-8d19-4e75e03ac433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:11.728757 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-c986e4db-6c32-46ff-8d19-4e75e03ac433 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:11.729994 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-c986e4db-6c32-46ff-8d19-4e75e03ac433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:11.738672 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1251/2538] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:03:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:03:11.742974 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a772593-b09a-4fa5-8d84-bcd27870d7f2 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:11.752833 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a772593-b09a-4fa5-8d84-bcd27870d7f2 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:11.757617 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42297cc-db44-4f3d-8f3a-1f8e3bd1fe0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:11.758239 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42297cc-db44-4f3d-8f3a-1f8e3bd1fe0e admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:11.758515 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42297cc-db44-4f3d-8f3a-1f8e3bd1fe0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:11.758781 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42297cc-db44-4f3d-8f3a-1f8e3bd1fe0e admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:11.759422 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42297cc-db44-4f3d-8f3a-1f8e3bd1fe0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:11.759719 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42297cc-db44-4f3d-8f3a-1f8e3bd1fe0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:11.761339 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42297cc-db44-4f3d-8f3a-1f8e3bd1fe0e admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:11.772540 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1288/2539] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 16:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:11.776955 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986e4db-6c32-46ff-8d19-4e75e03ac433 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:11.786950 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986e4db-6c32-46ff-8d19-4e75e03ac433 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:11.791576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce948ce7-094a-4ce9-9d5b-6c9df89d4eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:11.792163 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce948ce7-094a-4ce9-9d5b-6c9df89d4eb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:11.792439 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce948ce7-094a-4ce9-9d5b-6c9df89d4eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:11.792726 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce948ce7-094a-4ce9-9d5b-6c9df89d4eb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:11.793416 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce948ce7-094a-4ce9-9d5b-6c9df89d4eb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:11.796108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce948ce7-094a-4ce9-9d5b-6c9df89d4eb7 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:11.822988 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1252/2540] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:03:11 2022] POST /identity/v3/projects => generated 391 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:03:11.827183 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42297cc-db44-4f3d-8f3a-1f8e3bd1fe0e admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:11.837130 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42297cc-db44-4f3d-8f3a-1f8e3bd1fe0e admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:11.892710 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04afd5fb-590d-499b-996f-6b20103473fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:11.893342 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afd5fb-590d-499b-996f-6b20103473fe admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:11.893618 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afd5fb-590d-499b-996f-6b20103473fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:11.893945 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afd5fb-590d-499b-996f-6b20103473fe admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:11.894568 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04afd5fb-590d-499b-996f-6b20103473fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:11.896481 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04afd5fb-590d-499b-996f-6b20103473fe admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:11.904770 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:11.924280 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1289/2541] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:03:11 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:03:11.928556 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce948ce7-094a-4ce9-9d5b-6c9df89d4eb7 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:11.935209 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:11.939941 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce948ce7-094a-4ce9-9d5b-6c9df89d4eb7 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:11.946174 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520a438-9f0f-450a-ba6c-0bc783f6e921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:11.946775 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520a438-9f0f-450a-ba6c-0bc783f6e921 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:11.947047 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520a438-9f0f-450a-ba6c-0bc783f6e921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:11.947313 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520a438-9f0f-450a-ba6c-0bc783f6e921 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:11.947949 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520a438-9f0f-450a-ba6c-0bc783f6e921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:11.949626 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520a438-9f0f-450a-ba6c-0bc783f6e921 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:11.959952 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1253/2542] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:03:11.963868 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04afd5fb-590d-499b-996f-6b20103473fe admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:11.974399 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04afd5fb-590d-499b-996f-6b20103473fe admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:11.978974 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4b401-c5b3-4078-930c-82bbfe14ab64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:11.979583 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4b401-c5b3-4078-930c-82bbfe14ab64 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:11.979838 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4b401-c5b3-4078-930c-82bbfe14ab64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:11.980105 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4b401-c5b3-4078-930c-82bbfe14ab64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:11.980745 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4b401-c5b3-4078-930c-82bbfe14ab64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:11.982917 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4b401-c5b3-4078-930c-82bbfe14ab64 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:11.993150 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1290/2543] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:03:11.997469 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520a438-9f0f-450a-ba6c-0bc783f6e921 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:12.007600 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520a438-9f0f-450a-ba6c-0bc783f6e921 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:12.012253 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124648e-4f48-4005-af6b-b1b67552a35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:12.013438 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124648e-4f48-4005-af6b-b1b67552a35f admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:12.013723 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124648e-4f48-4005-af6b-b1b67552a35f admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:12.013996 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124648e-4f48-4005-af6b-b1b67552a35f admin admin] PATH_INFO: `/v3/projects/f53a142ba3a74f00aaf3b0b9b45d096d/users/384d5b74192c49bc8d10ef6d006077bb/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:12.028383 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6124648e-4f48-4005-af6b-b1b67552a35f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f53a142ba3a74f00aaf3b0b9b45d096d, user_id=384d5b74192c49bc8d10ef6d006077bb, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:12.031750 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6124648e-4f48-4005-af6b-b1b67552a35f admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:12.044931 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1254/2544] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:03:11 2022] PUT /identity/v3/projects/f53a142ba3a74f00aaf3b0b9b45d096d/users/384d5b74192c49bc8d10ef6d006077bb/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:03:12.058636 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadccc97-14a2-487e-acce-6bc127459192 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:12.058908 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadccc97-14a2-487e-acce-6bc127459192 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:12.059185 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadccc97-14a2-487e-acce-6bc127459192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:12.088870 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-cadccc97-14a2-487e-acce-6bc127459192 None None] MFA Rules not processed for user `384d5b74192c49bc8d10ef6d006077bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:12.090087 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-cadccc97-14a2-487e-acce-6bc127459192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:12.153609 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1291/2545] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:03:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:03:12.165430 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124648e-4f48-4005-af6b-b1b67552a35f admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:12.167182 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-6124648e-4f48-4005-af6b-b1b67552a35f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:12.232159 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124648e-4f48-4005-af6b-b1b67552a35f admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:12.235834 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b8cb2-fd45-406c-a874-78dc155e4e95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:12.236447 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b8cb2-fd45-406c-a874-78dc155e4e95 service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:12.236721 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b8cb2-fd45-406c-a874-78dc155e4e95 service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:12.237019 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b8cb2-fd45-406c-a874-78dc155e4e95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:12.245920 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804b8cb2-fd45-406c-a874-78dc155e4e95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:12.247375 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804b8cb2-fd45-406c-a874-78dc155e4e95 service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:12.256916 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1255/2546] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:03:12 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:03:22.150749 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:INSERT=3,keystone:SELECT=39 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:22.257285 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=39,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:22.263864 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a5323-69aa-4e25-ba11-ea7b61a5de94 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:22.264411 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a5323-69aa-4e25-ba11-ea7b61a5de94 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:22.264753 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a5323-69aa-4e25-ba11-ea7b61a5de94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:22.285821 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-506a5323-69aa-4e25-ba11-ea7b61a5de94 None None] MFA Rules not processed for user `041323d39916493aa4318309904f4ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:22.287035 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-506a5323-69aa-4e25-ba11-ea7b61a5de94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:22.294842 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b8cb2-fd45-406c-a874-78dc155e4e95 service cinder] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:22.354078 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1292/2547] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:03:22 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:03:22.370241 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b8cb2-fd45-406c-a874-78dc155e4e95 service cinder] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:22.374976 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395b117-bdbe-461a-92da-cbbde86d162a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:22.375606 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395b117-bdbe-461a-92da-cbbde86d162a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:22.375891 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395b117-bdbe-461a-92da-cbbde86d162a admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:22.376184 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395b117-bdbe-461a-92da-cbbde86d162a admin admin] PATH_INFO: `/v3/users/384d5b74192c49bc8d10ef6d006077bb` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:22.377349 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7395b117-bdbe-461a-92da-cbbde86d162a admin admin] RBAC: Authorizing `identity:delete_user(user_id=384d5b74192c49bc8d10ef6d006077bb)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:22.379541 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7395b117-bdbe-461a-92da-cbbde86d162a admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:22.429925 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-7395b117-bdbe-461a-92da-cbbde86d162a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '384d5b74192c49bc8d10ef6d006077bb'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:03:22.442246 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-7395b117-bdbe-461a-92da-cbbde86d162a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '384d5b74192c49bc8d10ef6d006077bb'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:03:22.442927 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-7395b117-bdbe-461a-92da-cbbde86d162a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '384d5b74192c49bc8d10ef6d006077bb'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:03:22.444946 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-7395b117-bdbe-461a-92da-cbbde86d162a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '384d5b74192c49bc8d10ef6d006077bb'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:03:22.453243 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-7395b117-bdbe-461a-92da-cbbde86d162a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '384d5b74192c49bc8d10ef6d006077bb'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:03:22.466368 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1256/2548] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:03:22 2022] DELETE /identity/v3/users/384d5b74192c49bc8d10ef6d006077bb => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:03:22.471356 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf18a2-b712-4c03-a210-20da18c2a6fc None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:22.471649 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf18a2-b712-4c03-a210-20da18c2a6fc None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:22.471927 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf18a2-b712-4c03-a210-20da18c2a6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:22.492825 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-66bf18a2-b712-4c03-a210-20da18c2a6fc None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:22.493915 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-66bf18a2-b712-4c03-a210-20da18c2a6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:22.561772 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1293/2549] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:03:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:03:22.568531 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395b117-bdbe-461a-92da-cbbde86d162a admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:22.570292 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-7395b117-bdbe-461a-92da-cbbde86d162a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:22.631777 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395b117-bdbe-461a-92da-cbbde86d162a admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:22.635362 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc32482-ac6c-4002-844a-65fbd92c7047 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:22.635972 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc32482-ac6c-4002-844a-65fbd92c7047 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:22.636248 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc32482-ac6c-4002-844a-65fbd92c7047 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:22.636512 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc32482-ac6c-4002-844a-65fbd92c7047 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:22.646592 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc32482-ac6c-4002-844a-65fbd92c7047 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:22.648028 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc32482-ac6c-4002-844a-65fbd92c7047 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:22.659015 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1257/2550] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:03:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:03:22.990435 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf18a2-b712-4c03-a210-20da18c2a6fc None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:22.992012 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-66bf18a2-b712-4c03-a210-20da18c2a6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:23.007958 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf18a2-b712-4c03-a210-20da18c2a6fc None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:23.013827 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4ef3e-58e1-415b-90b7-a6dec087c2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:23.014333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4ef3e-58e1-415b-90b7-a6dec087c2eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:23.014612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4ef3e-58e1-415b-90b7-a6dec087c2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:23.015128 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4ef3e-58e1-415b-90b7-a6dec087c2eb admin admin] PATH_INFO: `/v3/projects/f53a142ba3a74f00aaf3b0b9b45d096d` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:23.016533 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4ef3e-58e1-415b-90b7-a6dec087c2eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f53a142ba3a74f00aaf3b0b9b45d096d)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:23.027751 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4ef3e-58e1-415b-90b7-a6dec087c2eb admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:23.084953 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-97b4ef3e-58e1-415b-90b7-a6dec087c2eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f53a142ba3a74f00aaf3b0b9b45d096d', 'request_id': 'req-97b4ef3e-58e1-415b-90b7-a6dec087c2eb'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:03:23.093966 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-97b4ef3e-58e1-415b-90b7-a6dec087c2eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f53a142ba3a74f00aaf3b0b9b45d096d', 'request_id': 'req-97b4ef3e-58e1-415b-90b7-a6dec087c2eb'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:03:23.100768 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-97b4ef3e-58e1-415b-90b7-a6dec087c2eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f53a142ba3a74f00aaf3b0b9b45d096d', 'request_id': 'req-97b4ef3e-58e1-415b-90b7-a6dec087c2eb'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:03:23.112623 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-97b4ef3e-58e1-415b-90b7-a6dec087c2eb admin admin] The token cache is being invalidate because project f53a142ba3a74f00aaf3b0b9b45d096d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:03:23.112950 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-97b4ef3e-58e1-415b-90b7-a6dec087c2eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:03:23.113619 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-97b4ef3e-58e1-415b-90b7-a6dec087c2eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:03:23.115115 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1294/2551] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:03:22 2022] DELETE /identity/v3/projects/f53a142ba3a74f00aaf3b0b9b45d096d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:03:23.119989 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f10c6-6c77-45bb-bfb6-4fe36c6b8cba None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:23.120278 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f10c6-6c77-45bb-bfb6-4fe36c6b8cba None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:23.120561 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f10c6-6c77-45bb-bfb6-4fe36c6b8cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:23.142249 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-e25f10c6-6c77-45bb-bfb6-4fe36c6b8cba None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:23.143510 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-e25f10c6-6c77-45bb-bfb6-4fe36c6b8cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:23.161802 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:23.221789 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1258/2552] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:03:23.230369 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561836d-6764-402c-8a1c-f7a2fd926066 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:23.230957 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561836d-6764-402c-8a1c-f7a2fd926066 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:23.230957 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561836d-6764-402c-8a1c-f7a2fd926066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:23.253354 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-8561836d-6764-402c-8a1c-f7a2fd926066 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:23.254835 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-8561836d-6764-402c-8a1c-f7a2fd926066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:23.262964 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1295/2553] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:03:23.267905 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f10c6-6c77-45bb-bfb6-4fe36c6b8cba None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:23.277839 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f10c6-6c77-45bb-bfb6-4fe36c6b8cba None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:23.284023 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5997eafe-9952-4569-b680-f5e6905242f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:23.284736 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997eafe-9952-4569-b680-f5e6905242f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:23.285113 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997eafe-9952-4569-b680-f5e6905242f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:23.285391 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997eafe-9952-4569-b680-f5e6905242f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:23.286052 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5997eafe-9952-4569-b680-f5e6905242f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:23.286352 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5997eafe-9952-4569-b680-f5e6905242f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:23.287995 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5997eafe-9952-4569-b680-f5e6905242f3 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:23.305104 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1259/2554] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 16:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:23.306401 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8561836d-6764-402c-8a1c-f7a2fd926066 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:23.317705 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8561836d-6764-402c-8a1c-f7a2fd926066 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:23.325006 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b04fd-56e1-42bb-a548-c3835bf8fe63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:23.326026 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b04fd-56e1-42bb-a548-c3835bf8fe63 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:23.326992 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b04fd-56e1-42bb-a548-c3835bf8fe63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:23.327447 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b04fd-56e1-42bb-a548-c3835bf8fe63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:23.328285 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b04fd-56e1-42bb-a548-c3835bf8fe63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:23.330396 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b04fd-56e1-42bb-a548-c3835bf8fe63 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:23.354445 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:23.367606 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1296/2555] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:03:23 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:03:23.369611 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5997eafe-9952-4569-b680-f5e6905242f3 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:23.383683 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5997eafe-9952-4569-b680-f5e6905242f3 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:23.449661 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17f5a8-201f-448b-bf5b-c57a82889fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:23.450192 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17f5a8-201f-448b-bf5b-c57a82889fb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:23.450471 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17f5a8-201f-448b-bf5b-c57a82889fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:23.450739 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17f5a8-201f-448b-bf5b-c57a82889fb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:23.451892 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17f5a8-201f-448b-bf5b-c57a82889fb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:23.454354 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17f5a8-201f-448b-bf5b-c57a82889fb6 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:23.497458 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1260/2556] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:03:23 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:03:23.498611 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b04fd-56e1-42bb-a548-c3835bf8fe63 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:23.512085 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b04fd-56e1-42bb-a548-c3835bf8fe63 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:23.519098 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63748df8-2965-4db9-8df1-318ec1d3c2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:23.519726 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63748df8-2965-4db9-8df1-318ec1d3c2db admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:23.520000 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63748df8-2965-4db9-8df1-318ec1d3c2db admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:23.520269 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63748df8-2965-4db9-8df1-318ec1d3c2db admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:23.521103 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63748df8-2965-4db9-8df1-318ec1d3c2db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:23.522771 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63748df8-2965-4db9-8df1-318ec1d3c2db admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:23.535551 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1297/2557] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:03:23.540326 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17f5a8-201f-448b-bf5b-c57a82889fb6 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:23.553361 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17f5a8-201f-448b-bf5b-c57a82889fb6 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:23.558587 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10affc5-c919-4993-8072-f86e814f2cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:23.559435 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10affc5-c919-4993-8072-f86e814f2cbb admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:23.559900 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10affc5-c919-4993-8072-f86e814f2cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:23.560684 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10affc5-c919-4993-8072-f86e814f2cbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:23.562297 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10affc5-c919-4993-8072-f86e814f2cbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:23.564146 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10affc5-c919-4993-8072-f86e814f2cbb admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:23.580201 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1261/2558] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:03:23.582313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63748df8-2965-4db9-8df1-318ec1d3c2db admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:23.595322 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63748df8-2965-4db9-8df1-318ec1d3c2db admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:23.602494 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38689caf-54f5-4ae0-b21f-deeb3e594fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:23.603197 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38689caf-54f5-4ae0-b21f-deeb3e594fcf admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:23.603473 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38689caf-54f5-4ae0-b21f-deeb3e594fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:23.603745 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38689caf-54f5-4ae0-b21f-deeb3e594fcf admin admin] PATH_INFO: `/v3/projects/b59ace9d7dec4b3895bdb94676ae8936/users/956b16fc956f4ffaa0863093a9637cdc/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:23.621207 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38689caf-54f5-4ae0-b21f-deeb3e594fcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b59ace9d7dec4b3895bdb94676ae8936, user_id=956b16fc956f4ffaa0863093a9637cdc, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:23.624844 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38689caf-54f5-4ae0-b21f-deeb3e594fcf admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:23.640313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1298/2559] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:03:23 2022] PUT /identity/v3/projects/b59ace9d7dec4b3895bdb94676ae8936/users/956b16fc956f4ffaa0863093a9637cdc/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:03:23.646193 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e0e85-36f0-4745-89bf-550f748baea4 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:23.646193 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e0e85-36f0-4745-89bf-550f748baea4 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:23.646193 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e0e85-36f0-4745-89bf-550f748baea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:23.667768 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-2e9e0e85-36f0-4745-89bf-550f748baea4 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:23.669082 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-2e9e0e85-36f0-4745-89bf-550f748baea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:23.752437 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1262/2560] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:03:23.771922 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38689caf-54f5-4ae0-b21f-deeb3e594fcf admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:23.774570 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-38689caf-54f5-4ae0-b21f-deeb3e594fcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:23.861428 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38689caf-54f5-4ae0-b21f-deeb3e594fcf admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:23.865516 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1318c-b971-4ca1-b1fa-a2fa285f5488 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:23.866488 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1318c-b971-4ca1-b1fa-a2fa285f5488 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:23.866933 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1318c-b971-4ca1-b1fa-a2fa285f5488 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:23.867371 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1318c-b971-4ca1-b1fa-a2fa285f5488 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:23.878765 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1318c-b971-4ca1-b1fa-a2fa285f5488 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:23.882259 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1318c-b971-4ca1-b1fa-a2fa285f5488 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:23.898270 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1299/2561] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:03:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:03:30.616614 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730494b-aa15-4253-a168-038d49d8c54a None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:30.617169 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730494b-aa15-4253-a168-038d49d8c54a None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:30.617287 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730494b-aa15-4253-a168-038d49d8c54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:30.649360 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-3730494b-aa15-4253-a168-038d49d8c54a None None] MFA Rules not processed for user `956b16fc956f4ffaa0863093a9637cdc`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:30.650647 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-3730494b-aa15-4253-a168-038d49d8c54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:30.670375 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:30.738503 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1263/2562] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:03:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:03:30.742681 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1318c-b971-4ca1-b1fa-a2fa285f5488 service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:30.752757 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1318c-b971-4ca1-b1fa-a2fa285f5488 service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:30.759007 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000215b-51c8-42bc-9215-f9202965af6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:30.759748 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000215b-51c8-42bc-9215-f9202965af6a admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:30.760150 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000215b-51c8-42bc-9215-f9202965af6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:30.760506 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000215b-51c8-42bc-9215-f9202965af6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:30.761932 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8000215b-51c8-42bc-9215-f9202965af6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:30.763335 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8000215b-51c8-42bc-9215-f9202965af6a admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:30.809611 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1300/2563] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:03:30 2022] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:03:30.809853 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bab19-8ef2-4445-aa2f-2d90c1de5418 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:30.810153 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bab19-8ef2-4445-aa2f-2d90c1de5418 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:30.810490 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bab19-8ef2-4445-aa2f-2d90c1de5418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:30.813881 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000215b-51c8-42bc-9215-f9202965af6a admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:30.831216 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-f76bab19-8ef2-4445-aa2f-2d90c1de5418 None None] MFA Rules not processed for user `a5b950f64746494fb2f024e0c7147f93`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:30.832439 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-f76bab19-8ef2-4445-aa2f-2d90c1de5418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:30.893854 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000215b-51c8-42bc-9215-f9202965af6a admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:30.895081 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1264/2564] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:03:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:03:30.898944 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07067425-d66c-4d9f-bb8b-d7a04c0ffd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:30.899555 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07067425-d66c-4d9f-bb8b-d7a04c0ffd09 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:30.899959 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07067425-d66c-4d9f-bb8b-d7a04c0ffd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:30.900240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07067425-d66c-4d9f-bb8b-d7a04c0ffd09 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:30.900912 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07067425-d66c-4d9f-bb8b-d7a04c0ffd09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:30.902834 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07067425-d66c-4d9f-bb8b-d7a04c0ffd09 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:30.932485 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1301/2565] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:03:30 2022] POST /identity/v3/users => generated 298 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:03:30.932715 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76bab19-8ef2-4445-aa2f-2d90c1de5418 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:30.944089 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76bab19-8ef2-4445-aa2f-2d90c1de5418 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:30.951682 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb35c7-5b96-4202-949b-1f7b4c00c7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:30.952397 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb35c7-5b96-4202-949b-1f7b4c00c7c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:30.952706 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb35c7-5b96-4202-949b-1f7b4c00c7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:30.953428 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb35c7-5b96-4202-949b-1f7b4c00c7c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:30.954602 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb35c7-5b96-4202-949b-1f7b4c00c7c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:30.955709 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb35c7-5b96-4202-949b-1f7b4c00c7c2 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:30.970367 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1265/2566] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:03:30.974401 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07067425-d66c-4d9f-bb8b-d7a04c0ffd09 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:30.986275 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07067425-d66c-4d9f-bb8b-d7a04c0ffd09 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:30.991106 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30abd73-272e-441e-bd9a-095f37994412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:30.991770 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30abd73-272e-441e-bd9a-095f37994412 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:30.992123 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30abd73-272e-441e-bd9a-095f37994412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:30.992391 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30abd73-272e-441e-bd9a-095f37994412 admin admin] PATH_INFO: `/v3/projects/01d2bf363306425883da0c0fe059cb6c/users/612982b6c9554c0eb8e31804f595e36a/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:31.010263 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30abd73-272e-441e-bd9a-095f37994412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01d2bf363306425883da0c0fe059cb6c, user_id=612982b6c9554c0eb8e31804f595e36a, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:31.013109 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30abd73-272e-441e-bd9a-095f37994412 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:31.031291 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1302/2567] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:03:30 2022] PUT /identity/v3/projects/01d2bf363306425883da0c0fe059cb6c/users/612982b6c9554c0eb8e31804f595e36a/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:03:31.035391 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb35c7-5b96-4202-949b-1f7b4c00c7c2 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:31.046323 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb35c7-5b96-4202-949b-1f7b4c00c7c2 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:31.131000 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf9c85-c80f-4e13-bb62-6fe67948fb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:31.131628 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf9c85-c80f-4e13-bb62-6fe67948fb23 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:31.131943 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf9c85-c80f-4e13-bb62-6fe67948fb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:31.132284 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf9c85-c80f-4e13-bb62-6fe67948fb23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:31.132990 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf9c85-c80f-4e13-bb62-6fe67948fb23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:31.134617 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf9c85-c80f-4e13-bb62-6fe67948fb23 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:31.146068 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1266/2568] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:03:31.150047 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30abd73-272e-441e-bd9a-095f37994412 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:31.165043 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30abd73-272e-441e-bd9a-095f37994412 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:31.171433 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b0600-cff1-4bd8-babb-0727f4913e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:31.172227 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b0600-cff1-4bd8-babb-0727f4913e31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:31.173240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b0600-cff1-4bd8-babb-0727f4913e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:31.173240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b0600-cff1-4bd8-babb-0727f4913e31 admin admin] PATH_INFO: `/v3/projects/01d2bf363306425883da0c0fe059cb6c/users/612982b6c9554c0eb8e31804f595e36a/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:31.175669 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b0600-cff1-4bd8-babb-0727f4913e31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01d2bf363306425883da0c0fe059cb6c, user_id=612982b6c9554c0eb8e31804f595e36a, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:31.179038 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b0600-cff1-4bd8-babb-0727f4913e31 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:31.186874 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:31.193764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1303/2569] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:03:31 2022] PUT /identity/v3/projects/01d2bf363306425883da0c0fe059cb6c/users/612982b6c9554c0eb8e31804f595e36a/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:03:36.611063 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4630a-35ed-4739-bc35-1431ed5ee63d None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:36.611545 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4630a-35ed-4739-bc35-1431ed5ee63d None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:36.611797 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4630a-35ed-4739-bc35-1431ed5ee63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:36.659294 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-75e4630a-35ed-4739-bc35-1431ed5ee63d None None] MFA Rules not processed for user `612982b6c9554c0eb8e31804f595e36a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:36.661584 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-75e4630a-35ed-4739-bc35-1431ed5ee63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:36.749477 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:36.831530 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1267/2570] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:03:36 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:03:36.838413 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b0600-cff1-4bd8-babb-0727f4913e31 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:36.840257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-829b0600-cff1-4bd8-babb-0727f4913e31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:36.914291 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b0600-cff1-4bd8-babb-0727f4913e31 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:36.922437 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d2567-1663-4074-9a1d-a19e7d93936f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9bd815f8fe54d7d99e00a47212ad9ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:36.922437 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d2567-1663-4074-9a1d-a19e7d93936f service glance] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:36.922683 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d2567-1663-4074-9a1d-a19e7d93936f service glance] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:36.922844 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d2567-1663-4074-9a1d-a19e7d93936f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:37.023803 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2d2567-1663-4074-9a1d-a19e7d93936f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:37.025785 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2d2567-1663-4074-9a1d-a19e7d93936f service glance] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:37.036627 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1304/2571] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:03:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:03:37.170959 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf68946-7226-4a38-8f99-2899f5403b57 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:37.171318 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf68946-7226-4a38-8f99-2899f5403b57 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:37.171609 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf68946-7226-4a38-8f99-2899f5403b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:37.194948 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-3bf68946-7226-4a38-8f99-2899f5403b57 None None] MFA Rules not processed for user `d7958b395d5e4f5da37927536b1856ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:37.196095 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-3bf68946-7226-4a38-8f99-2899f5403b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:37.256692 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1268/2572] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Aug 30 16:03:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:03:37.310616 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d2567-1663-4074-9a1d-a19e7d93936f service glance] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:37.312191 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-1d2d2567-1663-4074-9a1d-a19e7d93936f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:37.385648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d2567-1663-4074-9a1d-a19e7d93936f service glance] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:37.391659 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f80f69-fa13-4373-8ec2-be684affe847 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94765f224c734beabe83b4dc0c5e511f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:37.392266 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f80f69-fa13-4373-8ec2-be684affe847 service swift] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:37.392546 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f80f69-fa13-4373-8ec2-be684affe847 service swift] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:37.392848 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f80f69-fa13-4373-8ec2-be684affe847 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:37.400955 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f80f69-fa13-4373-8ec2-be684affe847 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:37.402531 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f80f69-fa13-4373-8ec2-be684affe847 service swift] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:37.410857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1305/2573] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Aug 30 16:03:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 16:03:46.414115 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecdb4b-db73-40dc-9244-e2ee0be01173 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:46.414689 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecdb4b-db73-40dc-9244-e2ee0be01173 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:46.414689 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecdb4b-db73-40dc-9244-e2ee0be01173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:46.435612 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-4eecdb4b-db73-40dc-9244-e2ee0be01173 None None] MFA Rules not processed for user `956b16fc956f4ffaa0863093a9637cdc`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:46.437200 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-4eecdb4b-db73-40dc-9244-e2ee0be01173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:46.444485 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1269/2574] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:03:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:03:47.407663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=81 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:48.553119 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4f623-3a63-4cdc-9e4b-649606994243 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:48.553745 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4f623-3a63-4cdc-9e4b-649606994243 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:48.553745 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4f623-3a63-4cdc-9e4b-649606994243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:48.573741 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-fdc4f623-3a63-4cdc-9e4b-649606994243 None None] MFA Rules not processed for user `d7958b395d5e4f5da37927536b1856ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:48.575958 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-fdc4f623-3a63-4cdc-9e4b-649606994243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:48.583340 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1306/2575] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Aug 30 16:03:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:03:48.596031 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eecdb4b-db73-40dc-9244-e2ee0be01173 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:48.608459 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eecdb4b-db73-40dc-9244-e2ee0be01173 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:48.613793 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ee30b-d6c2-401b-92ab-a14a0f0a4899 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94765f224c734beabe83b4dc0c5e511f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:48.614401 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ee30b-d6c2-401b-92ab-a14a0f0a4899 service swift] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:48.614830 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ee30b-d6c2-401b-92ab-a14a0f0a4899 service swift] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:48.615108 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ee30b-d6c2-401b-92ab-a14a0f0a4899 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:48.624402 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ee30b-d6c2-401b-92ab-a14a0f0a4899 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:48.626087 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ee30b-d6c2-401b-92ab-a14a0f0a4899 service swift] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:48.634848 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1270/2576] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Aug 30 16:03:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 16:03:58.568124 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:58.631429 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=46 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:14.941266 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4f623-3a63-4cdc-9e4b-649606994243 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:14.994098 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4f623-3a63-4cdc-9e4b-649606994243 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:14.997820 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b18462-876d-4900-aa3b-9fd1da2004b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:14.998423 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b18462-876d-4900-aa3b-9fd1da2004b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:14.998703 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b18462-876d-4900-aa3b-9fd1da2004b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:14.998976 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b18462-876d-4900-aa3b-9fd1da2004b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:15.008488 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b18462-876d-4900-aa3b-9fd1da2004b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:15.009947 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b18462-876d-4900-aa3b-9fd1da2004b3 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:15.020554 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1307/2577] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:04:14 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:04:20.665667 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ee30b-d6c2-401b-92ab-a14a0f0a4899 service swift] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:20.675525 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ee30b-d6c2-401b-92ab-a14a0f0a4899 service swift] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:20.679183 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a568004-20cc-4ed3-9c25-2bfc8f1defcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:20.679777 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a568004-20cc-4ed3-9c25-2bfc8f1defcb service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:20.680076 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a568004-20cc-4ed3-9c25-2bfc8f1defcb service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:20.680343 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a568004-20cc-4ed3-9c25-2bfc8f1defcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:20.682071 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-5a568004-20cc-4ed3-9c25-2bfc8f1defcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:20.753592 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a568004-20cc-4ed3-9c25-2bfc8f1defcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:20.755036 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a568004-20cc-4ed3-9c25-2bfc8f1defcb service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:20.766783 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1271/2578] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:04:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:04:21.942543 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b18462-876d-4900-aa3b-9fd1da2004b3 service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:21.951287 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b18462-876d-4900-aa3b-9fd1da2004b3 service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:21.955000 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558f4a5-17ed-4c45-8419-7a1461715089 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:21.955589 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558f4a5-17ed-4c45-8419-7a1461715089 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:21.955866 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558f4a5-17ed-4c45-8419-7a1461715089 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:21.956146 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558f4a5-17ed-4c45-8419-7a1461715089 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:21.957882 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-5558f4a5-17ed-4c45-8419-7a1461715089 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:21.970890 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5558f4a5-17ed-4c45-8419-7a1461715089 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:21.972338 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5558f4a5-17ed-4c45-8419-7a1461715089 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:21.983494 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1308/2579] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:04:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:04:24.500970 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a568004-20cc-4ed3-9c25-2bfc8f1defcb service neutron] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:24.509791 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a568004-20cc-4ed3-9c25-2bfc8f1defcb service neutron] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:24.514201 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a57ff7-ee2c-4ce1-a7b5-94c03e6550df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:24.514815 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a57ff7-ee2c-4ce1-a7b5-94c03e6550df service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:24.515091 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a57ff7-ee2c-4ce1-a7b5-94c03e6550df service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:24.515357 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a57ff7-ee2c-4ce1-a7b5-94c03e6550df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:24.517132 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-a9a57ff7-ee2c-4ce1-a7b5-94c03e6550df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:24.580346 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a57ff7-ee2c-4ce1-a7b5-94c03e6550df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:24.581818 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a57ff7-ee2c-4ce1-a7b5-94c03e6550df service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:24.591292 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1272/2580] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:04:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:04:27.756086 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558f4a5-17ed-4c45-8419-7a1461715089 service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:27.757658 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-5558f4a5-17ed-4c45-8419-7a1461715089 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:27.771861 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558f4a5-17ed-4c45-8419-7a1461715089 service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:27.776412 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaee103-6a09-415c-b30f-52357cd7d24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:27.777077 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaee103-6a09-415c-b30f-52357cd7d24c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:27.777357 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaee103-6a09-415c-b30f-52357cd7d24c admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:27.777630 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaee103-6a09-415c-b30f-52357cd7d24c admin admin] PATH_INFO: `/v3/users/041323d39916493aa4318309904f4ef2` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:27.781973 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaee103-6a09-415c-b30f-52357cd7d24c admin admin] RBAC: Authorizing `identity:delete_user(user_id=041323d39916493aa4318309904f4ef2)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:27.781973 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaee103-6a09-415c-b30f-52357cd7d24c admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:27.829782 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-cdaee103-6a09-415c-b30f-52357cd7d24c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '041323d39916493aa4318309904f4ef2'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:04:27.830428 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-cdaee103-6a09-415c-b30f-52357cd7d24c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '041323d39916493aa4318309904f4ef2'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:04:27.837637 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-cdaee103-6a09-415c-b30f-52357cd7d24c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '041323d39916493aa4318309904f4ef2'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:04:27.850594 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-cdaee103-6a09-415c-b30f-52357cd7d24c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '041323d39916493aa4318309904f4ef2'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:04:27.858253 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-cdaee103-6a09-415c-b30f-52357cd7d24c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '041323d39916493aa4318309904f4ef2'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:04:27.864122 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1309/2581] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:04:27 2022] DELETE /identity/v3/users/041323d39916493aa4318309904f4ef2 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:04:28.035709 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a57ff7-ee2c-4ce1-a7b5-94c03e6550df service neutron] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:28.047035 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a57ff7-ee2c-4ce1-a7b5-94c03e6550df service neutron] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:28.106959 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3725c-0456-4710-a00f-c3555c541a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:28.107642 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3725c-0456-4710-a00f-c3555c541a36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:28.107924 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3725c-0456-4710-a00f-c3555c541a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:28.108191 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3725c-0456-4710-a00f-c3555c541a36 admin admin] PATH_INFO: `/v3/projects/0bc4d8cac273429585b23fe362cb76b0` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:28.109976 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3725c-0456-4710-a00f-c3555c541a36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bc4d8cac273429585b23fe362cb76b0)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:28.111892 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3725c-0456-4710-a00f-c3555c541a36 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:28.135337 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:28.161006 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-c2f3725c-0456-4710-a00f-c3555c541a36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bc4d8cac273429585b23fe362cb76b0', 'request_id': 'req-c2f3725c-0456-4710-a00f-c3555c541a36'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:04:28.168032 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-c2f3725c-0456-4710-a00f-c3555c541a36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bc4d8cac273429585b23fe362cb76b0', 'request_id': 'req-c2f3725c-0456-4710-a00f-c3555c541a36'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:04:28.175078 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-c2f3725c-0456-4710-a00f-c3555c541a36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bc4d8cac273429585b23fe362cb76b0', 'request_id': 'req-c2f3725c-0456-4710-a00f-c3555c541a36'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:04:28.187595 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-c2f3725c-0456-4710-a00f-c3555c541a36 admin admin] The token cache is being invalidate because project 0bc4d8cac273429585b23fe362cb76b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:04:28.187887 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-c2f3725c-0456-4710-a00f-c3555c541a36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:04:28.188537 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-c2f3725c-0456-4710-a00f-c3555c541a36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:04:28.190059 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1273/2582] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:04:28 2022] DELETE /identity/v3/projects/0bc4d8cac273429585b23fe362cb76b0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:04:28.195175 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f6a6c-e40e-4800-9c82-3b655c114c0c None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:28.195460 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f6a6c-e40e-4800-9c82-3b655c114c0c None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:28.195733 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f6a6c-e40e-4800-9c82-3b655c114c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:28.217227 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-1f9f6a6c-e40e-4800-9c82-3b655c114c0c None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:28.218442 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-1f9f6a6c-e40e-4800-9c82-3b655c114c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:28.277198 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1310/2583] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:04:28.285013 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63487038-5ceb-41fc-9f73-6914d0e5b56f None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:28.285299 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63487038-5ceb-41fc-9f73-6914d0e5b56f None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:28.285567 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63487038-5ceb-41fc-9f73-6914d0e5b56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:28.305464 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-63487038-5ceb-41fc-9f73-6914d0e5b56f None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:28.306649 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-63487038-5ceb-41fc-9f73-6914d0e5b56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:28.314472 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1274/2584] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:04:28.318551 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f6a6c-e40e-4800-9c82-3b655c114c0c None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:28.323415 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:28.330240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f6a6c-e40e-4800-9c82-3b655c114c0c None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:28.335687 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a3acf-f60b-4d4b-87e0-6ca0e70390eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:28.336298 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a3acf-f60b-4d4b-87e0-6ca0e70390eb admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:28.336574 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a3acf-f60b-4d4b-87e0-6ca0e70390eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:28.336880 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a3acf-f60b-4d4b-87e0-6ca0e70390eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:28.337521 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a3acf-f60b-4d4b-87e0-6ca0e70390eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:28.337818 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a3acf-f60b-4d4b-87e0-6ca0e70390eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:28.339931 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a3acf-f60b-4d4b-87e0-6ca0e70390eb admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:28.351215 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1311/2585] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 16:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:28.356209 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63487038-5ceb-41fc-9f73-6914d0e5b56f None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:28.365463 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63487038-5ceb-41fc-9f73-6914d0e5b56f None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:28.370032 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543dc744-1f32-4ee1-8737-c3064e05cb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:28.370642 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dc744-1f32-4ee1-8737-c3064e05cb9f admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:28.370919 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dc744-1f32-4ee1-8737-c3064e05cb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:28.371188 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dc744-1f32-4ee1-8737-c3064e05cb9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:28.371820 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543dc744-1f32-4ee1-8737-c3064e05cb9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:28.373752 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543dc744-1f32-4ee1-8737-c3064e05cb9f admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:28.400416 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1275/2586] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:04:28 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:04:28.405184 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a3acf-f60b-4d4b-87e0-6ca0e70390eb admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:28.416281 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a3acf-f60b-4d4b-87e0-6ca0e70390eb admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:28.474873 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0e19f-adb8-45a7-a3b8-428cfb95f1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:28.475492 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0e19f-adb8-45a7-a3b8-428cfb95f1ac admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:28.475773 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0e19f-adb8-45a7-a3b8-428cfb95f1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:28.476044 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0e19f-adb8-45a7-a3b8-428cfb95f1ac admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:28.476688 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a0e19f-adb8-45a7-a3b8-428cfb95f1ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:28.478650 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a0e19f-adb8-45a7-a3b8-428cfb95f1ac admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:28.500486 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1312/2587] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:04:28 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:04:28.504873 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543dc744-1f32-4ee1-8737-c3064e05cb9f admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:28.515734 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543dc744-1f32-4ee1-8737-c3064e05cb9f admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:28.520733 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ece29e-2bfc-449f-b671-d35b052bd1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:28.521358 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ece29e-2bfc-449f-b671-d35b052bd1cd admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:28.521634 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ece29e-2bfc-449f-b671-d35b052bd1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:28.521904 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ece29e-2bfc-449f-b671-d35b052bd1cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:28.522541 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ece29e-2bfc-449f-b671-d35b052bd1cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:28.524140 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ece29e-2bfc-449f-b671-d35b052bd1cd admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:28.534655 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1276/2588] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:04:28.538725 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0e19f-adb8-45a7-a3b8-428cfb95f1ac admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:28.549125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0e19f-adb8-45a7-a3b8-428cfb95f1ac admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:28.553902 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550aef13-7ba3-4d72-9843-e36dd7749677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:28.554502 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550aef13-7ba3-4d72-9843-e36dd7749677 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:28.554783 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550aef13-7ba3-4d72-9843-e36dd7749677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:28.555059 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550aef13-7ba3-4d72-9843-e36dd7749677 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:28.555747 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550aef13-7ba3-4d72-9843-e36dd7749677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:28.557359 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550aef13-7ba3-4d72-9843-e36dd7749677 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:28.568404 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1313/2589] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:04:28.572951 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ece29e-2bfc-449f-b671-d35b052bd1cd admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:28.583645 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ece29e-2bfc-449f-b671-d35b052bd1cd admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:28.589619 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d62e91-655d-4744-bedd-0f4590d1e11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:28.590479 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d62e91-655d-4744-bedd-0f4590d1e11d admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:28.590833 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d62e91-655d-4744-bedd-0f4590d1e11d admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:28.591181 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d62e91-655d-4744-bedd-0f4590d1e11d admin admin] PATH_INFO: `/v3/projects/e4800bf375584de38fa6250bd44cfd08/users/784ffb9dd49449358524fa67a5eeca4e/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:28.607283 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d62e91-655d-4744-bedd-0f4590d1e11d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4800bf375584de38fa6250bd44cfd08, user_id=784ffb9dd49449358524fa67a5eeca4e, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:28.610013 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d62e91-655d-4744-bedd-0f4590d1e11d admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:28.623828 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1277/2590] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:04:28 2022] PUT /identity/v3/projects/e4800bf375584de38fa6250bd44cfd08/users/784ffb9dd49449358524fa67a5eeca4e/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:04:28.629085 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ea7b0-ecd4-4c29-919f-4f37f688cd98 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:28.629373 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ea7b0-ecd4-4c29-919f-4f37f688cd98 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:28.629648 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ea7b0-ecd4-4c29-919f-4f37f688cd98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:28.649481 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-787ea7b0-ecd4-4c29-919f-4f37f688cd98 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:28.650695 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-787ea7b0-ecd4-4c29-919f-4f37f688cd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:28.713305 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1314/2591] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:04:28.724546 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d62e91-655d-4744-bedd-0f4590d1e11d admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:28.726339 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-f7d62e91-655d-4744-bedd-0f4590d1e11d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:28.784341 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d62e91-655d-4744-bedd-0f4590d1e11d admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:28.788008 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacfb90f-da58-4ab8-9e3d-39d439d452c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:28.788612 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfb90f-da58-4ab8-9e3d-39d439d452c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:28.788923 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfb90f-da58-4ab8-9e3d-39d439d452c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:28.789199 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfb90f-da58-4ab8-9e3d-39d439d452c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:28.798549 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacfb90f-da58-4ab8-9e3d-39d439d452c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:28.799983 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacfb90f-da58-4ab8-9e3d-39d439d452c7 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:28.810027 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1278/2592] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:04:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:04:31.105015 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ea7b0-ecd4-4c29-919f-4f37f688cd98 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:31.106781 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-787ea7b0-ecd4-4c29-919f-4f37f688cd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:31.172991 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ea7b0-ecd4-4c29-919f-4f37f688cd98 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:31.177093 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b473a5c-a914-4d42-ac3f-df529f2b3c86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:31.177724 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b473a5c-a914-4d42-ac3f-df529f2b3c86 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:31.178043 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b473a5c-a914-4d42-ac3f-df529f2b3c86 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:31.178261 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b473a5c-a914-4d42-ac3f-df529f2b3c86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:31.180413 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-5b473a5c-a914-4d42-ac3f-df529f2b3c86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:31.204877 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:31.253735 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b473a5c-a914-4d42-ac3f-df529f2b3c86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:31.255329 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b473a5c-a914-4d42-ac3f-df529f2b3c86 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:31.266630 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1315/2593] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:04:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:04:33.319701 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60564519-792b-477b-9167-641c34e59b9f None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:33.320160 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60564519-792b-477b-9167-641c34e59b9f None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:33.320264 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60564519-792b-477b-9167-641c34e59b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:33.352549 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-60564519-792b-477b-9167-641c34e59b9f None None] MFA Rules not processed for user `784ffb9dd49449358524fa67a5eeca4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:33.353839 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-60564519-792b-477b-9167-641c34e59b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:33.397916 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:33.429753 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1279/2594] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:04:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:04:33.444930 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b473a5c-a914-4d42-ac3f-df529f2b3c86 service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:33.446418 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-5b473a5c-a914-4d42-ac3f-df529f2b3c86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:33.524436 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b473a5c-a914-4d42-ac3f-df529f2b3c86 service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:33.545302 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa4e9d-1939-4f96-9db3-94f55c1d454e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:33.545969 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa4e9d-1939-4f96-9db3-94f55c1d454e service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:33.546253 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa4e9d-1939-4f96-9db3-94f55c1d454e service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:33.546529 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa4e9d-1939-4f96-9db3-94f55c1d454e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:33.555452 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa4e9d-1939-4f96-9db3-94f55c1d454e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:33.557074 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa4e9d-1939-4f96-9db3-94f55c1d454e service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:33.565953 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1316/2595] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:04:33 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:04:35.006235 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591c067-7861-4d13-9192-97a8d1ad15f6 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:35.006774 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591c067-7861-4d13-9192-97a8d1ad15f6 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:35.006887 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591c067-7861-4d13-9192-97a8d1ad15f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:35.025734 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-e591c067-7861-4d13-9192-97a8d1ad15f6 None None] MFA Rules not processed for user `784ffb9dd49449358524fa67a5eeca4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:35.027455 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-e591c067-7861-4d13-9192-97a8d1ad15f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:35.034215 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1280/2596] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:04:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:04:35.347240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa4e9d-1939-4f96-9db3-94f55c1d454e service nova] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:35.348685 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-06aa4e9d-1939-4f96-9db3-94f55c1d454e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:35.360879 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa4e9d-1939-4f96-9db3-94f55c1d454e service nova] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:35.364364 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60688e3-05dd-48ba-98ef-3455049037b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:35.365010 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60688e3-05dd-48ba-98ef-3455049037b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:35.365293 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60688e3-05dd-48ba-98ef-3455049037b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:35.365564 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60688e3-05dd-48ba-98ef-3455049037b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:35.367258 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c60688e3-05dd-48ba-98ef-3455049037b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:35.376703 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60688e3-05dd-48ba-98ef-3455049037b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:35.378436 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60688e3-05dd-48ba-98ef-3455049037b4 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:35.386893 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1317/2597] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:04:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:04:35.743042 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591c067-7861-4d13-9192-97a8d1ad15f6 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:35.744434 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-e591c067-7861-4d13-9192-97a8d1ad15f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:35.854990 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591c067-7861-4d13-9192-97a8d1ad15f6 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:35.860918 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c583e-426c-4bab-ae3d-1534966b59dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bba851e1a0d4601b5d4841662f645dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:35.874292 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c583e-426c-4bab-ae3d-1534966b59dd service placement] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:35.874756 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c583e-426c-4bab-ae3d-1534966b59dd service placement] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:35.875038 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c583e-426c-4bab-ae3d-1534966b59dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:35.877516 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-e42c583e-426c-4bab-ae3d-1534966b59dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:35.892046 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c583e-426c-4bab-ae3d-1534966b59dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:35.893758 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c583e-426c-4bab-ae3d-1534966b59dd service placement] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:35.905825 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1281/2598] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:04:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:04:39.787270 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60688e3-05dd-48ba-98ef-3455049037b4 service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:39.803624 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60688e3-05dd-48ba-98ef-3455049037b4 service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:39.810813 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa57ff9-7b55-4b91-aaa8-fd68d81a7e57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:39.811463 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa57ff9-7b55-4b91-aaa8-fd68d81a7e57 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:39.811743 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa57ff9-7b55-4b91-aaa8-fd68d81a7e57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:39.812033 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa57ff9-7b55-4b91-aaa8-fd68d81a7e57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:39.814063 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-1fa57ff9-7b55-4b91-aaa8-fd68d81a7e57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:39.824690 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa57ff9-7b55-4b91-aaa8-fd68d81a7e57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:39.826168 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa57ff9-7b55-4b91-aaa8-fd68d81a7e57 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:39.835207 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1318/2599] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:04:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:04:45.900292 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=45 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:49.830746 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=63 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:52.800117 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c583e-426c-4bab-ae3d-1534966b59dd service placement] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:52.810525 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c583e-426c-4bab-ae3d-1534966b59dd service placement] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:52.814052 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4b17c-8777-4837-8b19-789d81340091 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:52.814643 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4b17c-8777-4837-8b19-789d81340091 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:52.814919 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4b17c-8777-4837-8b19-789d81340091 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:52.815217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4b17c-8777-4837-8b19-789d81340091 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:52.816970 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-88d4b17c-8777-4837-8b19-789d81340091 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:52.829759 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4b17c-8777-4837-8b19-789d81340091 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:52.831212 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4b17c-8777-4837-8b19-789d81340091 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:52.840973 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1282/2600] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:04:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:04:56.356370 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9864eea-9b0b-476d-abd0-4ea954d5a995 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:56.356871 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9864eea-9b0b-476d-abd0-4ea954d5a995 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:56.357712 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9864eea-9b0b-476d-abd0-4ea954d5a995 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:56.359126 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1319/2601] 10.222.0.25 () {54 vars in 961 bytes} [Tue Aug 30 16:04:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:56.364332 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2650fa5-638a-4305-81fa-9782891d1858 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:56.364871 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2650fa5-638a-4305-81fa-9782891d1858 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:56.364984 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2650fa5-638a-4305-81fa-9782891d1858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:56.385148 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-a2650fa5-638a-4305-81fa-9782891d1858 None None] MFA Rules not processed for user `2bba851e1a0d4601b5d4841662f645dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:56.387145 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-a2650fa5-638a-4305-81fa-9782891d1858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:56.396358 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1283/2602] 10.222.0.25 () {58 vars in 1058 bytes} [Tue Aug 30 16:04:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:04:56.404363 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9864eea-9b0b-476d-abd0-4ea954d5a995 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:56.420701 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9864eea-9b0b-476d-abd0-4ea954d5a995 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:56.422600 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2650fa5-638a-4305-81fa-9782891d1858 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:56.424274 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-a2650fa5-638a-4305-81fa-9782891d1858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:56.428045 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94fe718-01b2-4d5b-a719-aeb6b808605e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bba851e1a0d4601b5d4841662f645dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:56.428752 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fe718-01b2-4d5b-a719-aeb6b808605e service placement] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:56.429130 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fe718-01b2-4d5b-a719-aeb6b808605e service placement] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:56.429469 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fe718-01b2-4d5b-a719-aeb6b808605e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:56.431346 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-a94fe718-01b2-4d5b-a719-aeb6b808605e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:56.441657 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2650fa5-638a-4305-81fa-9782891d1858 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:56.443632 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94fe718-01b2-4d5b-a719-aeb6b808605e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:56.445334 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94fe718-01b2-4d5b-a719-aeb6b808605e service placement] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:56.446767 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd1bf4-036e-4f40-b538-35859d71bf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:56.447400 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd1bf4-036e-4f40-b538-35859d71bf09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:56.447681 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd1bf4-036e-4f40-b538-35859d71bf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:56.447953 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd1bf4-036e-4f40-b538-35859d71bf09 admin admin] PATH_INFO: `/v3/users/a5b950f64746494fb2f024e0c7147f93` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:56.449862 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd1bf4-036e-4f40-b538-35859d71bf09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5b950f64746494fb2f024e0c7147f93)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:56.451795 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd1bf4-036e-4f40-b538-35859d71bf09 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:56.455894 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1320/2603] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:04:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:04:56.500652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-a1fd1bf4-036e-4f40-b538-35859d71bf09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5b950f64746494fb2f024e0c7147f93'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:04:56.513605 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-a1fd1bf4-036e-4f40-b538-35859d71bf09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5b950f64746494fb2f024e0c7147f93'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:04:56.514325 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-a1fd1bf4-036e-4f40-b538-35859d71bf09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5b950f64746494fb2f024e0c7147f93'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:04:56.514956 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-a1fd1bf4-036e-4f40-b538-35859d71bf09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5b950f64746494fb2f024e0c7147f93'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:04:56.522332 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-a1fd1bf4-036e-4f40-b538-35859d71bf09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5b950f64746494fb2f024e0c7147f93'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:04:56.535201 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1284/2604] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:04:56 2022] DELETE /identity/v3/users/a5b950f64746494fb2f024e0c7147f93 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:04:56.725388 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94fe718-01b2-4d5b-a719-aeb6b808605e service placement] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:56.736254 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94fe718-01b2-4d5b-a719-aeb6b808605e service placement] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:56.792906 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b6ac3-a153-4759-b840-cc3308c48b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:56.794192 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b6ac3-a153-4759-b840-cc3308c48b1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:56.794192 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b6ac3-a153-4759-b840-cc3308c48b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:56.794192 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b6ac3-a153-4759-b840-cc3308c48b1e admin admin] PATH_INFO: `/v3/projects/164598d832474531a3326c748531194b` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:56.795100 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b6ac3-a153-4759-b840-cc3308c48b1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=164598d832474531a3326c748531194b)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:56.797037 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b6ac3-a153-4759-b840-cc3308c48b1e admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:56.851831 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-3e3b6ac3-a153-4759-b840-cc3308c48b1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '164598d832474531a3326c748531194b', 'request_id': 'req-3e3b6ac3-a153-4759-b840-cc3308c48b1e'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:04:56.861657 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-3e3b6ac3-a153-4759-b840-cc3308c48b1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '164598d832474531a3326c748531194b', 'request_id': 'req-3e3b6ac3-a153-4759-b840-cc3308c48b1e'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:04:56.868156 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-3e3b6ac3-a153-4759-b840-cc3308c48b1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '164598d832474531a3326c748531194b', 'request_id': 'req-3e3b6ac3-a153-4759-b840-cc3308c48b1e'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:04:56.879460 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-3e3b6ac3-a153-4759-b840-cc3308c48b1e admin admin] The token cache is being invalidate because project 164598d832474531a3326c748531194b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:04:56.879752 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-3e3b6ac3-a153-4759-b840-cc3308c48b1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:04:56.880388 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-3e3b6ac3-a153-4759-b840-cc3308c48b1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:04:56.881931 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1321/2605] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:04:56 2022] DELETE /identity/v3/projects/164598d832474531a3326c748531194b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:04:56.887695 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15279901-431e-4709-8ff1-eb853052416c None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:56.887979 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15279901-431e-4709-8ff1-eb853052416c None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:56.888271 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15279901-431e-4709-8ff1-eb853052416c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:56.907506 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-15279901-431e-4709-8ff1-eb853052416c None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:56.908693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-15279901-431e-4709-8ff1-eb853052416c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:56.966382 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1285/2606] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:04:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:04:56.974069 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e87334-b129-42d7-8449-ae98bdeef5f9 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:56.974369 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e87334-b129-42d7-8449-ae98bdeef5f9 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:56.974623 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e87334-b129-42d7-8449-ae98bdeef5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:56.994296 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-20e87334-b129-42d7-8449-ae98bdeef5f9 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:56.996299 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-20e87334-b129-42d7-8449-ae98bdeef5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:57.004563 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1322/2607] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:04:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:04:57.008856 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15279901-431e-4709-8ff1-eb853052416c None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:57.018954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15279901-431e-4709-8ff1-eb853052416c None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:57.023722 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e428425-4c2c-410f-b1ad-078c3f264334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:57.024351 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e428425-4c2c-410f-b1ad-078c3f264334 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:57.024626 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e428425-4c2c-410f-b1ad-078c3f264334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:57.024927 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e428425-4c2c-410f-b1ad-078c3f264334 admin admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:57.025596 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e428425-4c2c-410f-b1ad-078c3f264334 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:57.025892 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e428425-4c2c-410f-b1ad-078c3f264334 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:57.027668 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e428425-4c2c-410f-b1ad-078c3f264334 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:57.039799 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1286/2608] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 16:04:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:57.044862 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e87334-b129-42d7-8449-ae98bdeef5f9 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:57.054192 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e87334-b129-42d7-8449-ae98bdeef5f9 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:57.059573 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1f216-5fbe-4ea2-8b7c-3fc985d9bf8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:57.060172 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1f216-5fbe-4ea2-8b7c-3fc985d9bf8e admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:57.060451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1f216-5fbe-4ea2-8b7c-3fc985d9bf8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:57.060722 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1f216-5fbe-4ea2-8b7c-3fc985d9bf8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:57.061401 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1f216-5fbe-4ea2-8b7c-3fc985d9bf8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:57.063281 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1f216-5fbe-4ea2-8b7c-3fc985d9bf8e admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:57.092562 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1323/2609] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:04:57 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:04:57.096362 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e428425-4c2c-410f-b1ad-078c3f264334 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:57.106730 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e428425-4c2c-410f-b1ad-078c3f264334 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:57.144526 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:57.165481 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9f885-5610-43f8-a254-15ed20de1b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:57.166086 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9f885-5610-43f8-a254-15ed20de1b5f admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:57.166362 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9f885-5610-43f8-a254-15ed20de1b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:57.166633 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9f885-5610-43f8-a254-15ed20de1b5f admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:57.167765 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e9f885-5610-43f8-a254-15ed20de1b5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:57.169707 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e9f885-5610-43f8-a254-15ed20de1b5f admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:57.196716 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1287/2610] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:04:57 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:04:57.198173 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1f216-5fbe-4ea2-8b7c-3fc985d9bf8e admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:57.208676 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1f216-5fbe-4ea2-8b7c-3fc985d9bf8e admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:57.213595 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018aa7ad-00f4-494c-9568-fe73e06a0260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:57.214468 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018aa7ad-00f4-494c-9568-fe73e06a0260 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:57.214745 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018aa7ad-00f4-494c-9568-fe73e06a0260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:57.215048 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018aa7ad-00f4-494c-9568-fe73e06a0260 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:57.215699 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018aa7ad-00f4-494c-9568-fe73e06a0260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:57.217367 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018aa7ad-00f4-494c-9568-fe73e06a0260 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:57.227780 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1324/2611] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:04:57.232433 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9f885-5610-43f8-a254-15ed20de1b5f admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:57.242914 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9f885-5610-43f8-a254-15ed20de1b5f admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:57.247816 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c7e50-a4db-4813-88da-d3cc8e47db38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:57.248481 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c7e50-a4db-4813-88da-d3cc8e47db38 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:57.248824 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c7e50-a4db-4813-88da-d3cc8e47db38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:57.249109 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c7e50-a4db-4813-88da-d3cc8e47db38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:57.249763 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c7e50-a4db-4813-88da-d3cc8e47db38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:57.251631 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c7e50-a4db-4813-88da-d3cc8e47db38 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:57.263685 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1288/2612] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:04:57.267880 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018aa7ad-00f4-494c-9568-fe73e06a0260 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:57.278418 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018aa7ad-00f4-494c-9568-fe73e06a0260 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:57.283065 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d0e66-5e19-4926-8842-eb2d639636f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:57.283721 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d0e66-5e19-4926-8842-eb2d639636f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:57.284007 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d0e66-5e19-4926-8842-eb2d639636f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:57.284282 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d0e66-5e19-4926-8842-eb2d639636f0 admin admin] PATH_INFO: `/v3/projects/aa960eece7f0461a98e9fcb41824a128/users/090157a7cd154d3aa6e3466b4f3f8cb9/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:57.299112 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d0e66-5e19-4926-8842-eb2d639636f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa960eece7f0461a98e9fcb41824a128, user_id=090157a7cd154d3aa6e3466b4f3f8cb9, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:57.301756 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d0e66-5e19-4926-8842-eb2d639636f0 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:57.319119 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1325/2613] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:04:57 2022] PUT /identity/v3/projects/aa960eece7f0461a98e9fcb41824a128/users/090157a7cd154d3aa6e3466b4f3f8cb9/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:04:57.325205 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219ed51-facb-443c-8d6c-b52e11c3925d None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:57.325524 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219ed51-facb-443c-8d6c-b52e11c3925d None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:57.325971 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219ed51-facb-443c-8d6c-b52e11c3925d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:57.345904 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-a219ed51-facb-443c-8d6c-b52e11c3925d None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:57.347134 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-a219ed51-facb-443c-8d6c-b52e11c3925d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:57.403974 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1289/2614] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:04:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:04:57.413492 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d0e66-5e19-4926-8842-eb2d639636f0 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:57.415230 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-762d0e66-5e19-4926-8842-eb2d639636f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:57.429420 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:57.475152 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d0e66-5e19-4926-8842-eb2d639636f0 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:57.478759 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d860ea-8d55-41eb-b1ac-4c907393b0be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:57.479384 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d860ea-8d55-41eb-b1ac-4c907393b0be service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:57.479658 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d860ea-8d55-41eb-b1ac-4c907393b0be service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:57.479925 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d860ea-8d55-41eb-b1ac-4c907393b0be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:57.488591 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d860ea-8d55-41eb-b1ac-4c907393b0be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:57.490043 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d860ea-8d55-41eb-b1ac-4c907393b0be service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:57.499716 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1326/2615] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:04:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:05:01.499951 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec50ec8-92a1-4166-a9b6-9cd654423184 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:01.500512 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec50ec8-92a1-4166-a9b6-9cd654423184 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:01.500512 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec50ec8-92a1-4166-a9b6-9cd654423184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:01.532687 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-cec50ec8-92a1-4166-a9b6-9cd654423184 None None] MFA Rules not processed for user `090157a7cd154d3aa6e3466b4f3f8cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:05:01.534063 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-cec50ec8-92a1-4166-a9b6-9cd654423184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:05:01.605658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1290/2616] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:05:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:05:01.620906 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d860ea-8d55-41eb-b1ac-4c907393b0be service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:01.623168 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-63d860ea-8d55-41eb-b1ac-4c907393b0be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:05:01.706159 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d860ea-8d55-41eb-b1ac-4c907393b0be service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:01.711798 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6cb94-7144-4925-9e08-1c6329e8aa09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:01.712414 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6cb94-7144-4925-9e08-1c6329e8aa09 service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:01.712691 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6cb94-7144-4925-9e08-1c6329e8aa09 service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:01.712991 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6cb94-7144-4925-9e08-1c6329e8aa09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:01.724552 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc6cb94-7144-4925-9e08-1c6329e8aa09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:01.726281 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc6cb94-7144-4925-9e08-1c6329e8aa09 service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:01.736471 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1327/2617] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:05:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:05:03.030429 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b79a7e-1131-4af7-8bba-d8acaa3b0679 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:03.031413 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b79a7e-1131-4af7-8bba-d8acaa3b0679 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:03.032026 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b79a7e-1131-4af7-8bba-d8acaa3b0679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:03.054598 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-78b79a7e-1131-4af7-8bba-d8acaa3b0679 None None] MFA Rules not processed for user `090157a7cd154d3aa6e3466b4f3f8cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:05:03.055996 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-78b79a7e-1131-4af7-8bba-d8acaa3b0679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:05:03.063882 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1291/2618] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:05:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:05:06.654021 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6cb94-7144-4925-9e08-1c6329e8aa09 service nova] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:06.656387 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-1bc6cb94-7144-4925-9e08-1c6329e8aa09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:05:06.675828 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6cb94-7144-4925-9e08-1c6329e8aa09 service nova] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:06.684181 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ddaa77-6780-4742-b86a-5dce8f58163c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:06.684797 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddaa77-6780-4742-b86a-5dce8f58163c service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:06.685098 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddaa77-6780-4742-b86a-5dce8f58163c service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:06.685766 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddaa77-6780-4742-b86a-5dce8f58163c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:06.689831 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-26ddaa77-6780-4742-b86a-5dce8f58163c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:05:06.704480 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ddaa77-6780-4742-b86a-5dce8f58163c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:06.706134 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ddaa77-6780-4742-b86a-5dce8f58163c service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:06.730389 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1328/2619] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:05:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:05:11.957496 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b79a7e-1131-4af7-8bba-d8acaa3b0679 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:11.972654 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b79a7e-1131-4af7-8bba-d8acaa3b0679 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:11.978422 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c693b6-4994-40e8-b2d5-5c18ca3e2a96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:11.979599 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c693b6-4994-40e8-b2d5-5c18ca3e2a96 service nova] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:11.979599 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c693b6-4994-40e8-b2d5-5c18ca3e2a96 service nova] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:11.979599 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c693b6-4994-40e8-b2d5-5c18ca3e2a96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:11.981471 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-28c693b6-4994-40e8-b2d5-5c18ca3e2a96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:05:11.994467 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c693b6-4994-40e8-b2d5-5c18ca3e2a96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:11.996068 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c693b6-4994-40e8-b2d5-5c18ca3e2a96 service nova] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:12.010382 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1292/2620] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:05:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:05:16.712701 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=60 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:20.157661 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ddaa77-6780-4742-b86a-5dce8f58163c service nova] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:20.168153 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ddaa77-6780-4742-b86a-5dce8f58163c service nova] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:20.171969 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aba259-3b6c-4887-9456-8aede25fe535 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:20.172667 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aba259-3b6c-4887-9456-8aede25fe535 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:20.173069 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aba259-3b6c-4887-9456-8aede25fe535 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:20.173411 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aba259-3b6c-4887-9456-8aede25fe535 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:20.175300 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-76aba259-3b6c-4887-9456-8aede25fe535 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:05:20.186117 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aba259-3b6c-4887-9456-8aede25fe535 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:20.187735 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aba259-3b6c-4887-9456-8aede25fe535 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:20.196305 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1329/2621] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:05:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:05:20.320559 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d97942-f44d-4d9d-bdd7-aaf6fe3c4140 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:20.321159 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d97942-f44d-4d9d-bdd7-aaf6fe3c4140 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:20.321269 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d97942-f44d-4d9d-bdd7-aaf6fe3c4140 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:20.322647 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1293/2622] 10.222.0.25 () {54 vars in 921 bytes} [Tue Aug 30 16:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:05:20.329377 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240adafc-7697-449e-b174-e7f03ab12f1f None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:20.329664 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240adafc-7697-449e-b174-e7f03ab12f1f None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:20.329934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240adafc-7697-449e-b174-e7f03ab12f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:20.353076 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-240adafc-7697-449e-b174-e7f03ab12f1f None None] MFA Rules not processed for user `48c49f6751d14526a0954797d9ab6a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:05:20.354289 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-240adafc-7697-449e-b174-e7f03ab12f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:05:20.361110 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1330/2623] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Aug 30 16:05:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:05:20.373072 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d97942-f44d-4d9d-bdd7-aaf6fe3c4140 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:20.374867 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-09d97942-f44d-4d9d-bdd7-aaf6fe3c4140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:05:20.389390 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d97942-f44d-4d9d-bdd7-aaf6fe3c4140 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:20.393125 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca28460-4e8f-46aa-b473-ab7ca695dba8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:20.393802 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca28460-4e8f-46aa-b473-ab7ca695dba8 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:20.394089 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca28460-4e8f-46aa-b473-ab7ca695dba8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:20.394369 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca28460-4e8f-46aa-b473-ab7ca695dba8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:20.401745 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca28460-4e8f-46aa-b473-ab7ca695dba8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:20.403788 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca28460-4e8f-46aa-b473-ab7ca695dba8 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:20.411927 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1294/2624] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:05:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:05:20.497461 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f772b6-9687-4537-a4e1-221e1f54f8ec None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:20.497750 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f772b6-9687-4537-a4e1-221e1f54f8ec None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:20.498027 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f772b6-9687-4537-a4e1-221e1f54f8ec None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:20.499381 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1331/2625] 10.222.0.25 () {54 vars in 921 bytes} [Tue Aug 30 16:05:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:05:20.505226 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f75237-1c08-45a3-bc1a-0811b8d7a383 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:20.505514 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f75237-1c08-45a3-bc1a-0811b8d7a383 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:20.505790 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f75237-1c08-45a3-bc1a-0811b8d7a383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:20.525946 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-68f75237-1c08-45a3-bc1a-0811b8d7a383 None None] MFA Rules not processed for user `ebc80bf891614fb895af33ca1ded6b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:05:20.527213 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-68f75237-1c08-45a3-bc1a-0811b8d7a383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:05:20.536476 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1295/2626] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Aug 30 16:05:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:05:20.546756 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f772b6-9687-4537-a4e1-221e1f54f8ec None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:20.557798 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f772b6-9687-4537-a4e1-221e1f54f8ec None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:20.562046 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e34ff2-d3e0-4e1b-bd23-f081068a2995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:20.562640 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e34ff2-d3e0-4e1b-bd23-f081068a2995 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:20.562919 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e34ff2-d3e0-4e1b-bd23-f081068a2995 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:20.563191 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e34ff2-d3e0-4e1b-bd23-f081068a2995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:20.573626 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e34ff2-d3e0-4e1b-bd23-f081068a2995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:20.575673 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e34ff2-d3e0-4e1b-bd23-f081068a2995 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:20.586307 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1332/2627] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:05:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:05:30.520992 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=93,keystone:INSERT=3 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:30.581652 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=15 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:45.218986 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d05396-1d4c-41af-9851-e7546a5ea0fb None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:45.219505 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d05396-1d4c-41af-9851-e7546a5ea0fb None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:45.219505 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d05396-1d4c-41af-9851-e7546a5ea0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:45.238894 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-58d05396-1d4c-41af-9851-e7546a5ea0fb None None] MFA Rules not processed for user `d7958b395d5e4f5da37927536b1856ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:05:45.240074 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-58d05396-1d4c-41af-9851-e7546a5ea0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:05:45.295495 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1296/2628] 10.222.0.25 () {58 vars in 967 bytes} [Tue Aug 30 16:05:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:05:45.334875 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e34ff2-d3e0-4e1b-bd23-f081068a2995 service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:45.336301 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-72e34ff2-d3e0-4e1b-bd23-f081068a2995 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:05:45.405595 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e34ff2-d3e0-4e1b-bd23-f081068a2995 service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:45.410521 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05186470-0296-4555-a50d-afe176ca88f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94765f224c734beabe83b4dc0c5e511f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:45.411124 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05186470-0296-4555-a50d-afe176ca88f4 service swift] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:45.411401 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05186470-0296-4555-a50d-afe176ca88f4 service swift] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:45.411668 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05186470-0296-4555-a50d-afe176ca88f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:45.420205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05186470-0296-4555-a50d-afe176ca88f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:45.421801 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05186470-0296-4555-a50d-afe176ca88f4 service swift] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:45.429749 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1333/2629] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Aug 30 16:05:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 16:05:51.849218 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad700e8-d633-44dc-a9cd-79eb765b26f9 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:51.851364 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad700e8-d633-44dc-a9cd-79eb765b26f9 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:51.851364 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad700e8-d633-44dc-a9cd-79eb765b26f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:51.873282 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-cad700e8-d633-44dc-a9cd-79eb765b26f9 None None] MFA Rules not processed for user `d7958b395d5e4f5da37927536b1856ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:05:51.875045 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-cad700e8-d633-44dc-a9cd-79eb765b26f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:05:51.892074 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1297/2630] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Aug 30 16:05:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:05:51.904117 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05186470-0296-4555-a50d-afe176ca88f4 service swift] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:51.922636 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05186470-0296-4555-a50d-afe176ca88f4 service swift] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:51.929784 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac9a99-e08b-4c81-9eae-a1af355a99a3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94765f224c734beabe83b4dc0c5e511f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:51.930414 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac9a99-e08b-4c81-9eae-a1af355a99a3 service swift] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:51.930691 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac9a99-e08b-4c81-9eae-a1af355a99a3 service swift] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:51.930962 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac9a99-e08b-4c81-9eae-a1af355a99a3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:51.940600 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac9a99-e08b-4c81-9eae-a1af355a99a3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:51.942734 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac9a99-e08b-4c81-9eae-a1af355a99a3 service swift] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:51.955294 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1334/2631] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Aug 30 16:05:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 16:05:52.099081 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad700e8-d633-44dc-a9cd-79eb765b26f9 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:52.100540 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-cad700e8-d633-44dc-a9cd-79eb765b26f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:05:52.134470 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad700e8-d633-44dc-a9cd-79eb765b26f9 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:52.151545 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88437e0-0f7d-45aa-ae4e-f4c551ce704f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:52.152667 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88437e0-0f7d-45aa-ae4e-f4c551ce704f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:52.152986 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88437e0-0f7d-45aa-ae4e-f4c551ce704f admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:52.153255 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88437e0-0f7d-45aa-ae4e-f4c551ce704f admin admin] PATH_INFO: `/v3/users/956b16fc956f4ffaa0863093a9637cdc` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:52.157802 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88437e0-0f7d-45aa-ae4e-f4c551ce704f admin admin] RBAC: Authorizing `identity:delete_user(user_id=956b16fc956f4ffaa0863093a9637cdc)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:52.160027 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88437e0-0f7d-45aa-ae4e-f4c551ce704f admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:52.283938 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-f88437e0-0f7d-45aa-ae4e-f4c551ce704f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '956b16fc956f4ffaa0863093a9637cdc'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:05:52.327520 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-f88437e0-0f7d-45aa-ae4e-f4c551ce704f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '956b16fc956f4ffaa0863093a9637cdc'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:05:52.328743 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-f88437e0-0f7d-45aa-ae4e-f4c551ce704f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '956b16fc956f4ffaa0863093a9637cdc'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:05:52.329777 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-f88437e0-0f7d-45aa-ae4e-f4c551ce704f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '956b16fc956f4ffaa0863093a9637cdc'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:05:52.350158 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-f88437e0-0f7d-45aa-ae4e-f4c551ce704f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '956b16fc956f4ffaa0863093a9637cdc'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:05:52.389913 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1298/2632] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:05:52 2022] DELETE /identity/v3/users/956b16fc956f4ffaa0863093a9637cdc => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:05:52.662023 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac9a99-e08b-4c81-9eae-a1af355a99a3 service swift] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:52.681337 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac9a99-e08b-4c81-9eae-a1af355a99a3 service swift] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:52.784269 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e14b8-879d-4b6b-b271-afffce995b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:52.786179 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e14b8-879d-4b6b-b271-afffce995b2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:52.787295 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e14b8-879d-4b6b-b271-afffce995b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:52.787725 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e14b8-879d-4b6b-b271-afffce995b2f admin admin] PATH_INFO: `/v3/projects/b59ace9d7dec4b3895bdb94676ae8936` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:52.789855 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e14b8-879d-4b6b-b271-afffce995b2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b59ace9d7dec4b3895bdb94676ae8936)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:52.792846 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e14b8-879d-4b6b-b271-afffce995b2f admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:52.872742 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-124e14b8-879d-4b6b-b271-afffce995b2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b59ace9d7dec4b3895bdb94676ae8936', 'request_id': 'req-124e14b8-879d-4b6b-b271-afffce995b2f'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:05:52.883665 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-124e14b8-879d-4b6b-b271-afffce995b2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b59ace9d7dec4b3895bdb94676ae8936', 'request_id': 'req-124e14b8-879d-4b6b-b271-afffce995b2f'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:05:52.891806 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-124e14b8-879d-4b6b-b271-afffce995b2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b59ace9d7dec4b3895bdb94676ae8936', 'request_id': 'req-124e14b8-879d-4b6b-b271-afffce995b2f'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:05:52.904138 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-124e14b8-879d-4b6b-b271-afffce995b2f admin admin] The token cache is being invalidate because project b59ace9d7dec4b3895bdb94676ae8936 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:05:52.904811 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-124e14b8-879d-4b6b-b271-afffce995b2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:05:52.905116 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-124e14b8-879d-4b6b-b271-afffce995b2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:05:52.906661 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1335/2633] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:05:52 2022] DELETE /identity/v3/projects/b59ace9d7dec4b3895bdb94676ae8936 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:05:52.910824 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88437e0-0f7d-45aa-ae4e-f4c551ce704f admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:52.912396 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-f88437e0-0f7d-45aa-ae4e-f4c551ce704f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:05:52.926741 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88437e0-0f7d-45aa-ae4e-f4c551ce704f admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:52.998240 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a30ee8-4526-4e81-b81b-96694995e73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:52.999197 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a30ee8-4526-4e81-b81b-96694995e73b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:52.999746 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a30ee8-4526-4e81-b81b-96694995e73b admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:53.000008 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a30ee8-4526-4e81-b81b-96694995e73b admin admin] PATH_INFO: `/v3/users/612982b6c9554c0eb8e31804f595e36a` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:53.001200 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a30ee8-4526-4e81-b81b-96694995e73b admin admin] RBAC: Authorizing `identity:delete_user(user_id=612982b6c9554c0eb8e31804f595e36a)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:53.003327 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a30ee8-4526-4e81-b81b-96694995e73b admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:53.018198 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:53.063478 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-d8a30ee8-4526-4e81-b81b-96694995e73b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '612982b6c9554c0eb8e31804f595e36a'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:05:53.077509 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-d8a30ee8-4526-4e81-b81b-96694995e73b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '612982b6c9554c0eb8e31804f595e36a'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:05:53.078241 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-d8a30ee8-4526-4e81-b81b-96694995e73b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '612982b6c9554c0eb8e31804f595e36a'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:05:53.078858 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-d8a30ee8-4526-4e81-b81b-96694995e73b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '612982b6c9554c0eb8e31804f595e36a'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:05:53.089262 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-d8a30ee8-4526-4e81-b81b-96694995e73b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '612982b6c9554c0eb8e31804f595e36a'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:05:53.109386 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1299/2634] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:05:52 2022] DELETE /identity/v3/users/612982b6c9554c0eb8e31804f595e36a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:05:53.306103 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e14b8-879d-4b6b-b271-afffce995b2f admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:53.308290 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-124e14b8-879d-4b6b-b271-afffce995b2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:05:53.325795 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e14b8-879d-4b6b-b271-afffce995b2f admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:53.331130 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:53.402137 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e2574-461c-4acc-8074-6c856ea10e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:53.402791 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e2574-461c-4acc-8074-6c856ea10e39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:53.403075 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e2574-461c-4acc-8074-6c856ea10e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:53.403353 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e2574-461c-4acc-8074-6c856ea10e39 admin admin] PATH_INFO: `/v3/projects/01d2bf363306425883da0c0fe059cb6c` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:53.404506 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e2574-461c-4acc-8074-6c856ea10e39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01d2bf363306425883da0c0fe059cb6c)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:53.406467 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e2574-461c-4acc-8074-6c856ea10e39 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:53.478664 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f35e2574-461c-4acc-8074-6c856ea10e39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01d2bf363306425883da0c0fe059cb6c', 'request_id': 'req-f35e2574-461c-4acc-8074-6c856ea10e39'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:05:53.492758 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f35e2574-461c-4acc-8074-6c856ea10e39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01d2bf363306425883da0c0fe059cb6c', 'request_id': 'req-f35e2574-461c-4acc-8074-6c856ea10e39'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:05:53.501200 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f35e2574-461c-4acc-8074-6c856ea10e39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01d2bf363306425883da0c0fe059cb6c', 'request_id': 'req-f35e2574-461c-4acc-8074-6c856ea10e39'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:05:53.517151 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f35e2574-461c-4acc-8074-6c856ea10e39 admin admin] The token cache is being invalidate because project 01d2bf363306425883da0c0fe059cb6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:05:53.517438 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f35e2574-461c-4acc-8074-6c856ea10e39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:05:53.518105 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f35e2574-461c-4acc-8074-6c856ea10e39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:05:53.519990 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1336/2635] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:05:53 2022] DELETE /identity/v3/projects/01d2bf363306425883da0c0fe059cb6c => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:06:03.101889 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=22,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:03.513738 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=48,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:04.677029 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18265068-9518-46ef-a2eb-cfc4fe94737a None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:06:04.677507 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18265068-9518-46ef-a2eb-cfc4fe94737a None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:06:04.677619 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18265068-9518-46ef-a2eb-cfc4fe94737a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:06:04.696851 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-18265068-9518-46ef-a2eb-cfc4fe94737a None None] MFA Rules not processed for user `090157a7cd154d3aa6e3466b4f3f8cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:06:04.698046 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-18265068-9518-46ef-a2eb-cfc4fe94737a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:06:04.756972 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1300/2636] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:06:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:06:05.483992 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e2134-1fb3-46bd-bbef-57972bec7931 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:06:05.484510 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e2134-1fb3-46bd-bbef-57972bec7931 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:06:05.484662 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e2134-1fb3-46bd-bbef-57972bec7931 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:06:05.485922 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1337/2637] 10.222.0.25 () {54 vars in 921 bytes} [Tue Aug 30 16:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:06:05.491439 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ec797-653c-421b-9c87-783f40add157 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:06:05.491799 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ec797-653c-421b-9c87-783f40add157 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:06:05.492146 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ec797-653c-421b-9c87-783f40add157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:06:05.523367 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-bf4ec797-653c-421b-9c87-783f40add157 None None] MFA Rules not processed for user `ebc80bf891614fb895af33ca1ded6b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:06:05.524713 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-bf4ec797-653c-421b-9c87-783f40add157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:06:05.609386 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1301/2638] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Aug 30 16:06:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:06:05.621485 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e2134-1fb3-46bd-bbef-57972bec7931 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:06:05.623314 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-6b1e2134-1fb3-46bd-bbef-57972bec7931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:06:05.685788 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e2134-1fb3-46bd-bbef-57972bec7931 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:06:05.689333 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902428c5-c18c-4409-a6e8-7cf03846b800 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9bd815f8fe54d7d99e00a47212ad9ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:06:05.689939 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902428c5-c18c-4409-a6e8-7cf03846b800 service glance] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:06:05.690215 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902428c5-c18c-4409-a6e8-7cf03846b800 service glance] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:06:05.690485 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902428c5-c18c-4409-a6e8-7cf03846b800 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:06:05.701308 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902428c5-c18c-4409-a6e8-7cf03846b800 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:06:05.702725 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902428c5-c18c-4409-a6e8-7cf03846b800 service glance] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:06:05.713566 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1338/2639] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:06:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:06:08.517825 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b0f55-8672-4cab-bc72-6211ea602c5b None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:06:08.518290 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b0f55-8672-4cab-bc72-6211ea602c5b None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:06:08.518425 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b0f55-8672-4cab-bc72-6211ea602c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:06:08.538180 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-1b2b0f55-8672-4cab-bc72-6211ea602c5b None None] MFA Rules not processed for user `d7958b395d5e4f5da37927536b1856ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:06:08.539397 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-1b2b0f55-8672-4cab-bc72-6211ea602c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:06:08.600656 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1302/2640] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Aug 30 16:06:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:06:08.613620 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902428c5-c18c-4409-a6e8-7cf03846b800 service glance] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:06:08.615056 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-902428c5-c18c-4409-a6e8-7cf03846b800 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:06:08.684016 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902428c5-c18c-4409-a6e8-7cf03846b800 service glance] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:06:08.689389 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609144f5-63f8-4747-b294-957318f422ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94765f224c734beabe83b4dc0c5e511f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:06:08.690006 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609144f5-63f8-4747-b294-957318f422ae service swift] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:06:08.690264 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609144f5-63f8-4747-b294-957318f422ae service swift] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:06:08.690529 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609144f5-63f8-4747-b294-957318f422ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:06:08.698653 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609144f5-63f8-4747-b294-957318f422ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:06:08.700957 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609144f5-63f8-4747-b294-957318f422ae service swift] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:06:08.708884 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1339/2641] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Aug 30 16:06:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 16:06:18.591819 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=81 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:18.705765 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=58 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:24.531207 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac415735-31d8-448e-b586-dcf8b226e1ba None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:06:24.531688 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac415735-31d8-448e-b586-dcf8b226e1ba None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:06:24.531794 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac415735-31d8-448e-b586-dcf8b226e1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:06:24.553324 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-ac415735-31d8-448e-b586-dcf8b226e1ba None None] MFA Rules not processed for user `d7958b395d5e4f5da37927536b1856ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:06:24.554530 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-ac415735-31d8-448e-b586-dcf8b226e1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:06:24.562609 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1303/2642] 10.222.0.25 () {58 vars in 967 bytes} [Tue Aug 30 16:06:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:06:24.577018 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609144f5-63f8-4747-b294-957318f422ae service swift] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:06:24.587458 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609144f5-63f8-4747-b294-957318f422ae service swift] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:06:24.593620 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd34f82-d8a8-4bee-b1ea-1a39e9e0cc22 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94765f224c734beabe83b4dc0c5e511f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:06:24.594408 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd34f82-d8a8-4bee-b1ea-1a39e9e0cc22 service swift] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:06:24.594693 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd34f82-d8a8-4bee-b1ea-1a39e9e0cc22 service swift] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:06:24.594967 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd34f82-d8a8-4bee-b1ea-1a39e9e0cc22 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:06:24.604487 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd34f82-d8a8-4bee-b1ea-1a39e9e0cc22 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:06:24.606677 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd34f82-d8a8-4bee-b1ea-1a39e9e0cc22 service swift] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:06:24.615953 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1340/2643] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Aug 30 16:06:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 16:06:34.547674 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=3 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:34.612215 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=6 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:49.821710 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac415735-31d8-448e-b586-dcf8b226e1ba None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:06:49.823175 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-ac415735-31d8-448e-b586-dcf8b226e1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:06:49.839094 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac415735-31d8-448e-b586-dcf8b226e1ba None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:06:49.845084 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e1506-f65f-426a-8e12-cf3374a71361 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:06:49.845657 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e1506-f65f-426a-8e12-cf3374a71361 service nova] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:06:49.845937 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e1506-f65f-426a-8e12-cf3374a71361 service nova] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:06:49.846202 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e1506-f65f-426a-8e12-cf3374a71361 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:06:49.847955 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-056e1506-f65f-426a-8e12-cf3374a71361 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:06:49.861451 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e1506-f65f-426a-8e12-cf3374a71361 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:06:49.863042 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e1506-f65f-426a-8e12-cf3374a71361 service nova] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:06:49.874399 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1304/2644] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:06:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:06:57.943332 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd34f82-d8a8-4bee-b1ea-1a39e9e0cc22 service swift] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:06:57.945026 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-4bd34f82-d8a8-4bee-b1ea-1a39e9e0cc22 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:06:58.003248 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e1506-f65f-426a-8e12-cf3374a71361 service nova] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:06:58.004692 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-056e1506-f65f-426a-8e12-cf3374a71361 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:06:58.039803 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd34f82-d8a8-4bee-b1ea-1a39e9e0cc22 service swift] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:06:58.045337 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8306385-dd8c-41b5-bd57-d53431d3b9ce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bba851e1a0d4601b5d4841662f645dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:06:58.045957 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8306385-dd8c-41b5-bd57-d53431d3b9ce service placement] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:06:58.046239 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8306385-dd8c-41b5-bd57-d53431d3b9ce service placement] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:06:58.046529 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8306385-dd8c-41b5-bd57-d53431d3b9ce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:06:58.048317 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-e8306385-dd8c-41b5-bd57-d53431d3b9ce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:06:58.060301 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8306385-dd8c-41b5-bd57-d53431d3b9ce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:06:58.061905 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8306385-dd8c-41b5-bd57-d53431d3b9ce service placement] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:06:58.072356 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1341/2645] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:06:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:06:58.080125 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e1506-f65f-426a-8e12-cf3374a71361 service nova] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:06:58.084931 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88cbcf3-8468-4b3c-b343-673df7e7de89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:06:58.085579 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cbcf3-8468-4b3c-b343-673df7e7de89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:06:58.085866 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cbcf3-8468-4b3c-b343-673df7e7de89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:06:58.086141 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cbcf3-8468-4b3c-b343-673df7e7de89 admin admin] PATH_INFO: `/v3/users/d249e88d0d3944f482b26914ca4ea65e` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:06:58.087336 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88cbcf3-8468-4b3c-b343-673df7e7de89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d249e88d0d3944f482b26914ca4ea65e)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:06:58.089301 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88cbcf3-8468-4b3c-b343-673df7e7de89 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:06:58.136000 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-c88cbcf3-8468-4b3c-b343-673df7e7de89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd249e88d0d3944f482b26914ca4ea65e'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:06:58.147966 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-c88cbcf3-8468-4b3c-b343-673df7e7de89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd249e88d0d3944f482b26914ca4ea65e'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:06:58.148633 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-c88cbcf3-8468-4b3c-b343-673df7e7de89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd249e88d0d3944f482b26914ca4ea65e'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:06:58.149271 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-c88cbcf3-8468-4b3c-b343-673df7e7de89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd249e88d0d3944f482b26914ca4ea65e'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:06:58.157200 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-c88cbcf3-8468-4b3c-b343-673df7e7de89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd249e88d0d3944f482b26914ca4ea65e'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:06:58.169294 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1305/2646] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:06:58 2022] DELETE /identity/v3/users/d249e88d0d3944f482b26914ca4ea65e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:06:58.344188 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8306385-dd8c-41b5-bd57-d53431d3b9ce service placement] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:06:58.357324 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8306385-dd8c-41b5-bd57-d53431d3b9ce service placement] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:06:58.543145 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d3240-c985-409a-9c1c-29578034a056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:06:58.543628 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d3240-c985-409a-9c1c-29578034a056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:06:58.543899 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d3240-c985-409a-9c1c-29578034a056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:06:58.544162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d3240-c985-409a-9c1c-29578034a056 admin admin] PATH_INFO: `/v3/projects/f1592085bae240919c3441fd37778228` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:06:58.545295 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d3240-c985-409a-9c1c-29578034a056 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1592085bae240919c3441fd37778228)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:06:58.547236 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d3240-c985-409a-9c1c-29578034a056 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:06:58.592974 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a65d3240-c985-409a-9c1c-29578034a056 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1592085bae240919c3441fd37778228', 'request_id': 'req-a65d3240-c985-409a-9c1c-29578034a056'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:06:58.599805 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a65d3240-c985-409a-9c1c-29578034a056 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1592085bae240919c3441fd37778228', 'request_id': 'req-a65d3240-c985-409a-9c1c-29578034a056'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:06:58.606161 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a65d3240-c985-409a-9c1c-29578034a056 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1592085bae240919c3441fd37778228', 'request_id': 'req-a65d3240-c985-409a-9c1c-29578034a056'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:06:58.616369 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a65d3240-c985-409a-9c1c-29578034a056 admin admin] The token cache is being invalidate because project f1592085bae240919c3441fd37778228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:06:58.616656 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a65d3240-c985-409a-9c1c-29578034a056 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:06:58.617309 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a65d3240-c985-409a-9c1c-29578034a056 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:06:58.618887 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1342/2647] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:06:58 2022] DELETE /identity/v3/projects/f1592085bae240919c3441fd37778228 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:06:58.623547 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88cbcf3-8468-4b3c-b343-673df7e7de89 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:06:58.624983 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-c88cbcf3-8468-4b3c-b343-673df7e7de89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:06:58.639362 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88cbcf3-8468-4b3c-b343-673df7e7de89 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:06:58.702705 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb5cec-798e-4f6a-aab1-81f005cfb5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:06:58.703350 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb5cec-798e-4f6a-aab1-81f005cfb5c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:06:58.703630 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb5cec-798e-4f6a-aab1-81f005cfb5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:06:58.703903 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb5cec-798e-4f6a-aab1-81f005cfb5c2 admin admin] PATH_INFO: `/v3/users/3b2cc89ac50b43e9af2e0e010e9fb688` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:06:58.705117 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb5cec-798e-4f6a-aab1-81f005cfb5c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b2cc89ac50b43e9af2e0e010e9fb688)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:06:58.707062 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb5cec-798e-4f6a-aab1-81f005cfb5c2 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:06:58.713558 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:58.764878 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-01bb5cec-798e-4f6a-aab1-81f005cfb5c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b2cc89ac50b43e9af2e0e010e9fb688'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:06:58.776486 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-01bb5cec-798e-4f6a-aab1-81f005cfb5c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b2cc89ac50b43e9af2e0e010e9fb688'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:06:58.777241 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-01bb5cec-798e-4f6a-aab1-81f005cfb5c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b2cc89ac50b43e9af2e0e010e9fb688'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:06:58.777992 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-01bb5cec-798e-4f6a-aab1-81f005cfb5c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b2cc89ac50b43e9af2e0e010e9fb688'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:06:58.785391 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-01bb5cec-798e-4f6a-aab1-81f005cfb5c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b2cc89ac50b43e9af2e0e010e9fb688'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:06:58.798911 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1306/2648] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:06:58 2022] DELETE /identity/v3/users/3b2cc89ac50b43e9af2e0e010e9fb688 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:06:58.968374 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d3240-c985-409a-9c1c-29578034a056 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:06:58.969881 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-a65d3240-c985-409a-9c1c-29578034a056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:06:58.984068 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d3240-c985-409a-9c1c-29578034a056 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:06:59.001270 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:59.042392 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a9c71-0d77-4e6f-abcb-442a1f711f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:06:59.043080 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a9c71-0d77-4e6f-abcb-442a1f711f9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:06:59.043340 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a9c71-0d77-4e6f-abcb-442a1f711f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:06:59.043635 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a9c71-0d77-4e6f-abcb-442a1f711f9f admin admin] PATH_INFO: `/v3/projects/839f5f57317141c0b36239d90759d67c` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:06:59.044756 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4a9c71-0d77-4e6f-abcb-442a1f711f9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=839f5f57317141c0b36239d90759d67c)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:06:59.046704 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4a9c71-0d77-4e6f-abcb-442a1f711f9f admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:06:59.091664 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-9e4a9c71-0d77-4e6f-abcb-442a1f711f9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '839f5f57317141c0b36239d90759d67c', 'request_id': 'req-9e4a9c71-0d77-4e6f-abcb-442a1f711f9f'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:06:59.098710 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-9e4a9c71-0d77-4e6f-abcb-442a1f711f9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '839f5f57317141c0b36239d90759d67c', 'request_id': 'req-9e4a9c71-0d77-4e6f-abcb-442a1f711f9f'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:06:59.104692 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-9e4a9c71-0d77-4e6f-abcb-442a1f711f9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '839f5f57317141c0b36239d90759d67c', 'request_id': 'req-9e4a9c71-0d77-4e6f-abcb-442a1f711f9f'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:06:59.115009 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-9e4a9c71-0d77-4e6f-abcb-442a1f711f9f admin admin] The token cache is being invalidate because project 839f5f57317141c0b36239d90759d67c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:06:59.115302 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-9e4a9c71-0d77-4e6f-abcb-442a1f711f9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:06:59.115945 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-9e4a9c71-0d77-4e6f-abcb-442a1f711f9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:06:59.117426 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1343/2649] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:06:58 2022] DELETE /identity/v3/projects/839f5f57317141c0b36239d90759d67c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:07:08.795293 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:09.112070 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:09.352323 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a267f09-3c7d-4ba1-91dc-68f96ad1e490 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:09.352609 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a267f09-3c7d-4ba1-91dc-68f96ad1e490 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:09.352923 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a267f09-3c7d-4ba1-91dc-68f96ad1e490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:09.373393 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-8a267f09-3c7d-4ba1-91dc-68f96ad1e490 None None] MFA Rules not processed for user `784ffb9dd49449358524fa67a5eeca4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:07:09.374667 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-8a267f09-3c7d-4ba1-91dc-68f96ad1e490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:07:09.428679 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1307/2650] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:07:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:07:16.011855 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b9011-8c57-41bf-8af0-d2b1315e6a67 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:16.012339 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b9011-8c57-41bf-8af0-d2b1315e6a67 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:16.012585 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b9011-8c57-41bf-8af0-d2b1315e6a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:16.032165 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-ce4b9011-8c57-41bf-8af0-d2b1315e6a67 None None] MFA Rules not processed for user `090157a7cd154d3aa6e3466b4f3f8cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:07:16.033553 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-ce4b9011-8c57-41bf-8af0-d2b1315e6a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:07:16.088363 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1344/2651] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:07:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:07:19.422063 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=25 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:26.081689 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=25 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:13.226587 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a267f09-3c7d-4ba1-91dc-68f96ad1e490 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:08:13.228734 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-8a267f09-3c7d-4ba1-91dc-68f96ad1e490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:08:13.381695 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a267f09-3c7d-4ba1-91dc-68f96ad1e490 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:08:13.387424 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e8d11-91d5-4124-ba26-27a1038b2ec6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bba851e1a0d4601b5d4841662f645dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:08:13.388027 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e8d11-91d5-4124-ba26-27a1038b2ec6 service placement] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:08:13.388302 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e8d11-91d5-4124-ba26-27a1038b2ec6 service placement] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:08:13.388568 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e8d11-91d5-4124-ba26-27a1038b2ec6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:08:13.390346 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-373e8d11-91d5-4124-ba26-27a1038b2ec6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:08:13.402277 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e8d11-91d5-4124-ba26-27a1038b2ec6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:08:13.403880 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e8d11-91d5-4124-ba26-27a1038b2ec6 service placement] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:08:13.413717 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1308/2652] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:08:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:08:17.151413 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31317f6e-77fc-4f2e-9341-70a4a158c854 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:08:17.152364 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31317f6e-77fc-4f2e-9341-70a4a158c854 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:08:17.152874 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31317f6e-77fc-4f2e-9341-70a4a158c854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:08:17.173158 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-31317f6e-77fc-4f2e-9341-70a4a158c854 None None] MFA Rules not processed for user `090157a7cd154d3aa6e3466b4f3f8cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:08:17.174363 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-31317f6e-77fc-4f2e-9341-70a4a158c854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:08:17.185718 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1345/2653] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:08:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:08:17.923204 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221abfb8-2893-4271-97c0-cc47e964dc93 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:08:17.923680 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221abfb8-2893-4271-97c0-cc47e964dc93 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:08:17.923784 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221abfb8-2893-4271-97c0-cc47e964dc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:08:17.963673 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-221abfb8-2893-4271-97c0-cc47e964dc93 None None] MFA Rules not processed for user `d7958b395d5e4f5da37927536b1856ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:08:17.965029 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-221abfb8-2893-4271-97c0-cc47e964dc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:08:18.036831 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1309/2654] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Aug 30 16:08:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:08:18.083814 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31317f6e-77fc-4f2e-9341-70a4a158c854 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:08:18.085253 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-31317f6e-77fc-4f2e-9341-70a4a158c854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:08:18.156568 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31317f6e-77fc-4f2e-9341-70a4a158c854 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:08:18.161798 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca136b8-46b6-4ef2-9a19-02c8c55ae3c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94765f224c734beabe83b4dc0c5e511f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:08:18.162416 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca136b8-46b6-4ef2-9a19-02c8c55ae3c1 service swift] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:08:18.162696 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca136b8-46b6-4ef2-9a19-02c8c55ae3c1 service swift] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:08:18.162970 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca136b8-46b6-4ef2-9a19-02c8c55ae3c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:08:18.171488 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca136b8-46b6-4ef2-9a19-02c8c55ae3c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:08:18.173131 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca136b8-46b6-4ef2-9a19-02c8c55ae3c1 service swift] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:08:18.183816 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1346/2655] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Aug 30 16:08:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 16:08:28.028459 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=95 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:28.178671 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=35 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:34.899960 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d461f3-546f-41bb-b995-18443c6355a6 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:08:34.900489 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d461f3-546f-41bb-b995-18443c6355a6 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:08:34.900661 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d461f3-546f-41bb-b995-18443c6355a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:08:34.920571 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-c5d461f3-546f-41bb-b995-18443c6355a6 None None] MFA Rules not processed for user `d7958b395d5e4f5da37927536b1856ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:08:34.921801 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-c5d461f3-546f-41bb-b995-18443c6355a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:08:34.928818 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1310/2656] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Aug 30 16:08:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:08:34.941591 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca136b8-46b6-4ef2-9a19-02c8c55ae3c1 service swift] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:08:34.952212 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca136b8-46b6-4ef2-9a19-02c8c55ae3c1 service swift] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:08:34.957378 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715e690-fe78-4c83-aba2-feac5a37b269 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94765f224c734beabe83b4dc0c5e511f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:08:34.958073 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715e690-fe78-4c83-aba2-feac5a37b269 service swift] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:08:34.958417 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715e690-fe78-4c83-aba2-feac5a37b269 service swift] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:08:34.958696 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715e690-fe78-4c83-aba2-feac5a37b269 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:08:34.967061 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715e690-fe78-4c83-aba2-feac5a37b269 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:08:34.968631 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715e690-fe78-4c83-aba2-feac5a37b269 service swift] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:08:34.976725 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1347/2657] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Aug 30 16:08:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 16:08:44.914187 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=3 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:44.973332 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=6 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:48.445238 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c31b6-d237-4245-9fa2-695e707eca23 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:08:48.445694 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c31b6-d237-4245-9fa2-695e707eca23 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:08:48.445800 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c31b6-d237-4245-9fa2-695e707eca23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:08:48.470852 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-ad9c31b6-d237-4245-9fa2-695e707eca23 None None] MFA Rules not processed for user `d7958b395d5e4f5da37927536b1856ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:08:48.472043 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-ad9c31b6-d237-4245-9fa2-695e707eca23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:08:48.479128 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1311/2658] 10.222.0.25 () {58 vars in 967 bytes} [Tue Aug 30 16:08:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:08:48.491229 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715e690-fe78-4c83-aba2-feac5a37b269 service swift] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:08:48.502668 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715e690-fe78-4c83-aba2-feac5a37b269 service swift] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:08:48.507628 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0da97-a86c-49e3-8350-d11e46939b63 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94765f224c734beabe83b4dc0c5e511f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:08:48.508225 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0da97-a86c-49e3-8350-d11e46939b63 service swift] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:08:48.508504 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0da97-a86c-49e3-8350-d11e46939b63 service swift] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:08:48.508857 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0da97-a86c-49e3-8350-d11e46939b63 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:08:48.517769 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a0da97-a86c-49e3-8350-d11e46939b63 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:08:48.519363 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a0da97-a86c-49e3-8350-d11e46939b63 service swift] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:08:48.528410 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1348/2659] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Aug 30 16:08:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 16:08:58.465513 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=3 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:58.524664 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=6 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:22.873165 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c31b6-d237-4245-9fa2-695e707eca23 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:22.874632 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-ad9c31b6-d237-4245-9fa2-695e707eca23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:22.957397 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c31b6-d237-4245-9fa2-695e707eca23 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:22.961072 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33ee42-6332-465d-98d8-b09817f19404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:22.962304 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33ee42-6332-465d-98d8-b09817f19404 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:22.962579 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33ee42-6332-465d-98d8-b09817f19404 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:22.962847 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33ee42-6332-465d-98d8-b09817f19404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:22.964575 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-8b33ee42-6332-465d-98d8-b09817f19404 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:23.107255 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b33ee42-6332-465d-98d8-b09817f19404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:23.108867 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b33ee42-6332-465d-98d8-b09817f19404 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:23.150789 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1312/2660] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:09:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:09:23.507608 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0da97-a86c-49e3-8350-d11e46939b63 service swift] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:23.510329 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-15a0da97-a86c-49e3-8350-d11e46939b63 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:23.609045 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0da97-a86c-49e3-8350-d11e46939b63 service swift] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:23.613605 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36386710-10a9-4012-b0c8-c2441542e247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:23.614174 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36386710-10a9-4012-b0c8-c2441542e247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:23.614451 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36386710-10a9-4012-b0c8-c2441542e247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:23.614721 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36386710-10a9-4012-b0c8-c2441542e247 admin admin] PATH_INFO: `/v3/users/090157a7cd154d3aa6e3466b4f3f8cb9` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:23.615835 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36386710-10a9-4012-b0c8-c2441542e247 admin admin] RBAC: Authorizing `identity:delete_user(user_id=090157a7cd154d3aa6e3466b4f3f8cb9)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:23.618769 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36386710-10a9-4012-b0c8-c2441542e247 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:23.663586 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-36386710-10a9-4012-b0c8-c2441542e247 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '090157a7cd154d3aa6e3466b4f3f8cb9'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:23.664843 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-36386710-10a9-4012-b0c8-c2441542e247 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '090157a7cd154d3aa6e3466b4f3f8cb9'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:23.672884 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-36386710-10a9-4012-b0c8-c2441542e247 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '090157a7cd154d3aa6e3466b4f3f8cb9'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:23.685629 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-36386710-10a9-4012-b0c8-c2441542e247 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '090157a7cd154d3aa6e3466b4f3f8cb9'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:23.692507 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-36386710-10a9-4012-b0c8-c2441542e247 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '090157a7cd154d3aa6e3466b4f3f8cb9'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:23.698633 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1349/2661] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:09:23 2022] DELETE /identity/v3/users/090157a7cd154d3aa6e3466b4f3f8cb9 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:23.869020 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33ee42-6332-465d-98d8-b09817f19404 service neutron] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:23.879706 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33ee42-6332-465d-98d8-b09817f19404 service neutron] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:23.937769 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc32939-5001-4a25-8434-43420cfa98dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:23.938401 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc32939-5001-4a25-8434-43420cfa98dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:23.938682 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc32939-5001-4a25-8434-43420cfa98dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:23.938952 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc32939-5001-4a25-8434-43420cfa98dc admin admin] PATH_INFO: `/v3/projects/aa960eece7f0461a98e9fcb41824a128` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:23.940074 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc32939-5001-4a25-8434-43420cfa98dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa960eece7f0461a98e9fcb41824a128)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:23.942065 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc32939-5001-4a25-8434-43420cfa98dc admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:23.944280 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:23.991930 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-9bc32939-5001-4a25-8434-43420cfa98dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa960eece7f0461a98e9fcb41824a128', 'request_id': 'req-9bc32939-5001-4a25-8434-43420cfa98dc'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:23.998606 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-9bc32939-5001-4a25-8434-43420cfa98dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa960eece7f0461a98e9fcb41824a128', 'request_id': 'req-9bc32939-5001-4a25-8434-43420cfa98dc'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:24.006122 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-9bc32939-5001-4a25-8434-43420cfa98dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa960eece7f0461a98e9fcb41824a128', 'request_id': 'req-9bc32939-5001-4a25-8434-43420cfa98dc'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:24.017883 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-9bc32939-5001-4a25-8434-43420cfa98dc admin admin] The token cache is being invalidate because project aa960eece7f0461a98e9fcb41824a128 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:09:24.018171 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-9bc32939-5001-4a25-8434-43420cfa98dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:24.018803 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-9bc32939-5001-4a25-8434-43420cfa98dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:24.020291 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1313/2662] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:09:23 2022] DELETE /identity/v3/projects/aa960eece7f0461a98e9fcb41824a128 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:24.025509 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068609cb-3a08-47db-ac0d-65466bb1a873 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:24.025791 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068609cb-3a08-47db-ac0d-65466bb1a873 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:24.026061 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068609cb-3a08-47db-ac0d-65466bb1a873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:24.083367 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-068609cb-3a08-47db-ac0d-65466bb1a873 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:24.084555 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-068609cb-3a08-47db-ac0d-65466bb1a873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:24.096747 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:24.143864 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1350/2663] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:09:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:24.151666 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbac23-b871-4fd0-a0e1-0ea3c8ddbe39 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:24.151953 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbac23-b871-4fd0-a0e1-0ea3c8ddbe39 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:24.152230 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbac23-b871-4fd0-a0e1-0ea3c8ddbe39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:24.171851 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-eefbac23-b871-4fd0-a0e1-0ea3c8ddbe39 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:24.173081 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-eefbac23-b871-4fd0-a0e1-0ea3c8ddbe39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:24.181447 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1314/2664] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:09:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:24.185534 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068609cb-3a08-47db-ac0d-65466bb1a873 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:24.197046 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068609cb-3a08-47db-ac0d-65466bb1a873 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:24.201961 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f57afd-f118-4ff6-b54b-4eff485de12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:24.202623 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f57afd-f118-4ff6-b54b-4eff485de12b admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:24.202905 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f57afd-f118-4ff6-b54b-4eff485de12b admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:24.203237 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f57afd-f118-4ff6-b54b-4eff485de12b admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:24.203925 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f57afd-f118-4ff6-b54b-4eff485de12b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:09:24.204348 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f57afd-f118-4ff6-b54b-4eff485de12b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:24.206292 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f57afd-f118-4ff6-b54b-4eff485de12b admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:24.218179 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1351/2665] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 16:09:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:09:24.222441 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbac23-b871-4fd0-a0e1-0ea3c8ddbe39 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:24.231776 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbac23-b871-4fd0-a0e1-0ea3c8ddbe39 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:24.236336 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99969ed-d0dc-4b93-8229-47faea83883f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:24.236968 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99969ed-d0dc-4b93-8229-47faea83883f admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:24.237249 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99969ed-d0dc-4b93-8229-47faea83883f admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:24.237520 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99969ed-d0dc-4b93-8229-47faea83883f admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:24.238164 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99969ed-d0dc-4b93-8229-47faea83883f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:24.240080 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99969ed-d0dc-4b93-8229-47faea83883f admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:24.276857 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1315/2666] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:09:24 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:09:24.281042 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f57afd-f118-4ff6-b54b-4eff485de12b admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:24.290811 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f57afd-f118-4ff6-b54b-4eff485de12b admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:24.345861 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da840ec1-0716-4c2c-ba16-c14e2bd26b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:24.346467 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da840ec1-0716-4c2c-ba16-c14e2bd26b8c admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:24.346749 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da840ec1-0716-4c2c-ba16-c14e2bd26b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:24.347258 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da840ec1-0716-4c2c-ba16-c14e2bd26b8c admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:24.347912 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da840ec1-0716-4c2c-ba16-c14e2bd26b8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:24.349956 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da840ec1-0716-4c2c-ba16-c14e2bd26b8c admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:24.373158 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1352/2667] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:09:24 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:09:24.377065 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99969ed-d0dc-4b93-8229-47faea83883f admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:24.388037 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99969ed-d0dc-4b93-8229-47faea83883f admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:24.392652 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee14b5d-fc2b-4661-99e2-dd13e4b514ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:24.393288 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee14b5d-fc2b-4661-99e2-dd13e4b514ac admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:24.393566 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee14b5d-fc2b-4661-99e2-dd13e4b514ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:24.393833 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee14b5d-fc2b-4661-99e2-dd13e4b514ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:24.394473 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee14b5d-fc2b-4661-99e2-dd13e4b514ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:24.396060 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee14b5d-fc2b-4661-99e2-dd13e4b514ac admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:24.406865 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1316/2668] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:09:24.410793 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da840ec1-0716-4c2c-ba16-c14e2bd26b8c admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:24.421777 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da840ec1-0716-4c2c-ba16-c14e2bd26b8c admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:24.426504 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b192c14-8f2f-4bd3-8549-7f037bf5eefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:24.427113 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b192c14-8f2f-4bd3-8549-7f037bf5eefe admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:24.427392 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b192c14-8f2f-4bd3-8549-7f037bf5eefe admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:24.427654 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b192c14-8f2f-4bd3-8549-7f037bf5eefe admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:24.428291 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b192c14-8f2f-4bd3-8549-7f037bf5eefe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:24.430039 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b192c14-8f2f-4bd3-8549-7f037bf5eefe admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:24.443432 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1353/2669] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:09:24.448104 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee14b5d-fc2b-4661-99e2-dd13e4b514ac admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:24.459728 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee14b5d-fc2b-4661-99e2-dd13e4b514ac admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:24.465434 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c34c2b-0624-482c-89fd-92bd7fa9ffb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:24.466091 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c34c2b-0624-482c-89fd-92bd7fa9ffb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:24.466371 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c34c2b-0624-482c-89fd-92bd7fa9ffb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:24.466638 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c34c2b-0624-482c-89fd-92bd7fa9ffb9 admin admin] PATH_INFO: `/v3/projects/0d83f7c5dc264a668c3e147fd4b0e322/users/14b3b5106230433fb3c60bad0193c3d7/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:24.475065 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b192c14-8f2f-4bd3-8549-7f037bf5eefe admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:24.477313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-3b192c14-8f2f-4bd3-8549-7f037bf5eefe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:24.485967 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c34c2b-0624-482c-89fd-92bd7fa9ffb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d83f7c5dc264a668c3e147fd4b0e322, user_id=14b3b5106230433fb3c60bad0193c3d7, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:24.488751 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c34c2b-0624-482c-89fd-92bd7fa9ffb9 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:24.510591 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1317/2670] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:09:24 2022] PUT /identity/v3/projects/0d83f7c5dc264a668c3e147fd4b0e322/users/14b3b5106230433fb3c60bad0193c3d7/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:24.515101 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017a4c3-4e33-4568-b66e-3b7648739b12 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:24.515386 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017a4c3-4e33-4568-b66e-3b7648739b12 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:24.515658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017a4c3-4e33-4568-b66e-3b7648739b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:24.548455 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-7017a4c3-4e33-4568-b66e-3b7648739b12 None None] MFA Rules not processed for user `14b3b5106230433fb3c60bad0193c3d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:24.549814 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-7017a4c3-4e33-4568-b66e-3b7648739b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:24.551169 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b192c14-8f2f-4bd3-8549-7f037bf5eefe admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:24.598534 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:24.610748 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023c5d7-c80e-42d5-a8c6-bc0ab4b47d02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:24.611376 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023c5d7-c80e-42d5-a8c6-bc0ab4b47d02 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:24.611656 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023c5d7-c80e-42d5-a8c6-bc0ab4b47d02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:24.611929 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023c5d7-c80e-42d5-a8c6-bc0ab4b47d02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:24.614515 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7023c5d7-c80e-42d5-a8c6-bc0ab4b47d02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:24.623103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1318/2671] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:09:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:24.627385 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017a4c3-4e33-4568-b66e-3b7648739b12 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:24.638964 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:24.696177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023c5d7-c80e-42d5-a8c6-bc0ab4b47d02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:24.697683 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023c5d7-c80e-42d5-a8c6-bc0ab4b47d02 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:24.700059 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017a4c3-4e33-4568-b66e-3b7648739b12 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:24.705806 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e4d2c-205e-4c2c-9956-ff18ceb6258c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:24.706549 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e4d2c-205e-4c2c-9956-ff18ceb6258c admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:24.706952 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e4d2c-205e-4c2c-9956-ff18ceb6258c admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:24.707301 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e4d2c-205e-4c2c-9956-ff18ceb6258c admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:24.708044 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e4d2c-205e-4c2c-9956-ff18ceb6258c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:24.710287 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e4d2c-205e-4c2c-9956-ff18ceb6258c admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:24.710430 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1354/2672] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:09:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:09:24.754660 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1319/2673] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:09:24 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:09:24.755959 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023c5d7-c80e-42d5-a8c6-bc0ab4b47d02 service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:24.775666 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023c5d7-c80e-42d5-a8c6-bc0ab4b47d02 service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:24.855372 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81465562-e4e9-4587-8170-9cb22db7ae33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:24.856632 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81465562-e4e9-4587-8170-9cb22db7ae33 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:24.857326 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81465562-e4e9-4587-8170-9cb22db7ae33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:24.858512 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81465562-e4e9-4587-8170-9cb22db7ae33 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:24.858512 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81465562-e4e9-4587-8170-9cb22db7ae33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:24.861131 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81465562-e4e9-4587-8170-9cb22db7ae33 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:24.894409 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1355/2674] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:09:24 2022] POST /identity/v3/users => generated 295 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:09:24.895477 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e4d2c-205e-4c2c-9956-ff18ceb6258c admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:24.907859 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e4d2c-205e-4c2c-9956-ff18ceb6258c admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:24.914643 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8f13f-0276-492f-9a6a-aab8ba5c5359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:24.919776 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8f13f-0276-492f-9a6a-aab8ba5c5359 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:24.920192 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8f13f-0276-492f-9a6a-aab8ba5c5359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:24.920573 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8f13f-0276-492f-9a6a-aab8ba5c5359 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:24.921412 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da8f13f-0276-492f-9a6a-aab8ba5c5359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:24.923301 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da8f13f-0276-492f-9a6a-aab8ba5c5359 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:24.936660 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1320/2675] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:09:24.941390 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81465562-e4e9-4587-8170-9cb22db7ae33 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:24.955176 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81465562-e4e9-4587-8170-9cb22db7ae33 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:24.960725 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e2cf2-b8bd-4087-9938-1e3ca3781ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:24.962240 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e2cf2-b8bd-4087-9938-1e3ca3781ae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:24.962693 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e2cf2-b8bd-4087-9938-1e3ca3781ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:24.962970 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e2cf2-b8bd-4087-9938-1e3ca3781ae2 admin admin] PATH_INFO: `/v3/projects/b275df18d4c9446aa606b4824e30d240/users/00e81491e1f649d785f7e85c0f52cd6c/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:24.983909 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206e2cf2-b8bd-4087-9938-1e3ca3781ae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b275df18d4c9446aa606b4824e30d240, user_id=00e81491e1f649d785f7e85c0f52cd6c, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:24.987121 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206e2cf2-b8bd-4087-9938-1e3ca3781ae2 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:25.005727 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1356/2676] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:09:24 2022] PUT /identity/v3/projects/b275df18d4c9446aa606b4824e30d240/users/00e81491e1f649d785f7e85c0f52cd6c/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:25.009841 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8f13f-0276-492f-9a6a-aab8ba5c5359 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:25.020940 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8f13f-0276-492f-9a6a-aab8ba5c5359 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:25.093263 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99050e-4ddc-4889-8287-1a379e29d68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:25.093877 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99050e-4ddc-4889-8287-1a379e29d68a admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:25.094157 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99050e-4ddc-4889-8287-1a379e29d68a admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:25.094486 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99050e-4ddc-4889-8287-1a379e29d68a admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:25.095137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99050e-4ddc-4889-8287-1a379e29d68a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:25.096749 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99050e-4ddc-4889-8287-1a379e29d68a admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:25.108604 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1321/2677] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:09:25.112532 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e2cf2-b8bd-4087-9938-1e3ca3781ae2 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:25.124033 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e2cf2-b8bd-4087-9938-1e3ca3781ae2 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:25.129007 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62162c0-3526-432e-a025-a256a5adca79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:25.129629 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62162c0-3526-432e-a025-a256a5adca79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:25.129915 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62162c0-3526-432e-a025-a256a5adca79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:25.130191 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62162c0-3526-432e-a025-a256a5adca79 admin admin] PATH_INFO: `/v3/projects/b275df18d4c9446aa606b4824e30d240/users/00e81491e1f649d785f7e85c0f52cd6c/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:25.132284 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62162c0-3526-432e-a025-a256a5adca79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b275df18d4c9446aa606b4824e30d240, user_id=00e81491e1f649d785f7e85c0f52cd6c, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:25.135178 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62162c0-3526-432e-a025-a256a5adca79 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:25.147262 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1357/2678] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:09:25 2022] PUT /identity/v3/projects/b275df18d4c9446aa606b4824e30d240/users/00e81491e1f649d785f7e85c0f52cd6c/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:25.158566 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aff941-8420-4e8a-9715-be15b39fc4b6 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:25.158891 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aff941-8420-4e8a-9715-be15b39fc4b6 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:25.159194 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aff941-8420-4e8a-9715-be15b39fc4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:25.188537 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-58aff941-8420-4e8a-9715-be15b39fc4b6 None None] MFA Rules not processed for user `00e81491e1f649d785f7e85c0f52cd6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:25.189950 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-58aff941-8420-4e8a-9715-be15b39fc4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:25.266505 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1322/2679] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:09:25 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:25.289870 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62162c0-3526-432e-a025-a256a5adca79 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:25.292065 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-b62162c0-3526-432e-a025-a256a5adca79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:25.358811 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:25.428339 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62162c0-3526-432e-a025-a256a5adca79 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:25.433959 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e710848-fc2b-4e67-86e1-bf61d16c2ecd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:25.435165 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e710848-fc2b-4e67-86e1-bf61d16c2ecd service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:25.435752 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e710848-fc2b-4e67-86e1-bf61d16c2ecd service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:25.436862 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e710848-fc2b-4e67-86e1-bf61d16c2ecd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:25.526090 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e710848-fc2b-4e67-86e1-bf61d16c2ecd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:25.527722 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e710848-fc2b-4e67-86e1-bf61d16c2ecd service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:25.537108 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1358/2680] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:09:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:09:28.169348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aff941-8420-4e8a-9715-be15b39fc4b6 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:28.176817 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:28.183866 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aff941-8420-4e8a-9715-be15b39fc4b6 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:28.190876 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a4ab3-4671-4746-a188-5fb52c0ed868 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:28.192063 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a4ab3-4671-4746-a188-5fb52c0ed868 service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:28.192548 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a4ab3-4671-4746-a188-5fb52c0ed868 service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:28.193120 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a4ab3-4671-4746-a188-5fb52c0ed868 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:28.203324 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958a4ab3-4671-4746-a188-5fb52c0ed868 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:28.204795 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958a4ab3-4671-4746-a188-5fb52c0ed868 service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:28.214332 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1323/2681] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:09:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:09:29.296865 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e710848-fc2b-4e67-86e1-bf61d16c2ecd service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:29.298334 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-6e710848-fc2b-4e67-86e1-bf61d16c2ecd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:29.365826 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e710848-fc2b-4e67-86e1-bf61d16c2ecd service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:29.369797 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b3f02-6138-412b-991d-2f77e73235cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:29.370395 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b3f02-6138-412b-991d-2f77e73235cf service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:29.370667 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b3f02-6138-412b-991d-2f77e73235cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:29.370930 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b3f02-6138-412b-991d-2f77e73235cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:29.372649 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-9f0b3f02-6138-412b-991d-2f77e73235cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:29.434179 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b3f02-6138-412b-991d-2f77e73235cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:29.435651 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b3f02-6138-412b-991d-2f77e73235cf service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:29.444876 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1359/2682] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:09:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:09:32.657366 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a4ab3-4671-4746-a188-5fb52c0ed868 service cinder] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:32.658980 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-958a4ab3-4671-4746-a188-5fb52c0ed868 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:32.673311 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a4ab3-4671-4746-a188-5fb52c0ed868 service cinder] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:32.678181 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6f520-f105-4f86-82a4-6c9fe02c4b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:32.678928 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6f520-f105-4f86-82a4-6c9fe02c4b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:32.679210 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6f520-f105-4f86-82a4-6c9fe02c4b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:32.679479 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6f520-f105-4f86-82a4-6c9fe02c4b91 admin admin] PATH_INFO: `/v3/users/784ffb9dd49449358524fa67a5eeca4e` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:32.680580 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6f520-f105-4f86-82a4-6c9fe02c4b91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=784ffb9dd49449358524fa67a5eeca4e)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:32.682562 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6f520-f105-4f86-82a4-6c9fe02c4b91 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:32.735759 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-23c6f520-f105-4f86-82a4-6c9fe02c4b91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '784ffb9dd49449358524fa67a5eeca4e'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:32.748765 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-23c6f520-f105-4f86-82a4-6c9fe02c4b91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '784ffb9dd49449358524fa67a5eeca4e'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:32.749626 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-23c6f520-f105-4f86-82a4-6c9fe02c4b91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '784ffb9dd49449358524fa67a5eeca4e'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:32.750243 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-23c6f520-f105-4f86-82a4-6c9fe02c4b91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '784ffb9dd49449358524fa67a5eeca4e'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:32.759010 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-23c6f520-f105-4f86-82a4-6c9fe02c4b91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '784ffb9dd49449358524fa67a5eeca4e'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:32.772857 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1324/2683] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:09:32 2022] DELETE /identity/v3/users/784ffb9dd49449358524fa67a5eeca4e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:32.949810 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b3f02-6138-412b-991d-2f77e73235cf service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:32.959528 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b3f02-6138-412b-991d-2f77e73235cf service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:32.976508 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:33.016472 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04a835-5f55-49d8-876c-b68fc3a29647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:33.017138 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04a835-5f55-49d8-876c-b68fc3a29647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:33.017411 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04a835-5f55-49d8-876c-b68fc3a29647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:33.017677 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04a835-5f55-49d8-876c-b68fc3a29647 admin admin] PATH_INFO: `/v3/projects/e4800bf375584de38fa6250bd44cfd08` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:33.018770 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04a835-5f55-49d8-876c-b68fc3a29647 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4800bf375584de38fa6250bd44cfd08)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:33.020640 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04a835-5f55-49d8-876c-b68fc3a29647 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:33.065307 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-ff04a835-5f55-49d8-876c-b68fc3a29647 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4800bf375584de38fa6250bd44cfd08', 'request_id': 'req-ff04a835-5f55-49d8-876c-b68fc3a29647'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:33.073930 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-ff04a835-5f55-49d8-876c-b68fc3a29647 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4800bf375584de38fa6250bd44cfd08', 'request_id': 'req-ff04a835-5f55-49d8-876c-b68fc3a29647'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:33.080611 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-ff04a835-5f55-49d8-876c-b68fc3a29647 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4800bf375584de38fa6250bd44cfd08', 'request_id': 'req-ff04a835-5f55-49d8-876c-b68fc3a29647'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:33.090884 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-ff04a835-5f55-49d8-876c-b68fc3a29647 admin admin] The token cache is being invalidate because project e4800bf375584de38fa6250bd44cfd08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:09:33.091171 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-ff04a835-5f55-49d8-876c-b68fc3a29647 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:33.091797 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-ff04a835-5f55-49d8-876c-b68fc3a29647 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:33.093302 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1360/2684] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:09:32 2022] DELETE /identity/v3/projects/e4800bf375584de38fa6250bd44cfd08 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:33.098352 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5e22e-6458-42bb-b796-90cd8b72bd79 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:33.098640 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5e22e-6458-42bb-b796-90cd8b72bd79 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:33.098918 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5e22e-6458-42bb-b796-90cd8b72bd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:33.119793 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-0ce5e22e-6458-42bb-b796-90cd8b72bd79 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:33.121047 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-0ce5e22e-6458-42bb-b796-90cd8b72bd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:33.179910 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1325/2685] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:09:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:33.188402 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61670882-6993-4b03-81ec-6065a45e731a None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:33.188694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61670882-6993-4b03-81ec-6065a45e731a None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:33.189003 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61670882-6993-4b03-81ec-6065a45e731a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:33.209177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-61670882-6993-4b03-81ec-6065a45e731a None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:33.210436 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-61670882-6993-4b03-81ec-6065a45e731a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:33.218982 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1361/2686] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:09:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:33.222918 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5e22e-6458-42bb-b796-90cd8b72bd79 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:33.233326 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5e22e-6458-42bb-b796-90cd8b72bd79 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:33.237985 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373b92d-e4c7-4988-a448-3ea6ef33c8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:33.238597 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373b92d-e4c7-4988-a448-3ea6ef33c8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:33.238875 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373b92d-e4c7-4988-a448-3ea6ef33c8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:33.239146 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373b92d-e4c7-4988-a448-3ea6ef33c8e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:33.239800 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c373b92d-e4c7-4988-a448-3ea6ef33c8e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:09:33.240101 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c373b92d-e4c7-4988-a448-3ea6ef33c8e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:33.241736 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c373b92d-e4c7-4988-a448-3ea6ef33c8e6 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:33.258127 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1326/2687] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 16:09:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:09:33.259336 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61670882-6993-4b03-81ec-6065a45e731a None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:33.268984 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61670882-6993-4b03-81ec-6065a45e731a None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:33.274560 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1710834-ff5a-455c-a02a-1ad61bd0d54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:33.275672 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1710834-ff5a-455c-a02a-1ad61bd0d54a admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:33.276169 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1710834-ff5a-455c-a02a-1ad61bd0d54a admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:33.276449 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1710834-ff5a-455c-a02a-1ad61bd0d54a admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:33.277165 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1710834-ff5a-455c-a02a-1ad61bd0d54a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:33.279054 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1710834-ff5a-455c-a02a-1ad61bd0d54a admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:33.306889 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1362/2688] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:09:33 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:09:33.311040 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373b92d-e4c7-4988-a448-3ea6ef33c8e6 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:33.322120 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373b92d-e4c7-4988-a448-3ea6ef33c8e6 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:33.371986 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:33.384756 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ffcf5-37de-4678-abec-8657ffe784e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:33.385940 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ffcf5-37de-4678-abec-8657ffe784e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:33.386250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ffcf5-37de-4678-abec-8657ffe784e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:33.386528 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ffcf5-37de-4678-abec-8657ffe784e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:33.387169 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0ffcf5-37de-4678-abec-8657ffe784e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:33.389498 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0ffcf5-37de-4678-abec-8657ffe784e3 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:33.415328 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1327/2689] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:09:33 2022] POST /identity/v3/users => generated 285 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:09:33.417446 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1710834-ff5a-455c-a02a-1ad61bd0d54a admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:33.427512 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1710834-ff5a-455c-a02a-1ad61bd0d54a admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:33.432539 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc2730-9d65-4ac3-8191-41ee302d545a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:33.433180 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc2730-9d65-4ac3-8191-41ee302d545a admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:33.433459 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc2730-9d65-4ac3-8191-41ee302d545a admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:33.433729 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc2730-9d65-4ac3-8191-41ee302d545a admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:33.434374 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc2730-9d65-4ac3-8191-41ee302d545a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:33.436071 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc2730-9d65-4ac3-8191-41ee302d545a admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:33.448378 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1363/2690] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:09:33.452814 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ffcf5-37de-4678-abec-8657ffe784e3 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:33.467242 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ffcf5-37de-4678-abec-8657ffe784e3 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:33.472928 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4187b74b-2207-40b5-886e-949807ed8a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:33.473546 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187b74b-2207-40b5-886e-949807ed8a92 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:33.474093 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187b74b-2207-40b5-886e-949807ed8a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:33.474303 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187b74b-2207-40b5-886e-949807ed8a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:33.475060 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4187b74b-2207-40b5-886e-949807ed8a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:33.477097 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4187b74b-2207-40b5-886e-949807ed8a92 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:33.494510 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1328/2691] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:09:33.498346 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc2730-9d65-4ac3-8191-41ee302d545a admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:33.508569 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc2730-9d65-4ac3-8191-41ee302d545a admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:33.514062 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac001e00-05b1-4ff1-8ed6-9f8797aa308c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:33.514720 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac001e00-05b1-4ff1-8ed6-9f8797aa308c admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:33.514998 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac001e00-05b1-4ff1-8ed6-9f8797aa308c admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:33.515303 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac001e00-05b1-4ff1-8ed6-9f8797aa308c admin admin] PATH_INFO: `/v3/projects/ab22b8d311b54dca87ae2a99d083eabc/users/c4bead31862e447196c9f8e346393c83/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:33.530372 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac001e00-05b1-4ff1-8ed6-9f8797aa308c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab22b8d311b54dca87ae2a99d083eabc, user_id=c4bead31862e447196c9f8e346393c83, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:33.533043 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac001e00-05b1-4ff1-8ed6-9f8797aa308c admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:33.546523 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1364/2692] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:09:33 2022] PUT /identity/v3/projects/ab22b8d311b54dca87ae2a99d083eabc/users/c4bead31862e447196c9f8e346393c83/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:33.556944 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3cba4-dc1e-4856-a848-e83411ce98b8 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:33.557226 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3cba4-dc1e-4856-a848-e83411ce98b8 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:33.557493 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3cba4-dc1e-4856-a848-e83411ce98b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:33.588580 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-2dc3cba4-dc1e-4856-a848-e83411ce98b8 None None] MFA Rules not processed for user `c4bead31862e447196c9f8e346393c83`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:33.589768 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-2dc3cba4-dc1e-4856-a848-e83411ce98b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:33.659910 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1329/2693] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:09:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:33.671140 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac001e00-05b1-4ff1-8ed6-9f8797aa308c admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:33.672858 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-ac001e00-05b1-4ff1-8ed6-9f8797aa308c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:33.721233 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:33.748618 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac001e00-05b1-4ff1-8ed6-9f8797aa308c admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:33.754071 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865370ea-e6f8-44e7-8a58-564618ca4735 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc80bf891614fb895af33ca1ded6b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:33.754678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865370ea-e6f8-44e7-8a58-564618ca4735 service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:33.754953 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865370ea-e6f8-44e7-8a58-564618ca4735 service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:33.755218 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865370ea-e6f8-44e7-8a58-564618ca4735 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:33.763584 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865370ea-e6f8-44e7-8a58-564618ca4735 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:33.765178 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865370ea-e6f8-44e7-8a58-564618ca4735 service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:33.773684 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1365/2694] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:09:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:09:36.445082 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3cba4-dc1e-4856-a848-e83411ce98b8 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:36.508660 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3cba4-dc1e-4856-a848-e83411ce98b8 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:36.513760 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbbf1e-1f27-44a4-b2b9-412c86edf303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:36.514382 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbbf1e-1f27-44a4-b2b9-412c86edf303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:36.514657 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbbf1e-1f27-44a4-b2b9-412c86edf303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:36.514927 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbbf1e-1f27-44a4-b2b9-412c86edf303 admin admin] PATH_INFO: `/v3/users/c4bead31862e447196c9f8e346393c83` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:36.516027 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fbbf1e-1f27-44a4-b2b9-412c86edf303 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4bead31862e447196c9f8e346393c83)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:36.517965 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fbbf1e-1f27-44a4-b2b9-412c86edf303 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:36.563174 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-13fbbf1e-1f27-44a4-b2b9-412c86edf303 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4bead31862e447196c9f8e346393c83'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:36.574100 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:36.576379 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-13fbbf1e-1f27-44a4-b2b9-412c86edf303 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4bead31862e447196c9f8e346393c83'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:36.577291 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-13fbbf1e-1f27-44a4-b2b9-412c86edf303 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4bead31862e447196c9f8e346393c83'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:36.578261 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-13fbbf1e-1f27-44a4-b2b9-412c86edf303 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4bead31862e447196c9f8e346393c83'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:36.585880 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-13fbbf1e-1f27-44a4-b2b9-412c86edf303 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4bead31862e447196c9f8e346393c83'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:36.598657 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1330/2695] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:09:36 2022] DELETE /identity/v3/users/c4bead31862e447196c9f8e346393c83 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:36.603068 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec8262-d993-4bc9-87c4-3484bc9f4020 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:36.603557 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec8262-d993-4bc9-87c4-3484bc9f4020 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:36.603649 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec8262-d993-4bc9-87c4-3484bc9f4020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:36.623817 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-55ec8262-d993-4bc9-87c4-3484bc9f4020 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:36.625047 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-55ec8262-d993-4bc9-87c4-3484bc9f4020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:36.684506 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1366/2696] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:36.694187 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbbf1e-1f27-44a4-b2b9-412c86edf303 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:36.695599 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-13fbbf1e-1f27-44a4-b2b9-412c86edf303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:36.754503 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbbf1e-1f27-44a4-b2b9-412c86edf303 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:36.758131 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01846950-2007-4e5d-aed6-be76f3f80451 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:36.758731 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01846950-2007-4e5d-aed6-be76f3f80451 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:36.759617 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01846950-2007-4e5d-aed6-be76f3f80451 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:36.759895 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01846950-2007-4e5d-aed6-be76f3f80451 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:36.768729 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01846950-2007-4e5d-aed6-be76f3f80451 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:36.770180 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01846950-2007-4e5d-aed6-be76f3f80451 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:36.779665 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1331/2697] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:09:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:09:37.055432 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec8262-d993-4bc9-87c4-3484bc9f4020 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:37.057940 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-55ec8262-d993-4bc9-87c4-3484bc9f4020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:37.084043 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec8262-d993-4bc9-87c4-3484bc9f4020 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:37.089403 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f3dfa-138c-4742-a246-f341c124aa67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:37.090178 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f3dfa-138c-4742-a246-f341c124aa67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:37.090458 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f3dfa-138c-4742-a246-f341c124aa67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:37.090725 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f3dfa-138c-4742-a246-f341c124aa67 admin admin] PATH_INFO: `/v3/projects/ab22b8d311b54dca87ae2a99d083eabc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:37.091853 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9f3dfa-138c-4742-a246-f341c124aa67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab22b8d311b54dca87ae2a99d083eabc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:37.094138 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9f3dfa-138c-4742-a246-f341c124aa67 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:37.149464 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-ec9f3dfa-138c-4742-a246-f341c124aa67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab22b8d311b54dca87ae2a99d083eabc', 'request_id': 'req-ec9f3dfa-138c-4742-a246-f341c124aa67'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:37.157505 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-ec9f3dfa-138c-4742-a246-f341c124aa67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab22b8d311b54dca87ae2a99d083eabc', 'request_id': 'req-ec9f3dfa-138c-4742-a246-f341c124aa67'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:37.163753 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-ec9f3dfa-138c-4742-a246-f341c124aa67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab22b8d311b54dca87ae2a99d083eabc', 'request_id': 'req-ec9f3dfa-138c-4742-a246-f341c124aa67'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:37.174734 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-ec9f3dfa-138c-4742-a246-f341c124aa67 admin admin] The token cache is being invalidate because project ab22b8d311b54dca87ae2a99d083eabc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:09:37.175000 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-ec9f3dfa-138c-4742-a246-f341c124aa67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:37.175615 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-ec9f3dfa-138c-4742-a246-f341c124aa67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:37.177140 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1367/2698] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:09:37 2022] DELETE /identity/v3/projects/ab22b8d311b54dca87ae2a99d083eabc => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:37.182612 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ecde7-64df-4aa9-82c7-efcc86de82c5 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:37.182898 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ecde7-64df-4aa9-82c7-efcc86de82c5 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:37.183168 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ecde7-64df-4aa9-82c7-efcc86de82c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:37.202825 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-1a0ecde7-64df-4aa9-82c7-efcc86de82c5 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:37.204008 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-1a0ecde7-64df-4aa9-82c7-efcc86de82c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:37.265744 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1332/2699] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:09:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:37.275493 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58957fd-e2cd-4ea1-8fea-345d72510a13 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:37.275779 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58957fd-e2cd-4ea1-8fea-345d72510a13 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:37.276050 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58957fd-e2cd-4ea1-8fea-345d72510a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:37.296706 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-e58957fd-e2cd-4ea1-8fea-345d72510a13 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:37.298130 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-e58957fd-e2cd-4ea1-8fea-345d72510a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:37.307693 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1368/2700] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:09:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:37.311914 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ecde7-64df-4aa9-82c7-efcc86de82c5 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:37.321550 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ecde7-64df-4aa9-82c7-efcc86de82c5 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:37.326200 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f08f0-7178-40e8-80e9-14a5a18a66fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:37.326814 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f08f0-7178-40e8-80e9-14a5a18a66fd admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:37.327074 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f08f0-7178-40e8-80e9-14a5a18a66fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:37.327345 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f08f0-7178-40e8-80e9-14a5a18a66fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:37.327987 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f08f0-7178-40e8-80e9-14a5a18a66fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:09:37.328289 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f08f0-7178-40e8-80e9-14a5a18a66fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:37.330246 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f08f0-7178-40e8-80e9-14a5a18a66fd admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:37.341685 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1333/2701] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 16:09:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:09:37.346010 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58957fd-e2cd-4ea1-8fea-345d72510a13 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:37.356298 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58957fd-e2cd-4ea1-8fea-345d72510a13 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:37.360775 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993836f-791c-48da-bcec-767a2206adb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:37.361447 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993836f-791c-48da-bcec-767a2206adb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:37.361725 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993836f-791c-48da-bcec-767a2206adb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:37.361994 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993836f-791c-48da-bcec-767a2206adb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:37.362627 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8993836f-791c-48da-bcec-767a2206adb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:37.364481 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8993836f-791c-48da-bcec-767a2206adb7 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:37.391755 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1369/2702] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:09:37 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:09:37.395810 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f08f0-7178-40e8-80e9-14a5a18a66fd admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:37.405981 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f08f0-7178-40e8-80e9-14a5a18a66fd admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:37.462637 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc17fd-383f-44c7-96e1-51bccb5ad0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:37.463433 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc17fd-383f-44c7-96e1-51bccb5ad0da admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:37.463716 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc17fd-383f-44c7-96e1-51bccb5ad0da admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:37.463992 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc17fd-383f-44c7-96e1-51bccb5ad0da admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:37.464629 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc17fd-383f-44c7-96e1-51bccb5ad0da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:37.466588 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc17fd-383f-44c7-96e1-51bccb5ad0da admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:37.483933 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:37.491833 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1334/2703] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:09:37 2022] POST /identity/v3/users => generated 283 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:09:37.496467 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993836f-791c-48da-bcec-767a2206adb7 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:37.506906 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993836f-791c-48da-bcec-767a2206adb7 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:37.511501 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947e858-9b73-426b-8791-72ce0d23f1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:37.512095 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947e858-9b73-426b-8791-72ce0d23f1b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:37.512369 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947e858-9b73-426b-8791-72ce0d23f1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:37.512667 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947e858-9b73-426b-8791-72ce0d23f1b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:37.513340 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947e858-9b73-426b-8791-72ce0d23f1b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:37.514905 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947e858-9b73-426b-8791-72ce0d23f1b0 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:37.525347 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1370/2704] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:09:37.529290 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc17fd-383f-44c7-96e1-51bccb5ad0da admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:37.539214 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc17fd-383f-44c7-96e1-51bccb5ad0da admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:37.544757 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ee4d9-3203-46f3-9e6d-8c0ce06eeea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:37.545382 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ee4d9-3203-46f3-9e6d-8c0ce06eeea0 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:37.545667 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ee4d9-3203-46f3-9e6d-8c0ce06eeea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:37.545951 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ee4d9-3203-46f3-9e6d-8c0ce06eeea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:37.546596 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ee4d9-3203-46f3-9e6d-8c0ce06eeea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:37.548231 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ee4d9-3203-46f3-9e6d-8c0ce06eeea0 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:37.559049 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1335/2705] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:09:37.562867 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947e858-9b73-426b-8791-72ce0d23f1b0 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:37.573251 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947e858-9b73-426b-8791-72ce0d23f1b0 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:37.578143 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1632b-5b7b-4fc5-8c5c-06f27e1f470d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:37.578791 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1632b-5b7b-4fc5-8c5c-06f27e1f470d admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:37.579068 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1632b-5b7b-4fc5-8c5c-06f27e1f470d admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:37.579338 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1632b-5b7b-4fc5-8c5c-06f27e1f470d admin admin] PATH_INFO: `/v3/projects/9df9fdbe9e6d4439b2496662754d48d5/users/88e834604b8b4a88a156893c1bb20c51/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:37.591934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:37.595162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f1632b-5b7b-4fc5-8c5c-06f27e1f470d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9df9fdbe9e6d4439b2496662754d48d5, user_id=88e834604b8b4a88a156893c1bb20c51, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:37.598582 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f1632b-5b7b-4fc5-8c5c-06f27e1f470d admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:37.612694 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1371/2706] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:09:37 2022] PUT /identity/v3/projects/9df9fdbe9e6d4439b2496662754d48d5/users/88e834604b8b4a88a156893c1bb20c51/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:09:37.623304 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf75f71-3f50-48d3-88c8-fd5d387571d5 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:37.623596 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf75f71-3f50-48d3-88c8-fd5d387571d5 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:37.623875 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf75f71-3f50-48d3-88c8-fd5d387571d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:37.651548 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-acf75f71-3f50-48d3-88c8-fd5d387571d5 None None] MFA Rules not processed for user `88e834604b8b4a88a156893c1bb20c51`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:37.652759 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-acf75f71-3f50-48d3-88c8-fd5d387571d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:37.718139 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1336/2707] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:09:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:37.722327 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1632b-5b7b-4fc5-8c5c-06f27e1f470d admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:37.783284 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1632b-5b7b-4fc5-8c5c-06f27e1f470d admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:37.787851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33648d76-7e27-4941-a2db-ed665222f8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:37.788449 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33648d76-7e27-4941-a2db-ed665222f8c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:37.788723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33648d76-7e27-4941-a2db-ed665222f8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:37.789022 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33648d76-7e27-4941-a2db-ed665222f8c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:37.789650 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33648d76-7e27-4941-a2db-ed665222f8c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:37.792157 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33648d76-7e27-4941-a2db-ed665222f8c4 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:37.817704 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1372/2708] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:09:37 2022] POST /identity/v3/projects => generated 365 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:09:37.822248 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf75f71-3f50-48d3-88c8-fd5d387571d5 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:37.832732 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf75f71-3f50-48d3-88c8-fd5d387571d5 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:37.889293 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e522a-6dcf-4387-93d5-c9ba22578d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:37.889830 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e522a-6dcf-4387-93d5-c9ba22578d6a admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:37.890113 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e522a-6dcf-4387-93d5-c9ba22578d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:37.890389 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e522a-6dcf-4387-93d5-c9ba22578d6a admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:37.891019 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e522a-6dcf-4387-93d5-c9ba22578d6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:37.892979 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e522a-6dcf-4387-93d5-c9ba22578d6a admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:37.913830 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1337/2709] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:09:37 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:09:37.917825 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33648d76-7e27-4941-a2db-ed665222f8c4 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:37.927920 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33648d76-7e27-4941-a2db-ed665222f8c4 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:37.932561 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd2dc4-abc6-4218-8bcc-dc7e0e7637ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:37.933186 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd2dc4-abc6-4218-8bcc-dc7e0e7637ee admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:37.933464 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd2dc4-abc6-4218-8bcc-dc7e0e7637ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:37.933734 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd2dc4-abc6-4218-8bcc-dc7e0e7637ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:37.934376 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd2dc4-abc6-4218-8bcc-dc7e0e7637ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:37.935953 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd2dc4-abc6-4218-8bcc-dc7e0e7637ee admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:37.946722 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1373/2710] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:09:37.950947 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e522a-6dcf-4387-93d5-c9ba22578d6a admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:37.961611 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e522a-6dcf-4387-93d5-c9ba22578d6a admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:37.967155 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b068f9-6f3e-4210-8a70-5def5e7607bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:37.967805 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b068f9-6f3e-4210-8a70-5def5e7607bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:37.968089 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b068f9-6f3e-4210-8a70-5def5e7607bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:37.968360 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b068f9-6f3e-4210-8a70-5def5e7607bc admin admin] PATH_INFO: `/v3/projects/801def5fe5a5452d800af33c87bab701/users/b4f16482c45d4fbf857b112804bb00a6/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:37.983067 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b068f9-6f3e-4210-8a70-5def5e7607bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=801def5fe5a5452d800af33c87bab701, user_id=b4f16482c45d4fbf857b112804bb00a6, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:37.985795 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b068f9-6f3e-4210-8a70-5def5e7607bc admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:37.999082 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1338/2711] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:09:37 2022] PUT /identity/v3/projects/801def5fe5a5452d800af33c87bab701/users/b4f16482c45d4fbf857b112804bb00a6/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:38.003044 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd2dc4-abc6-4218-8bcc-dc7e0e7637ee admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:38.014065 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd2dc4-abc6-4218-8bcc-dc7e0e7637ee admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:38.068984 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3fbcf0-5c3f-44f6-b8b2-a89d7d3dd199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:38.069588 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fbcf0-5c3f-44f6-b8b2-a89d7d3dd199 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:38.069870 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fbcf0-5c3f-44f6-b8b2-a89d7d3dd199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:38.070143 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fbcf0-5c3f-44f6-b8b2-a89d7d3dd199 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:38.070778 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3fbcf0-5c3f-44f6-b8b2-a89d7d3dd199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:38.073047 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3fbcf0-5c3f-44f6-b8b2-a89d7d3dd199 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:38.082518 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1374/2712] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:09:38.087580 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b068f9-6f3e-4210-8a70-5def5e7607bc admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:38.097972 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b068f9-6f3e-4210-8a70-5def5e7607bc admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:38.102665 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823f450-6ecd-4a98-b39f-6b2f254547f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:38.103363 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823f450-6ecd-4a98-b39f-6b2f254547f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:38.103637 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823f450-6ecd-4a98-b39f-6b2f254547f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:38.103908 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823f450-6ecd-4a98-b39f-6b2f254547f1 admin admin] PATH_INFO: `/v3/projects/801def5fe5a5452d800af33c87bab701/users/b4f16482c45d4fbf857b112804bb00a6/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:38.105869 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8823f450-6ecd-4a98-b39f-6b2f254547f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=801def5fe5a5452d800af33c87bab701, user_id=b4f16482c45d4fbf857b112804bb00a6, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:38.108524 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8823f450-6ecd-4a98-b39f-6b2f254547f1 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:38.120405 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1339/2713] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:09:38 2022] PUT /identity/v3/projects/801def5fe5a5452d800af33c87bab701/users/b4f16482c45d4fbf857b112804bb00a6/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:38.130614 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245dc31-b142-46ac-a351-c40090b92cd3 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:38.130903 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245dc31-b142-46ac-a351-c40090b92cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:38.131179 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245dc31-b142-46ac-a351-c40090b92cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:38.160827 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-3245dc31-b142-46ac-a351-c40090b92cd3 None None] MFA Rules not processed for user `b4f16482c45d4fbf857b112804bb00a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:38.162015 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-3245dc31-b142-46ac-a351-c40090b92cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:38.213817 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:38.242712 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1375/2714] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:09:38 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:38.250647 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823f450-6ecd-4a98-b39f-6b2f254547f1 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:38.252374 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-8823f450-6ecd-4a98-b39f-6b2f254547f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:38.285784 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:38.314468 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823f450-6ecd-4a98-b39f-6b2f254547f1 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:38.325140 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c053d8-c6a3-445a-b3ee-e11834889bc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:38.325140 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c053d8-c6a3-445a-b3ee-e11834889bc8 service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:38.325140 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c053d8-c6a3-445a-b3ee-e11834889bc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:38.325140 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c053d8-c6a3-445a-b3ee-e11834889bc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:38.329385 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c053d8-c6a3-445a-b3ee-e11834889bc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:38.330819 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c053d8-c6a3-445a-b3ee-e11834889bc8 service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:38.340719 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1340/2715] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:09:38 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:09:38.416181 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245dc31-b142-46ac-a351-c40090b92cd3 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:38.426708 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245dc31-b142-46ac-a351-c40090b92cd3 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:38.430453 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd812a5-7491-4ace-b004-ec56e9251d89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:38.431887 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd812a5-7491-4ace-b004-ec56e9251d89 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:38.432019 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd812a5-7491-4ace-b004-ec56e9251d89 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:38.432301 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd812a5-7491-4ace-b004-ec56e9251d89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:38.491174 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd812a5-7491-4ace-b004-ec56e9251d89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:38.492828 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd812a5-7491-4ace-b004-ec56e9251d89 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:38.503932 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1376/2716] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:09:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:09:40.787671 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c053d8-c6a3-445a-b3ee-e11834889bc8 service cinder] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:40.789118 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-50c053d8-c6a3-445a-b3ee-e11834889bc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:40.853905 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c053d8-c6a3-445a-b3ee-e11834889bc8 service cinder] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:40.858391 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a5cd3-49ed-4e61-9f0a-ab74f48ef8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:40.859014 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a5cd3-49ed-4e61-9f0a-ab74f48ef8b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:40.859295 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a5cd3-49ed-4e61-9f0a-ab74f48ef8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:40.859569 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a5cd3-49ed-4e61-9f0a-ab74f48ef8b7 admin admin] PATH_INFO: `/v3/users/14b3b5106230433fb3c60bad0193c3d7` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:40.860684 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240a5cd3-49ed-4e61-9f0a-ab74f48ef8b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14b3b5106230433fb3c60bad0193c3d7)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:40.862642 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240a5cd3-49ed-4e61-9f0a-ab74f48ef8b7 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:40.908291 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-240a5cd3-49ed-4e61-9f0a-ab74f48ef8b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14b3b5106230433fb3c60bad0193c3d7'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:40.920464 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-240a5cd3-49ed-4e61-9f0a-ab74f48ef8b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14b3b5106230433fb3c60bad0193c3d7'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:40.921183 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-240a5cd3-49ed-4e61-9f0a-ab74f48ef8b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14b3b5106230433fb3c60bad0193c3d7'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:40.921808 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-240a5cd3-49ed-4e61-9f0a-ab74f48ef8b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14b3b5106230433fb3c60bad0193c3d7'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:40.928952 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-240a5cd3-49ed-4e61-9f0a-ab74f48ef8b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14b3b5106230433fb3c60bad0193c3d7'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:40.941101 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1341/2717] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:09:40 2022] DELETE /identity/v3/users/14b3b5106230433fb3c60bad0193c3d7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:40.945626 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1f678-0ada-47d5-a95a-20c8d8891f97 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:40.946599 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1f678-0ada-47d5-a95a-20c8d8891f97 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:40.946788 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1f678-0ada-47d5-a95a-20c8d8891f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:40.965753 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-bde1f678-0ada-47d5-a95a-20c8d8891f97 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:40.966931 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-bde1f678-0ada-47d5-a95a-20c8d8891f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:41.023896 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1377/2718] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:09:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:41.034104 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a5cd3-49ed-4e61-9f0a-ab74f48ef8b7 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:41.035533 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-240a5cd3-49ed-4e61-9f0a-ab74f48ef8b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:41.094144 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a5cd3-49ed-4e61-9f0a-ab74f48ef8b7 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:41.097842 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1c3e4-bd33-4a2a-a765-75ee265e54cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:41.098451 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1c3e4-bd33-4a2a-a765-75ee265e54cf service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:41.098731 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1c3e4-bd33-4a2a-a765-75ee265e54cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:41.099001 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1c3e4-bd33-4a2a-a765-75ee265e54cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:41.105276 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:41.110250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1c3e4-bd33-4a2a-a765-75ee265e54cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:41.112069 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1c3e4-bd33-4a2a-a765-75ee265e54cf service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:41.126565 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1342/2719] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:09:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:09:41.417978 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde1f678-0ada-47d5-a95a-20c8d8891f97 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:41.419643 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-bde1f678-0ada-47d5-a95a-20c8d8891f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:41.431965 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde1f678-0ada-47d5-a95a-20c8d8891f97 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:41.437024 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf8a1a-cd04-4dac-b056-09bf8be3af10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:41.437672 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf8a1a-cd04-4dac-b056-09bf8be3af10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:41.438087 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf8a1a-cd04-4dac-b056-09bf8be3af10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:41.438366 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf8a1a-cd04-4dac-b056-09bf8be3af10 admin admin] PATH_INFO: `/v3/projects/0d83f7c5dc264a668c3e147fd4b0e322` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:41.439508 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cf8a1a-cd04-4dac-b056-09bf8be3af10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d83f7c5dc264a668c3e147fd4b0e322)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:41.441467 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cf8a1a-cd04-4dac-b056-09bf8be3af10 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:41.495799 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-49cf8a1a-cd04-4dac-b056-09bf8be3af10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d83f7c5dc264a668c3e147fd4b0e322', 'request_id': 'req-49cf8a1a-cd04-4dac-b056-09bf8be3af10'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:41.503728 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-49cf8a1a-cd04-4dac-b056-09bf8be3af10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d83f7c5dc264a668c3e147fd4b0e322', 'request_id': 'req-49cf8a1a-cd04-4dac-b056-09bf8be3af10'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:41.511514 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-49cf8a1a-cd04-4dac-b056-09bf8be3af10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d83f7c5dc264a668c3e147fd4b0e322', 'request_id': 'req-49cf8a1a-cd04-4dac-b056-09bf8be3af10'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:41.522963 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-49cf8a1a-cd04-4dac-b056-09bf8be3af10 admin admin] The token cache is being invalidate because project 0d83f7c5dc264a668c3e147fd4b0e322 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:09:41.523249 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-49cf8a1a-cd04-4dac-b056-09bf8be3af10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:41.523976 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-49cf8a1a-cd04-4dac-b056-09bf8be3af10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:41.526008 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1378/2720] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:09:41 2022] DELETE /identity/v3/projects/0d83f7c5dc264a668c3e147fd4b0e322 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:41.530047 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1c3e4-bd33-4a2a-a765-75ee265e54cf service neutron] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:41.539908 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1c3e4-bd33-4a2a-a765-75ee265e54cf service neutron] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:41.604238 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e86b0-b914-43e7-b64f-1fa643f1c7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:41.604926 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e86b0-b914-43e7-b64f-1fa643f1c7e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:41.605227 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e86b0-b914-43e7-b64f-1fa643f1c7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:41.605491 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e86b0-b914-43e7-b64f-1fa643f1c7e1 admin admin] PATH_INFO: `/v3/users/00e81491e1f649d785f7e85c0f52cd6c` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:41.606771 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e86b0-b914-43e7-b64f-1fa643f1c7e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00e81491e1f649d785f7e85c0f52cd6c)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:41.608717 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e86b0-b914-43e7-b64f-1fa643f1c7e1 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:41.662263 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4c1e86b0-b914-43e7-b64f-1fa643f1c7e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00e81491e1f649d785f7e85c0f52cd6c'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:41.678083 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4c1e86b0-b914-43e7-b64f-1fa643f1c7e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00e81491e1f649d785f7e85c0f52cd6c'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:41.678820 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4c1e86b0-b914-43e7-b64f-1fa643f1c7e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00e81491e1f649d785f7e85c0f52cd6c'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:41.679438 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4c1e86b0-b914-43e7-b64f-1fa643f1c7e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00e81491e1f649d785f7e85c0f52cd6c'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:41.687279 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-4c1e86b0-b914-43e7-b64f-1fa643f1c7e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00e81491e1f649d785f7e85c0f52cd6c'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:41.708751 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1343/2721] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:09:41 2022] DELETE /identity/v3/users/00e81491e1f649d785f7e85c0f52cd6c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:41.998013 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf8a1a-cd04-4dac-b056-09bf8be3af10 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:41.999762 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-49cf8a1a-cd04-4dac-b056-09bf8be3af10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:42.014312 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf8a1a-cd04-4dac-b056-09bf8be3af10 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:42.019250 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:42.079349 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29807e-5ff8-4edd-ac0a-eea8050c38f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:42.080116 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29807e-5ff8-4edd-ac0a-eea8050c38f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:42.080471 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29807e-5ff8-4edd-ac0a-eea8050c38f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:42.080885 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29807e-5ff8-4edd-ac0a-eea8050c38f3 admin admin] PATH_INFO: `/v3/projects/b275df18d4c9446aa606b4824e30d240` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:42.082017 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29807e-5ff8-4edd-ac0a-eea8050c38f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b275df18d4c9446aa606b4824e30d240)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:42.084236 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29807e-5ff8-4edd-ac0a-eea8050c38f3 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:42.135666 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-9e29807e-5ff8-4edd-ac0a-eea8050c38f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b275df18d4c9446aa606b4824e30d240', 'request_id': 'req-9e29807e-5ff8-4edd-ac0a-eea8050c38f3'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:42.143513 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-9e29807e-5ff8-4edd-ac0a-eea8050c38f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b275df18d4c9446aa606b4824e30d240', 'request_id': 'req-9e29807e-5ff8-4edd-ac0a-eea8050c38f3'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:42.150409 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-9e29807e-5ff8-4edd-ac0a-eea8050c38f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b275df18d4c9446aa606b4824e30d240', 'request_id': 'req-9e29807e-5ff8-4edd-ac0a-eea8050c38f3'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:42.162579 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-9e29807e-5ff8-4edd-ac0a-eea8050c38f3 admin admin] The token cache is being invalidate because project b275df18d4c9446aa606b4824e30d240 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:09:42.162891 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-9e29807e-5ff8-4edd-ac0a-eea8050c38f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:42.163850 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-9e29807e-5ff8-4edd-ac0a-eea8050c38f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:42.166563 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1379/2722] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:09:41 2022] DELETE /identity/v3/projects/b275df18d4c9446aa606b4824e30d240 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:42.172230 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a490db-ba4f-44da-8a22-7d12ad3615aa None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:42.172767 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a490db-ba4f-44da-8a22-7d12ad3615aa None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:42.172906 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a490db-ba4f-44da-8a22-7d12ad3615aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:42.193369 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-90a490db-ba4f-44da-8a22-7d12ad3615aa None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:42.194669 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-90a490db-ba4f-44da-8a22-7d12ad3615aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:42.261416 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1344/2723] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:09:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:42.269346 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a4f34-937f-4e9b-ab85-8cd38c9fda56 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:42.269726 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a4f34-937f-4e9b-ab85-8cd38c9fda56 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:42.269950 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a4f34-937f-4e9b-ab85-8cd38c9fda56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:42.291209 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-aa1a4f34-937f-4e9b-ab85-8cd38c9fda56 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:42.292419 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-aa1a4f34-937f-4e9b-ab85-8cd38c9fda56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:42.300397 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1380/2724] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:09:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:42.304926 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a490db-ba4f-44da-8a22-7d12ad3615aa None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:42.314777 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a490db-ba4f-44da-8a22-7d12ad3615aa None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:42.319325 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2b924-7e6d-424f-84af-10c06106c333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:42.319921 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2b924-7e6d-424f-84af-10c06106c333 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:42.320201 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2b924-7e6d-424f-84af-10c06106c333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:42.320471 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2b924-7e6d-424f-84af-10c06106c333 admin admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:42.321660 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2b924-7e6d-424f-84af-10c06106c333 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:09:42.322208 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2b924-7e6d-424f-84af-10c06106c333 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:42.323826 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2b924-7e6d-424f-84af-10c06106c333 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:42.332335 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:42.336362 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1345/2725] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 16:09:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:09:42.341361 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a4f34-937f-4e9b-ab85-8cd38c9fda56 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:42.350351 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a4f34-937f-4e9b-ab85-8cd38c9fda56 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:42.355403 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43054a86-9bd0-4499-97d0-33565cfba623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:42.355989 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43054a86-9bd0-4499-97d0-33565cfba623 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:42.356261 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43054a86-9bd0-4499-97d0-33565cfba623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:42.356523 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43054a86-9bd0-4499-97d0-33565cfba623 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:42.357185 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43054a86-9bd0-4499-97d0-33565cfba623 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:42.359060 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43054a86-9bd0-4499-97d0-33565cfba623 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:42.385878 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1381/2726] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:09:42 2022] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:09:42.390088 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2b924-7e6d-424f-84af-10c06106c333 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:42.400903 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2b924-7e6d-424f-84af-10c06106c333 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:42.458225 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d0f2c-1326-42f4-9187-6b09f50a9b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:42.458843 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d0f2c-1326-42f4-9187-6b09f50a9b03 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:42.459127 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d0f2c-1326-42f4-9187-6b09f50a9b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:42.459427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d0f2c-1326-42f4-9187-6b09f50a9b03 admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:42.460067 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236d0f2c-1326-42f4-9187-6b09f50a9b03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:42.462822 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236d0f2c-1326-42f4-9187-6b09f50a9b03 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:42.483529 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1346/2727] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:09:42 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:09:42.487566 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43054a86-9bd0-4499-97d0-33565cfba623 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:42.498299 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43054a86-9bd0-4499-97d0-33565cfba623 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:42.502830 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99083cb5-30b0-4317-95c8-905862302215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:42.503416 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99083cb5-30b0-4317-95c8-905862302215 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:42.503713 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99083cb5-30b0-4317-95c8-905862302215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:42.503979 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99083cb5-30b0-4317-95c8-905862302215 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:42.504614 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99083cb5-30b0-4317-95c8-905862302215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:42.506215 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99083cb5-30b0-4317-95c8-905862302215 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:42.516286 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1382/2728] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:09:42.520196 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d0f2c-1326-42f4-9187-6b09f50a9b03 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:42.531097 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d0f2c-1326-42f4-9187-6b09f50a9b03 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:42.535742 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad7aa6-6e40-4537-90ad-25d25fd20c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:42.536330 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad7aa6-6e40-4537-90ad-25d25fd20c47 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:42.536607 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad7aa6-6e40-4537-90ad-25d25fd20c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:42.536941 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad7aa6-6e40-4537-90ad-25d25fd20c47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:42.537576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad7aa6-6e40-4537-90ad-25d25fd20c47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:42.539186 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad7aa6-6e40-4537-90ad-25d25fd20c47 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:42.550656 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1347/2729] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:09:42.554643 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99083cb5-30b0-4317-95c8-905862302215 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:42.565023 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99083cb5-30b0-4317-95c8-905862302215 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:42.569672 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b6078-ce4f-4c63-a614-4d68efd06e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:42.570334 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b6078-ce4f-4c63-a614-4d68efd06e09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:42.570612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b6078-ce4f-4c63-a614-4d68efd06e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:42.570884 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b6078-ce4f-4c63-a614-4d68efd06e09 admin admin] PATH_INFO: `/v3/projects/7b98c1adf89343a98914ceb61dc5a7a1/users/68787e6d404b4e7e8c4765e070eac2e7/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:42.585436 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b6078-ce4f-4c63-a614-4d68efd06e09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b98c1adf89343a98914ceb61dc5a7a1, user_id=68787e6d404b4e7e8c4765e070eac2e7, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:42.588774 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b6078-ce4f-4c63-a614-4d68efd06e09 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:42.602233 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1383/2730] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:09:42 2022] PUT /identity/v3/projects/7b98c1adf89343a98914ceb61dc5a7a1/users/68787e6d404b4e7e8c4765e070eac2e7/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:42.613659 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb46d3-d7a3-4d37-a9ed-b36fb3623df8 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:42.613944 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb46d3-d7a3-4d37-a9ed-b36fb3623df8 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:42.614218 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb46d3-d7a3-4d37-a9ed-b36fb3623df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:42.642329 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-0bdb46d3-d7a3-4d37-a9ed-b36fb3623df8 None None] MFA Rules not processed for user `68787e6d404b4e7e8c4765e070eac2e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:42.643537 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-0bdb46d3-d7a3-4d37-a9ed-b36fb3623df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:42.706543 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1348/2731] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:09:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:42.711027 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b6078-ce4f-4c63-a614-4d68efd06e09 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:42.750850 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:42.774316 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b6078-ce4f-4c63-a614-4d68efd06e09 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:42.778946 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d2ac2-dc85-4066-af41-af7c6fd35843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:42.779543 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d2ac2-dc85-4066-af41-af7c6fd35843 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:42.779820 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d2ac2-dc85-4066-af41-af7c6fd35843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:42.780116 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d2ac2-dc85-4066-af41-af7c6fd35843 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:42.780742 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d2ac2-dc85-4066-af41-af7c6fd35843 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:42.782647 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d2ac2-dc85-4066-af41-af7c6fd35843 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:42.808411 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1384/2732] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:09:42 2022] POST /identity/v3/projects => generated 369 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:09:42.812403 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb46d3-d7a3-4d37-a9ed-b36fb3623df8 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:42.823701 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb46d3-d7a3-4d37-a9ed-b36fb3623df8 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:42.879057 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1143fa-6245-4ad7-acd8-f086913dd2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:42.879596 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1143fa-6245-4ad7-acd8-f086913dd2c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:42.879880 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1143fa-6245-4ad7-acd8-f086913dd2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:42.880155 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1143fa-6245-4ad7-acd8-f086913dd2c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:42.880807 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1143fa-6245-4ad7-acd8-f086913dd2c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:42.882755 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1143fa-6245-4ad7-acd8-f086913dd2c2 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:42.898641 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:42.905831 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1349/2733] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:09:42 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:09:42.909817 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d2ac2-dc85-4066-af41-af7c6fd35843 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:42.919931 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d2ac2-dc85-4066-af41-af7c6fd35843 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:42.924591 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf08c786-6998-454b-b0d0-5f810864da4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:42.925219 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08c786-6998-454b-b0d0-5f810864da4d admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:42.925502 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08c786-6998-454b-b0d0-5f810864da4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:42.925772 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08c786-6998-454b-b0d0-5f810864da4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:42.926458 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf08c786-6998-454b-b0d0-5f810864da4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:42.927991 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf08c786-6998-454b-b0d0-5f810864da4d admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:42.938849 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1385/2734] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:09:42.942816 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1143fa-6245-4ad7-acd8-f086913dd2c2 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:42.953269 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1143fa-6245-4ad7-acd8-f086913dd2c2 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:42.957909 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe81fa-ef66-4b5b-b53e-aa0bf2b76ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:42.958555 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe81fa-ef66-4b5b-b53e-aa0bf2b76ae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:42.958839 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe81fa-ef66-4b5b-b53e-aa0bf2b76ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:42.959117 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe81fa-ef66-4b5b-b53e-aa0bf2b76ae4 admin admin] PATH_INFO: `/v3/projects/d744d74a3fc647ae9c2160e57481bdc1/users/f15f983a6a3342a98a117711283ef670/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:42.973569 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbe81fa-ef66-4b5b-b53e-aa0bf2b76ae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d744d74a3fc647ae9c2160e57481bdc1, user_id=f15f983a6a3342a98a117711283ef670, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:42.976217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbe81fa-ef66-4b5b-b53e-aa0bf2b76ae4 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:42.988820 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1350/2735] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:09:42 2022] PUT /identity/v3/projects/d744d74a3fc647ae9c2160e57481bdc1/users/f15f983a6a3342a98a117711283ef670/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:42.993435 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf08c786-6998-454b-b0d0-5f810864da4d admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:43.003767 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf08c786-6998-454b-b0d0-5f810864da4d admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:43.061692 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f63ea-85cb-477b-95df-f1352d272954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:43.062827 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f63ea-85cb-477b-95df-f1352d272954 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:43.063355 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f63ea-85cb-477b-95df-f1352d272954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:43.063638 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f63ea-85cb-477b-95df-f1352d272954 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:43.064277 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f63ea-85cb-477b-95df-f1352d272954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:43.065894 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f63ea-85cb-477b-95df-f1352d272954 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:43.079897 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1386/2736] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:09:43.081276 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe81fa-ef66-4b5b-b53e-aa0bf2b76ae4 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:43.092035 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe81fa-ef66-4b5b-b53e-aa0bf2b76ae4 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:43.099536 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76745c33-abd1-46a7-9702-36703c3fdeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:43.100211 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76745c33-abd1-46a7-9702-36703c3fdeed admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:43.100573 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76745c33-abd1-46a7-9702-36703c3fdeed admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:43.100757 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76745c33-abd1-46a7-9702-36703c3fdeed admin admin] PATH_INFO: `/v3/projects/d744d74a3fc647ae9c2160e57481bdc1/users/f15f983a6a3342a98a117711283ef670/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:43.103553 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76745c33-abd1-46a7-9702-36703c3fdeed admin admin] RBAC: Authorizing `identity:create_grant(project_id=d744d74a3fc647ae9c2160e57481bdc1, user_id=f15f983a6a3342a98a117711283ef670, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:43.106371 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76745c33-abd1-46a7-9702-36703c3fdeed admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:43.116894 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1351/2737] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:09:43 2022] PUT /identity/v3/projects/d744d74a3fc647ae9c2160e57481bdc1/users/f15f983a6a3342a98a117711283ef670/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:43.128001 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3f4b7-c16f-4529-b173-d5b13177cb52 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:43.128291 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3f4b7-c16f-4529-b173-d5b13177cb52 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:43.128571 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3f4b7-c16f-4529-b173-d5b13177cb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:43.156828 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-9fb3f4b7-c16f-4529-b173-d5b13177cb52 None None] MFA Rules not processed for user `f15f983a6a3342a98a117711283ef670`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:43.157876 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-9fb3f4b7-c16f-4529-b173-d5b13177cb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:43.231286 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1387/2738] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:09:43 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:43.243919 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76745c33-abd1-46a7-9702-36703c3fdeed admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:43.245893 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-76745c33-abd1-46a7-9702-36703c3fdeed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:43.306996 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76745c33-abd1-46a7-9702-36703c3fdeed admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:43.311090 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6641757d-5f56-49d5-8dbd-12080cbffdb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:43.311705 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641757d-5f56-49d5-8dbd-12080cbffdb6 service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:43.312093 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641757d-5f56-49d5-8dbd-12080cbffdb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:43.312242 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641757d-5f56-49d5-8dbd-12080cbffdb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:43.322455 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6641757d-5f56-49d5-8dbd-12080cbffdb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:43.323921 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6641757d-5f56-49d5-8dbd-12080cbffdb6 service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:43.333840 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1352/2739] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:09:43 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:09:43.382895 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb3f4b7-c16f-4529-b173-d5b13177cb52 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:43.384621 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-9fb3f4b7-c16f-4529-b173-d5b13177cb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:43.396402 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb3f4b7-c16f-4529-b173-d5b13177cb52 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:43.400381 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20303cb4-351b-4d2e-9db0-9911d3e85658 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:43.401024 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20303cb4-351b-4d2e-9db0-9911d3e85658 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:43.401305 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20303cb4-351b-4d2e-9db0-9911d3e85658 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:43.401578 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20303cb4-351b-4d2e-9db0-9911d3e85658 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:43.432156 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:43.460936 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20303cb4-351b-4d2e-9db0-9911d3e85658 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:43.462859 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20303cb4-351b-4d2e-9db0-9911d3e85658 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:43.472036 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1388/2740] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:09:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:09:44.521658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6641757d-5f56-49d5-8dbd-12080cbffdb6 service cinder] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:44.523045 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-6641757d-5f56-49d5-8dbd-12080cbffdb6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:44.586240 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6641757d-5f56-49d5-8dbd-12080cbffdb6 service cinder] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:44.591386 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b61a24-7218-44c5-9d5a-843463aa70ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:44.592005 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b61a24-7218-44c5-9d5a-843463aa70ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:44.592284 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b61a24-7218-44c5-9d5a-843463aa70ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:44.592553 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b61a24-7218-44c5-9d5a-843463aa70ff admin admin] PATH_INFO: `/v3/users/88e834604b8b4a88a156893c1bb20c51` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:44.593675 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b61a24-7218-44c5-9d5a-843463aa70ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=88e834604b8b4a88a156893c1bb20c51)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:44.595700 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b61a24-7218-44c5-9d5a-843463aa70ff admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:44.640165 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-f1b61a24-7218-44c5-9d5a-843463aa70ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88e834604b8b4a88a156893c1bb20c51'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:44.652135 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-f1b61a24-7218-44c5-9d5a-843463aa70ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88e834604b8b4a88a156893c1bb20c51'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:44.652793 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-f1b61a24-7218-44c5-9d5a-843463aa70ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88e834604b8b4a88a156893c1bb20c51'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:44.653402 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-f1b61a24-7218-44c5-9d5a-843463aa70ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88e834604b8b4a88a156893c1bb20c51'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:44.655010 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:44.661051 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-f1b61a24-7218-44c5-9d5a-843463aa70ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88e834604b8b4a88a156893c1bb20c51'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:44.674115 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1353/2741] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:09:44 2022] DELETE /identity/v3/users/88e834604b8b4a88a156893c1bb20c51 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:44.678514 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66270b-1dfe-452a-ab58-22d0ee09b371 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:44.679013 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66270b-1dfe-452a-ab58-22d0ee09b371 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:44.679126 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66270b-1dfe-452a-ab58-22d0ee09b371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:44.699499 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-7d66270b-1dfe-452a-ab58-22d0ee09b371 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:44.700686 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7d66270b-1dfe-452a-ab58-22d0ee09b371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:44.762916 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1389/2742] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:09:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:44.772689 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b61a24-7218-44c5-9d5a-843463aa70ff admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:44.774146 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-f1b61a24-7218-44c5-9d5a-843463aa70ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:44.834806 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b61a24-7218-44c5-9d5a-843463aa70ff admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:44.839136 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51293e2a-14b8-479a-96cc-e28f6bcd7602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:44.839737 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51293e2a-14b8-479a-96cc-e28f6bcd7602 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:44.840043 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51293e2a-14b8-479a-96cc-e28f6bcd7602 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:44.840311 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51293e2a-14b8-479a-96cc-e28f6bcd7602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:44.849543 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51293e2a-14b8-479a-96cc-e28f6bcd7602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:44.850978 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51293e2a-14b8-479a-96cc-e28f6bcd7602 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:44.861063 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1354/2743] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:09:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:09:45.154215 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66270b-1dfe-452a-ab58-22d0ee09b371 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:45.155793 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7d66270b-1dfe-452a-ab58-22d0ee09b371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:45.169013 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66270b-1dfe-452a-ab58-22d0ee09b371 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:45.175540 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc9469-62ad-4ccd-a12b-5f040254b636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:45.176526 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc9469-62ad-4ccd-a12b-5f040254b636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:45.177068 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc9469-62ad-4ccd-a12b-5f040254b636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:45.177563 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc9469-62ad-4ccd-a12b-5f040254b636 admin admin] PATH_INFO: `/v3/projects/9df9fdbe9e6d4439b2496662754d48d5` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:45.181877 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc9469-62ad-4ccd-a12b-5f040254b636 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9df9fdbe9e6d4439b2496662754d48d5)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:45.184689 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc9469-62ad-4ccd-a12b-5f040254b636 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:45.244934 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-91bc9469-62ad-4ccd-a12b-5f040254b636 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9df9fdbe9e6d4439b2496662754d48d5', 'request_id': 'req-91bc9469-62ad-4ccd-a12b-5f040254b636'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:45.254342 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-91bc9469-62ad-4ccd-a12b-5f040254b636 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9df9fdbe9e6d4439b2496662754d48d5', 'request_id': 'req-91bc9469-62ad-4ccd-a12b-5f040254b636'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:45.262126 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-91bc9469-62ad-4ccd-a12b-5f040254b636 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9df9fdbe9e6d4439b2496662754d48d5', 'request_id': 'req-91bc9469-62ad-4ccd-a12b-5f040254b636'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:45.273780 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-91bc9469-62ad-4ccd-a12b-5f040254b636 admin admin] The token cache is being invalidate because project 9df9fdbe9e6d4439b2496662754d48d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:09:45.274757 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-91bc9469-62ad-4ccd-a12b-5f040254b636 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:45.275566 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-91bc9469-62ad-4ccd-a12b-5f040254b636 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:45.277336 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1390/2744] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:09:45 2022] DELETE /identity/v3/projects/9df9fdbe9e6d4439b2496662754d48d5 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:45.281624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51293e2a-14b8-479a-96cc-e28f6bcd7602 service neutron] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:45.291659 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51293e2a-14b8-479a-96cc-e28f6bcd7602 service neutron] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:45.346764 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e50a7f-2ba9-4a41-bdc0-20dcbde272f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:45.347386 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e50a7f-2ba9-4a41-bdc0-20dcbde272f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:45.347662 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e50a7f-2ba9-4a41-bdc0-20dcbde272f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:45.347929 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e50a7f-2ba9-4a41-bdc0-20dcbde272f2 admin admin] PATH_INFO: `/v3/users/b4f16482c45d4fbf857b112804bb00a6` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:45.349054 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e50a7f-2ba9-4a41-bdc0-20dcbde272f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4f16482c45d4fbf857b112804bb00a6)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:45.350965 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e50a7f-2ba9-4a41-bdc0-20dcbde272f2 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:45.398044 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-46e50a7f-2ba9-4a41-bdc0-20dcbde272f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4f16482c45d4fbf857b112804bb00a6'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:45.410029 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-46e50a7f-2ba9-4a41-bdc0-20dcbde272f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4f16482c45d4fbf857b112804bb00a6'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:45.410685 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-46e50a7f-2ba9-4a41-bdc0-20dcbde272f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4f16482c45d4fbf857b112804bb00a6'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:45.411286 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-46e50a7f-2ba9-4a41-bdc0-20dcbde272f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4f16482c45d4fbf857b112804bb00a6'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:45.419035 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-46e50a7f-2ba9-4a41-bdc0-20dcbde272f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4f16482c45d4fbf857b112804bb00a6'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:45.431648 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1355/2745] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:09:45 2022] DELETE /identity/v3/users/b4f16482c45d4fbf857b112804bb00a6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:45.709325 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc9469-62ad-4ccd-a12b-5f040254b636 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:45.711309 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-91bc9469-62ad-4ccd-a12b-5f040254b636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:45.727174 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc9469-62ad-4ccd-a12b-5f040254b636 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:45.780368 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:45.791412 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf2a70-916b-442a-a6db-1a1ce9b8fd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:45.792233 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf2a70-916b-442a-a6db-1a1ce9b8fd66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:45.792508 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf2a70-916b-442a-a6db-1a1ce9b8fd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:45.792776 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf2a70-916b-442a-a6db-1a1ce9b8fd66 admin admin] PATH_INFO: `/v3/projects/801def5fe5a5452d800af33c87bab701` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:45.793922 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf2a70-916b-442a-a6db-1a1ce9b8fd66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=801def5fe5a5452d800af33c87bab701)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:45.795794 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf2a70-916b-442a-a6db-1a1ce9b8fd66 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:45.839204 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-9eaf2a70-916b-442a-a6db-1a1ce9b8fd66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '801def5fe5a5452d800af33c87bab701', 'request_id': 'req-9eaf2a70-916b-442a-a6db-1a1ce9b8fd66'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:45.846214 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-9eaf2a70-916b-442a-a6db-1a1ce9b8fd66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '801def5fe5a5452d800af33c87bab701', 'request_id': 'req-9eaf2a70-916b-442a-a6db-1a1ce9b8fd66'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:45.852415 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-9eaf2a70-916b-442a-a6db-1a1ce9b8fd66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '801def5fe5a5452d800af33c87bab701', 'request_id': 'req-9eaf2a70-916b-442a-a6db-1a1ce9b8fd66'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:45.863252 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-9eaf2a70-916b-442a-a6db-1a1ce9b8fd66 admin admin] The token cache is being invalidate because project 801def5fe5a5452d800af33c87bab701 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:09:45.863536 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-9eaf2a70-916b-442a-a6db-1a1ce9b8fd66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:45.864153 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-9eaf2a70-916b-442a-a6db-1a1ce9b8fd66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:45.865748 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1391/2746] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:09:45 2022] DELETE /identity/v3/projects/801def5fe5a5452d800af33c87bab701 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:45.870816 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee845a5-c9b3-4519-9a83-2b42d0124bf6 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:45.871296 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee845a5-c9b3-4519-9a83-2b42d0124bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:45.871393 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee845a5-c9b3-4519-9a83-2b42d0124bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:45.879880 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:45.892964 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-3ee845a5-c9b3-4519-9a83-2b42d0124bf6 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:45.894161 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-3ee845a5-c9b3-4519-9a83-2b42d0124bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:46.075574 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1356/2747] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:09:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:46.082676 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1931da-066e-4226-9fd4-48db1579d124 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:46.082953 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1931da-066e-4226-9fd4-48db1579d124 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:46.083222 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1931da-066e-4226-9fd4-48db1579d124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:46.102745 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-ff1931da-066e-4226-9fd4-48db1579d124 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:46.103914 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-ff1931da-066e-4226-9fd4-48db1579d124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:46.111544 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1392/2748] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:09:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:46.115642 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee845a5-c9b3-4519-9a83-2b42d0124bf6 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:46.126568 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee845a5-c9b3-4519-9a83-2b42d0124bf6 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:46.134727 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66217987-2dfa-43aa-9469-351c2177badd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:46.135810 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66217987-2dfa-43aa-9469-351c2177badd admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:46.136316 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66217987-2dfa-43aa-9469-351c2177badd admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:46.136854 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66217987-2dfa-43aa-9469-351c2177badd admin admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:46.138022 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66217987-2dfa-43aa-9469-351c2177badd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:09:46.138529 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66217987-2dfa-43aa-9469-351c2177badd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:46.140361 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66217987-2dfa-43aa-9469-351c2177badd admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:46.152933 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1357/2749] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 16:09:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:09:46.157483 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1931da-066e-4226-9fd4-48db1579d124 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:46.167715 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1931da-066e-4226-9fd4-48db1579d124 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:46.172298 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04191cc1-43df-4c35-82fc-bb4362e8eeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:46.173911 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04191cc1-43df-4c35-82fc-bb4362e8eeb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:46.173911 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04191cc1-43df-4c35-82fc-bb4362e8eeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:46.173911 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04191cc1-43df-4c35-82fc-bb4362e8eeb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:46.174223 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04191cc1-43df-4c35-82fc-bb4362e8eeb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:46.176039 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04191cc1-43df-4c35-82fc-bb4362e8eeb1 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:46.203076 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1393/2750] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:09:46 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:09:46.207601 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66217987-2dfa-43aa-9469-351c2177badd admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:46.218678 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66217987-2dfa-43aa-9469-351c2177badd admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:46.274240 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ea209-366b-4054-95eb-437a8e7a220c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:46.275619 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ea209-366b-4054-95eb-437a8e7a220c admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:46.275894 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ea209-366b-4054-95eb-437a8e7a220c admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:46.276161 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ea209-366b-4054-95eb-437a8e7a220c admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:46.276803 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ea209-366b-4054-95eb-437a8e7a220c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:46.278698 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ea209-366b-4054-95eb-437a8e7a220c admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:46.304202 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1358/2751] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:09:46 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:09:46.305321 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04191cc1-43df-4c35-82fc-bb4362e8eeb1 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:46.315771 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04191cc1-43df-4c35-82fc-bb4362e8eeb1 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:46.320984 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06dec6-d809-4928-bc72-04da0e7cc3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:46.322257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06dec6-d809-4928-bc72-04da0e7cc3b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:46.322380 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06dec6-d809-4928-bc72-04da0e7cc3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:46.322625 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06dec6-d809-4928-bc72-04da0e7cc3b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:46.323274 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06dec6-d809-4928-bc72-04da0e7cc3b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:46.324956 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06dec6-d809-4928-bc72-04da0e7cc3b7 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:46.335613 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1394/2752] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:09:46.345301 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ea209-366b-4054-95eb-437a8e7a220c admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:46.355357 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ea209-366b-4054-95eb-437a8e7a220c admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:46.361944 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78481e13-7efd-49e5-9cfa-bc861aebcdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:46.361944 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78481e13-7efd-49e5-9cfa-bc861aebcdc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:46.361944 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78481e13-7efd-49e5-9cfa-bc861aebcdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:46.361944 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78481e13-7efd-49e5-9cfa-bc861aebcdc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:46.362441 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78481e13-7efd-49e5-9cfa-bc861aebcdc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:46.363337 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78481e13-7efd-49e5-9cfa-bc861aebcdc9 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:46.374503 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1359/2753] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:09:46.378536 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06dec6-d809-4928-bc72-04da0e7cc3b7 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:46.390295 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06dec6-d809-4928-bc72-04da0e7cc3b7 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:46.394961 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d856bd1-1a1b-402f-a7c9-845f4ea86a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:46.395614 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d856bd1-1a1b-402f-a7c9-845f4ea86a39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:46.395895 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d856bd1-1a1b-402f-a7c9-845f4ea86a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:46.396165 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d856bd1-1a1b-402f-a7c9-845f4ea86a39 admin admin] PATH_INFO: `/v3/projects/f134c0e44bc64d10b83eb74cd197185f/users/234fd6282a954edd908f938f9e0c26aa/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:46.411459 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d856bd1-1a1b-402f-a7c9-845f4ea86a39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f134c0e44bc64d10b83eb74cd197185f, user_id=234fd6282a954edd908f938f9e0c26aa, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:46.414103 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d856bd1-1a1b-402f-a7c9-845f4ea86a39 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:46.427947 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1395/2754] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:09:46 2022] PUT /identity/v3/projects/f134c0e44bc64d10b83eb74cd197185f/users/234fd6282a954edd908f938f9e0c26aa/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:46.438976 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66dd10e-5b6d-461a-aff8-6dcee06f2608 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:46.439326 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66dd10e-5b6d-461a-aff8-6dcee06f2608 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:46.439611 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66dd10e-5b6d-461a-aff8-6dcee06f2608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:46.469356 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-e66dd10e-5b6d-461a-aff8-6dcee06f2608 None None] MFA Rules not processed for user `234fd6282a954edd908f938f9e0c26aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:46.470603 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-e66dd10e-5b6d-461a-aff8-6dcee06f2608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:46.534346 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:46.541940 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1360/2755] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:09:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:46.542790 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d856bd1-1a1b-402f-a7c9-845f4ea86a39 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:46.611290 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d856bd1-1a1b-402f-a7c9-845f4ea86a39 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:46.616107 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b82034-d038-4891-9431-09aa5269c936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:46.616713 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b82034-d038-4891-9431-09aa5269c936 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:46.617024 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b82034-d038-4891-9431-09aa5269c936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:46.617295 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b82034-d038-4891-9431-09aa5269c936 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:46.618713 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b82034-d038-4891-9431-09aa5269c936 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:46.620665 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b82034-d038-4891-9431-09aa5269c936 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:46.651919 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1396/2756] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:09:46 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:09:46.653405 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66dd10e-5b6d-461a-aff8-6dcee06f2608 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:46.664923 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66dd10e-5b6d-461a-aff8-6dcee06f2608 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:46.726812 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dbf122-febb-4f32-abb4-7246fbe2bdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:46.727662 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dbf122-febb-4f32-abb4-7246fbe2bdf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:46.727945 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dbf122-febb-4f32-abb4-7246fbe2bdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:46.728208 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dbf122-febb-4f32-abb4-7246fbe2bdf9 admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:46.730068 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dbf122-febb-4f32-abb4-7246fbe2bdf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:46.731991 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dbf122-febb-4f32-abb4-7246fbe2bdf9 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:46.755444 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1361/2757] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:09:46 2022] POST /identity/v3/users => generated 296 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:09:46.760105 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b82034-d038-4891-9431-09aa5269c936 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:46.767323 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:46.771128 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b82034-d038-4891-9431-09aa5269c936 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:46.777157 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b4983-254a-4ecf-9e29-64b7d9ff6b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:46.777946 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b4983-254a-4ecf-9e29-64b7d9ff6b41 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:46.778567 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b4983-254a-4ecf-9e29-64b7d9ff6b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:46.779080 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b4983-254a-4ecf-9e29-64b7d9ff6b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:46.780037 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b4983-254a-4ecf-9e29-64b7d9ff6b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:46.781876 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b4983-254a-4ecf-9e29-64b7d9ff6b41 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:46.796825 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1397/2758] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:09:46.798237 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dbf122-febb-4f32-abb4-7246fbe2bdf9 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:46.809818 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dbf122-febb-4f32-abb4-7246fbe2bdf9 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:46.812951 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b4983-254a-4ecf-9e29-64b7d9ff6b41 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:46.814691 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-045b4983-254a-4ecf-9e29-64b7d9ff6b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:46.815020 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9242a9-6d7d-476f-9472-a8072fe3e423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:46.815752 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9242a9-6d7d-476f-9472-a8072fe3e423 admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:46.816106 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9242a9-6d7d-476f-9472-a8072fe3e423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:46.816475 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9242a9-6d7d-476f-9472-a8072fe3e423 admin admin] PATH_INFO: `/v3/projects/866151cbf7e442a59a8ca380c93725eb/users/bf6252efd0b042d3bd605ce324583161/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:46.827905 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b4983-254a-4ecf-9e29-64b7d9ff6b41 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:46.832117 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9242a9-6d7d-476f-9472-a8072fe3e423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=866151cbf7e442a59a8ca380c93725eb, user_id=bf6252efd0b042d3bd605ce324583161, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:46.832501 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144cb616-9c4f-406b-935a-c80175d6cddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:46.833148 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144cb616-9c4f-406b-935a-c80175d6cddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:46.833535 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144cb616-9c4f-406b-935a-c80175d6cddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:46.833805 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144cb616-9c4f-406b-935a-c80175d6cddd admin admin] PATH_INFO: `/v3/users/68787e6d404b4e7e8c4765e070eac2e7` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:46.834780 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9242a9-6d7d-476f-9472-a8072fe3e423 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:46.835080 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144cb616-9c4f-406b-935a-c80175d6cddd admin admin] RBAC: Authorizing `identity:delete_user(user_id=68787e6d404b4e7e8c4765e070eac2e7)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:46.837147 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144cb616-9c4f-406b-935a-c80175d6cddd admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:46.850310 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1362/2759] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:09:46 2022] PUT /identity/v3/projects/866151cbf7e442a59a8ca380c93725eb/users/bf6252efd0b042d3bd605ce324583161/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:46.857929 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9242a9-6d7d-476f-9472-a8072fe3e423 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:46.889500 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-144cb616-9c4f-406b-935a-c80175d6cddd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68787e6d404b4e7e8c4765e070eac2e7'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:46.890180 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-144cb616-9c4f-406b-935a-c80175d6cddd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68787e6d404b4e7e8c4765e070eac2e7'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:46.898642 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-144cb616-9c4f-406b-935a-c80175d6cddd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68787e6d404b4e7e8c4765e070eac2e7'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:46.911025 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-144cb616-9c4f-406b-935a-c80175d6cddd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68787e6d404b4e7e8c4765e070eac2e7'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:46.918331 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-144cb616-9c4f-406b-935a-c80175d6cddd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68787e6d404b4e7e8c4765e070eac2e7'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:46.924189 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1398/2760] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:09:46 2022] DELETE /identity/v3/users/68787e6d404b4e7e8c4765e070eac2e7 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:09:46.925288 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9242a9-6d7d-476f-9472-a8072fe3e423 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:46.928583 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af431e5-549c-4e9c-bee8-8bd198c8a00c None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:46.928904 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af431e5-549c-4e9c-bee8-8bd198c8a00c None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:46.929183 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af431e5-549c-4e9c-bee8-8bd198c8a00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:46.948052 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-8af431e5-549c-4e9c-bee8-8bd198c8a00c None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:46.949295 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-8af431e5-549c-4e9c-bee8-8bd198c8a00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:46.981886 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097c4ab-c2cb-4eef-8d2f-f5d3943f33df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:46.982500 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097c4ab-c2cb-4eef-8d2f-f5d3943f33df admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:46.982783 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097c4ab-c2cb-4eef-8d2f-f5d3943f33df admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:46.983100 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097c4ab-c2cb-4eef-8d2f-f5d3943f33df admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:46.983696 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097c4ab-c2cb-4eef-8d2f-f5d3943f33df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:46.985330 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097c4ab-c2cb-4eef-8d2f-f5d3943f33df admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:46.995962 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1363/2761] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:09:47.000274 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097c4ab-c2cb-4eef-8d2f-f5d3943f33df admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:47.002077 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-6097c4ab-c2cb-4eef-8d2f-f5d3943f33df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:47.012817 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1399/2762] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:09:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:09:47.015772 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097c4ab-c2cb-4eef-8d2f-f5d3943f33df admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:47.020368 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6de0f1-476e-467a-971c-1c0c1b6de830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:47.021057 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6de0f1-476e-467a-971c-1c0c1b6de830 admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:47.021346 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6de0f1-476e-467a-971c-1c0c1b6de830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:47.021634 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6de0f1-476e-467a-971c-1c0c1b6de830 admin admin] PATH_INFO: `/v3/projects/866151cbf7e442a59a8ca380c93725eb/users/bf6252efd0b042d3bd605ce324583161/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:47.022792 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af431e5-549c-4e9c-bee8-8bd198c8a00c None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:47.023512 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6de0f1-476e-467a-971c-1c0c1b6de830 admin admin] RBAC: Authorizing `identity:create_grant(project_id=866151cbf7e442a59a8ca380c93725eb, user_id=bf6252efd0b042d3bd605ce324583161, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:47.024193 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-8af431e5-549c-4e9c-bee8-8bd198c8a00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:47.026936 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6de0f1-476e-467a-971c-1c0c1b6de830 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:47.030217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:47.039425 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1364/2763] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:09:46 2022] PUT /identity/v3/projects/866151cbf7e442a59a8ca380c93725eb/users/bf6252efd0b042d3bd605ce324583161/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:09:47.087387 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af431e5-549c-4e9c-bee8-8bd198c8a00c None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:47.108207 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:47.111668 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe2906-d6c5-4583-9c6d-8fc1403abf12 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:47.112014 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe2906-d6c5-4583-9c6d-8fc1403abf12 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:47.112289 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe2906-d6c5-4583-9c6d-8fc1403abf12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:47.141850 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-b3fe2906-d6c5-4583-9c6d-8fc1403abf12 None None] MFA Rules not processed for user `bf6252efd0b042d3bd605ce324583161`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:47.143068 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-b3fe2906-d6c5-4583-9c6d-8fc1403abf12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:47.143192 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ba16a-749e-41c3-aa29-3df7cb477451 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:47.143836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ba16a-749e-41c3-aa29-3df7cb477451 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:47.144107 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ba16a-749e-41c3-aa29-3df7cb477451 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:47.144371 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ba16a-749e-41c3-aa29-3df7cb477451 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:47.204679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ba16a-749e-41c3-aa29-3df7cb477451 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:47.206400 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ba16a-749e-41c3-aa29-3df7cb477451 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:47.214086 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1365/2764] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:09:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:09:47.216946 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1400/2765] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:09:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:09:47.229438 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe2906-d6c5-4583-9c6d-8fc1403abf12 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:47.230848 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-b3fe2906-d6c5-4583-9c6d-8fc1403abf12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:47.290533 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe2906-d6c5-4583-9c6d-8fc1403abf12 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:47.294438 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a0662-ef3a-4275-8755-28197d66a02e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:47.295187 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a0662-ef3a-4275-8755-28197d66a02e service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:47.295478 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a0662-ef3a-4275-8755-28197d66a02e service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:47.295751 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a0662-ef3a-4275-8755-28197d66a02e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:47.297539 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-694a0662-ef3a-4275-8755-28197d66a02e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:47.357594 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a0662-ef3a-4275-8755-28197d66a02e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:47.359219 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a0662-ef3a-4275-8755-28197d66a02e service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:47.373714 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1366/2766] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:09:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:09:47.499959 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ba16a-749e-41c3-aa29-3df7cb477451 service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:47.501464 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-a66ba16a-749e-41c3-aa29-3df7cb477451 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:47.515117 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ba16a-749e-41c3-aa29-3df7cb477451 service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:47.520512 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a684b2b-feda-42b1-b19b-cbf63322e6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:47.521211 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a684b2b-feda-42b1-b19b-cbf63322e6f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:47.521500 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a684b2b-feda-42b1-b19b-cbf63322e6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:47.521771 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a684b2b-feda-42b1-b19b-cbf63322e6f4 admin admin] PATH_INFO: `/v3/projects/7b98c1adf89343a98914ceb61dc5a7a1` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:47.522884 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a684b2b-feda-42b1-b19b-cbf63322e6f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b98c1adf89343a98914ceb61dc5a7a1)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:47.525192 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a684b2b-feda-42b1-b19b-cbf63322e6f4 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:47.575708 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-9a684b2b-feda-42b1-b19b-cbf63322e6f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b98c1adf89343a98914ceb61dc5a7a1', 'request_id': 'req-9a684b2b-feda-42b1-b19b-cbf63322e6f4'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:47.583588 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-9a684b2b-feda-42b1-b19b-cbf63322e6f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b98c1adf89343a98914ceb61dc5a7a1', 'request_id': 'req-9a684b2b-feda-42b1-b19b-cbf63322e6f4'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:47.590708 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-9a684b2b-feda-42b1-b19b-cbf63322e6f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b98c1adf89343a98914ceb61dc5a7a1', 'request_id': 'req-9a684b2b-feda-42b1-b19b-cbf63322e6f4'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:47.601752 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-9a684b2b-feda-42b1-b19b-cbf63322e6f4 admin admin] The token cache is being invalidate because project 7b98c1adf89343a98914ceb61dc5a7a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:09:47.602051 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-9a684b2b-feda-42b1-b19b-cbf63322e6f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:47.603216 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-9a684b2b-feda-42b1-b19b-cbf63322e6f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:47.605030 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1401/2767] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:09:47 2022] DELETE /identity/v3/projects/7b98c1adf89343a98914ceb61dc5a7a1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:47.609308 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a0662-ef3a-4275-8755-28197d66a02e service cinder] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:47.621398 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a0662-ef3a-4275-8755-28197d66a02e service cinder] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:47.670760 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:47.705359 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ff0d5-ee67-47b8-8e1a-599f0dfdc15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:47.706005 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ff0d5-ee67-47b8-8e1a-599f0dfdc15d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:47.706285 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ff0d5-ee67-47b8-8e1a-599f0dfdc15d admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:47.706557 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ff0d5-ee67-47b8-8e1a-599f0dfdc15d admin admin] PATH_INFO: `/v3/users/f15f983a6a3342a98a117711283ef670` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:47.707695 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ff0d5-ee67-47b8-8e1a-599f0dfdc15d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f15f983a6a3342a98a117711283ef670)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:47.709730 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ff0d5-ee67-47b8-8e1a-599f0dfdc15d admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:47.762564 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-7b5ff0d5-ee67-47b8-8e1a-599f0dfdc15d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f15f983a6a3342a98a117711283ef670'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:47.774265 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-7b5ff0d5-ee67-47b8-8e1a-599f0dfdc15d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f15f983a6a3342a98a117711283ef670'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:47.774933 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-7b5ff0d5-ee67-47b8-8e1a-599f0dfdc15d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f15f983a6a3342a98a117711283ef670'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:47.775538 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-7b5ff0d5-ee67-47b8-8e1a-599f0dfdc15d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f15f983a6a3342a98a117711283ef670'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:47.782974 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-7b5ff0d5-ee67-47b8-8e1a-599f0dfdc15d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f15f983a6a3342a98a117711283ef670'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:47.795697 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1367/2768] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:09:47 2022] DELETE /identity/v3/users/f15f983a6a3342a98a117711283ef670 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:48.070372 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a684b2b-feda-42b1-b19b-cbf63322e6f4 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:48.071970 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-9a684b2b-feda-42b1-b19b-cbf63322e6f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:48.095401 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a684b2b-feda-42b1-b19b-cbf63322e6f4 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:48.145549 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:48.154211 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ed97d-d0f7-403d-9c8a-56f1c643142b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:48.154856 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ed97d-d0f7-403d-9c8a-56f1c643142b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:48.155351 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ed97d-d0f7-403d-9c8a-56f1c643142b admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:48.156036 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ed97d-d0f7-403d-9c8a-56f1c643142b admin admin] PATH_INFO: `/v3/projects/d744d74a3fc647ae9c2160e57481bdc1` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:48.157462 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ed97d-d0f7-403d-9c8a-56f1c643142b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d744d74a3fc647ae9c2160e57481bdc1)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:48.159356 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ed97d-d0f7-403d-9c8a-56f1c643142b admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:48.207268 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e32ed97d-d0f7-403d-9c8a-56f1c643142b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd744d74a3fc647ae9c2160e57481bdc1', 'request_id': 'req-e32ed97d-d0f7-403d-9c8a-56f1c643142b'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:48.215835 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e32ed97d-d0f7-403d-9c8a-56f1c643142b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd744d74a3fc647ae9c2160e57481bdc1', 'request_id': 'req-e32ed97d-d0f7-403d-9c8a-56f1c643142b'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:48.222186 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e32ed97d-d0f7-403d-9c8a-56f1c643142b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd744d74a3fc647ae9c2160e57481bdc1', 'request_id': 'req-e32ed97d-d0f7-403d-9c8a-56f1c643142b'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:48.232912 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e32ed97d-d0f7-403d-9c8a-56f1c643142b admin admin] The token cache is being invalidate because project d744d74a3fc647ae9c2160e57481bdc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:09:48.233196 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e32ed97d-d0f7-403d-9c8a-56f1c643142b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:48.233823 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e32ed97d-d0f7-403d-9c8a-56f1c643142b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:48.235287 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1402/2769] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:09:48 2022] DELETE /identity/v3/projects/d744d74a3fc647ae9c2160e57481bdc1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:48.240314 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd02d1-4dcf-4045-92e6-8e82b51bf60d None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:48.240816 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd02d1-4dcf-4045-92e6-8e82b51bf60d None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:48.240936 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd02d1-4dcf-4045-92e6-8e82b51bf60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:48.260430 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-18fd02d1-4dcf-4045-92e6-8e82b51bf60d None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:48.261670 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-18fd02d1-4dcf-4045-92e6-8e82b51bf60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:48.320332 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1368/2770] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:09:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:48.330088 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577a87d-a751-4b15-b53f-9febd5c7eba9 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:48.330372 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577a87d-a751-4b15-b53f-9febd5c7eba9 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:48.330642 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577a87d-a751-4b15-b53f-9febd5c7eba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:48.350580 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-a577a87d-a751-4b15-b53f-9febd5c7eba9 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:48.351759 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-a577a87d-a751-4b15-b53f-9febd5c7eba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:48.359723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1403/2771] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:09:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:48.363861 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd02d1-4dcf-4045-92e6-8e82b51bf60d None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:48.373783 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd02d1-4dcf-4045-92e6-8e82b51bf60d None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:48.378270 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba930ef5-7d0c-49ba-9e2d-aa8da6a72e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:48.378857 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba930ef5-7d0c-49ba-9e2d-aa8da6a72e74 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:48.379134 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba930ef5-7d0c-49ba-9e2d-aa8da6a72e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:48.379402 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba930ef5-7d0c-49ba-9e2d-aa8da6a72e74 admin admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:48.380039 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba930ef5-7d0c-49ba-9e2d-aa8da6a72e74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:09:48.380338 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba930ef5-7d0c-49ba-9e2d-aa8da6a72e74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:48.381969 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba930ef5-7d0c-49ba-9e2d-aa8da6a72e74 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:48.393567 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1369/2772] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 16:09:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:09:48.397848 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577a87d-a751-4b15-b53f-9febd5c7eba9 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:48.407396 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577a87d-a751-4b15-b53f-9febd5c7eba9 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:48.411948 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86af453-b941-454a-96aa-ca9dafc62e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:48.412532 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86af453-b941-454a-96aa-ca9dafc62e5b admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:48.412834 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86af453-b941-454a-96aa-ca9dafc62e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:48.413105 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86af453-b941-454a-96aa-ca9dafc62e5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:48.413728 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86af453-b941-454a-96aa-ca9dafc62e5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:48.415633 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86af453-b941-454a-96aa-ca9dafc62e5b admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:48.442171 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1404/2773] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:09:48 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:09:48.446920 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba930ef5-7d0c-49ba-9e2d-aa8da6a72e74 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:48.456644 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba930ef5-7d0c-49ba-9e2d-aa8da6a72e74 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:48.496397 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:48.514405 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e3092-d286-4015-ac1f-0b326062e2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:48.515000 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e3092-d286-4015-ac1f-0b326062e2e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:48.515280 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e3092-d286-4015-ac1f-0b326062e2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:48.515588 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e3092-d286-4015-ac1f-0b326062e2e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:48.516170 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e3092-d286-4015-ac1f-0b326062e2e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:48.518099 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e3092-d286-4015-ac1f-0b326062e2e2 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:48.539335 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1370/2774] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:09:48 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:09:48.543747 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86af453-b941-454a-96aa-ca9dafc62e5b admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:48.553941 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86af453-b941-454a-96aa-ca9dafc62e5b admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:48.558604 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b0320-f3e7-468f-ad76-43bfded681c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:48.559202 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b0320-f3e7-468f-ad76-43bfded681c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:48.559483 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b0320-f3e7-468f-ad76-43bfded681c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:48.559759 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b0320-f3e7-468f-ad76-43bfded681c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:48.560406 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b0320-f3e7-468f-ad76-43bfded681c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:48.562043 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b0320-f3e7-468f-ad76-43bfded681c0 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:48.572266 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1405/2775] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:09:48.576175 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e3092-d286-4015-ac1f-0b326062e2e2 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:48.585977 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e3092-d286-4015-ac1f-0b326062e2e2 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:48.591672 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5eeb4-41b2-4dd8-9157-f7fb692594aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:48.592263 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5eeb4-41b2-4dd8-9157-f7fb692594aa admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:48.592538 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5eeb4-41b2-4dd8-9157-f7fb692594aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:48.592838 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5eeb4-41b2-4dd8-9157-f7fb692594aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:48.593492 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5eeb4-41b2-4dd8-9157-f7fb692594aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:48.595045 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5eeb4-41b2-4dd8-9157-f7fb692594aa admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:48.605372 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1371/2776] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:09:48.609589 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b0320-f3e7-468f-ad76-43bfded681c0 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:48.620521 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b0320-f3e7-468f-ad76-43bfded681c0 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:48.625338 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab5907-5934-4c89-9b32-74915a8883c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:48.625992 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab5907-5934-4c89-9b32-74915a8883c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:48.626274 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab5907-5934-4c89-9b32-74915a8883c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:48.626550 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab5907-5934-4c89-9b32-74915a8883c1 admin admin] PATH_INFO: `/v3/projects/b4252958dc0e46c5a206c503f2d6a1f6/users/bbfb6e51810946fc9255704d41d310c2/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:48.641319 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab5907-5934-4c89-9b32-74915a8883c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4252958dc0e46c5a206c503f2d6a1f6, user_id=bbfb6e51810946fc9255704d41d310c2, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:48.643961 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab5907-5934-4c89-9b32-74915a8883c1 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:48.657152 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1406/2777] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:09:48 2022] PUT /identity/v3/projects/b4252958dc0e46c5a206c503f2d6a1f6/users/bbfb6e51810946fc9255704d41d310c2/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:09:48.667454 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db03f8-9214-4fb4-9c81-9760cdfb370f None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:48.667737 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db03f8-9214-4fb4-9c81-9760cdfb370f None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:48.668003 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db03f8-9214-4fb4-9c81-9760cdfb370f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:48.697118 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-11db03f8-9214-4fb4-9c81-9760cdfb370f None None] MFA Rules not processed for user `bbfb6e51810946fc9255704d41d310c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:48.698398 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-11db03f8-9214-4fb4-9c81-9760cdfb370f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:48.763599 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab5907-5934-4c89-9b32-74915a8883c1 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:48.765310 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-01ab5907-5934-4c89-9b32-74915a8883c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:48.772007 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1372/2778] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:09:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:48.776708 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db03f8-9214-4fb4-9c81-9760cdfb370f None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:48.822643 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab5907-5934-4c89-9b32-74915a8883c1 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:48.827054 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534f55f-8742-48a1-9164-8e2c4b492045 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:48.827668 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534f55f-8742-48a1-9164-8e2c4b492045 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:48.828061 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534f55f-8742-48a1-9164-8e2c4b492045 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:48.828342 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534f55f-8742-48a1-9164-8e2c4b492045 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:48.830145 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-b534f55f-8742-48a1-9164-8e2c4b492045 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:48.839180 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db03f8-9214-4fb4-9c81-9760cdfb370f None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:48.843846 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9384b-dd08-4e6d-bd3a-a8356e7ec271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:48.844447 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9384b-dd08-4e6d-bd3a-a8356e7ec271 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:48.844723 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9384b-dd08-4e6d-bd3a-a8356e7ec271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:48.845037 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9384b-dd08-4e6d-bd3a-a8356e7ec271 admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:48.845709 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9384b-dd08-4e6d-bd3a-a8356e7ec271 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:48.847596 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9384b-dd08-4e6d-bd3a-a8356e7ec271 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:48.864889 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:48.877846 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1373/2779] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:09:48 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:09:48.881868 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9384b-dd08-4e6d-bd3a-a8356e7ec271 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:48.901534 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534f55f-8742-48a1-9164-8e2c4b492045 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:48.902971 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534f55f-8742-48a1-9164-8e2c4b492045 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:48.912714 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1407/2780] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:09:48 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:09:48.922526 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:48.947015 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9384b-dd08-4e6d-bd3a-a8356e7ec271 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:48.951729 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab4d9b-ef22-4719-98ca-a9ee4e1d3ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:48.952345 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab4d9b-ef22-4719-98ca-a9ee4e1d3ce1 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:48.952625 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab4d9b-ef22-4719-98ca-a9ee4e1d3ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:48.952933 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab4d9b-ef22-4719-98ca-a9ee4e1d3ce1 admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:48.953598 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab4d9b-ef22-4719-98ca-a9ee4e1d3ce1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:48.955501 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab4d9b-ef22-4719-98ca-a9ee4e1d3ce1 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:48.981775 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1374/2781] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:09:48 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:09:48.985842 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534f55f-8742-48a1-9164-8e2c4b492045 service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:48.997013 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534f55f-8742-48a1-9164-8e2c4b492045 service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:49.001916 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd8f9b0-642d-4a98-9106-1cf36efdf6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:49.002528 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8f9b0-642d-4a98-9106-1cf36efdf6b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:49.002806 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8f9b0-642d-4a98-9106-1cf36efdf6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:49.003080 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8f9b0-642d-4a98-9106-1cf36efdf6b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:49.003727 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd8f9b0-642d-4a98-9106-1cf36efdf6b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:49.005370 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd8f9b0-642d-4a98-9106-1cf36efdf6b3 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:49.019348 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1408/2782] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:09:49.021065 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab4d9b-ef22-4719-98ca-a9ee4e1d3ce1 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:49.032114 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab4d9b-ef22-4719-98ca-a9ee4e1d3ce1 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:49.036885 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47059f-82d9-47d1-bf00-7538ec2db597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:49.037600 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47059f-82d9-47d1-bf00-7538ec2db597 admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:49.037884 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47059f-82d9-47d1-bf00-7538ec2db597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:49.038167 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47059f-82d9-47d1-bf00-7538ec2db597 admin admin] PATH_INFO: `/v3/projects/4d8b4e8b637f4c299e126a2d0be6f503/users/aa53eead725c43afa301c1fa9e16e6b5/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:49.058674 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a47059f-82d9-47d1-bf00-7538ec2db597 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d8b4e8b637f4c299e126a2d0be6f503, user_id=aa53eead725c43afa301c1fa9e16e6b5, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:49.061677 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a47059f-82d9-47d1-bf00-7538ec2db597 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:49.077451 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1375/2783] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:09:49 2022] PUT /identity/v3/projects/4d8b4e8b637f4c299e126a2d0be6f503/users/aa53eead725c43afa301c1fa9e16e6b5/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:49.081444 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd8f9b0-642d-4a98-9106-1cf36efdf6b3 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:49.092809 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd8f9b0-642d-4a98-9106-1cf36efdf6b3 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:49.150634 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8476d27-e1e1-48d4-a436-8891e9758dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:49.151242 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8476d27-e1e1-48d4-a436-8891e9758dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:49.151547 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8476d27-e1e1-48d4-a436-8891e9758dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:49.151818 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8476d27-e1e1-48d4-a436-8891e9758dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:49.152454 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8476d27-e1e1-48d4-a436-8891e9758dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:49.154071 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8476d27-e1e1-48d4-a436-8891e9758dc7 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:49.163522 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1409/2784] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:09:49.167597 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47059f-82d9-47d1-bf00-7538ec2db597 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:49.177631 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47059f-82d9-47d1-bf00-7538ec2db597 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:49.182416 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a085479-adae-41b7-b7e1-e15ab2e3acbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:49.183134 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a085479-adae-41b7-b7e1-e15ab2e3acbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:49.183365 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a085479-adae-41b7-b7e1-e15ab2e3acbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:49.183661 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a085479-adae-41b7-b7e1-e15ab2e3acbe admin admin] PATH_INFO: `/v3/projects/4d8b4e8b637f4c299e126a2d0be6f503/users/aa53eead725c43afa301c1fa9e16e6b5/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:49.185616 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a085479-adae-41b7-b7e1-e15ab2e3acbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d8b4e8b637f4c299e126a2d0be6f503, user_id=aa53eead725c43afa301c1fa9e16e6b5, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:49.188444 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a085479-adae-41b7-b7e1-e15ab2e3acbe admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:49.199655 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1376/2785] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:09:49 2022] PUT /identity/v3/projects/4d8b4e8b637f4c299e126a2d0be6f503/users/aa53eead725c43afa301c1fa9e16e6b5/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:49.210158 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526ab64-77ba-4b37-b14a-2d760b893ec8 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:49.210438 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526ab64-77ba-4b37-b14a-2d760b893ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:49.210708 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526ab64-77ba-4b37-b14a-2d760b893ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:49.238289 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-b526ab64-77ba-4b37-b14a-2d760b893ec8 None None] MFA Rules not processed for user `aa53eead725c43afa301c1fa9e16e6b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:49.239486 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-b526ab64-77ba-4b37-b14a-2d760b893ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:49.305312 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1410/2786] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:09:49 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:49.317649 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a085479-adae-41b7-b7e1-e15ab2e3acbe admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:49.319368 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-5a085479-adae-41b7-b7e1-e15ab2e3acbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:49.377641 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a085479-adae-41b7-b7e1-e15ab2e3acbe admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:49.381216 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aace4b9-05b2-4d1b-9289-57dae2de2fc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:49.381819 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aace4b9-05b2-4d1b-9289-57dae2de2fc1 service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:49.382097 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aace4b9-05b2-4d1b-9289-57dae2de2fc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:49.382371 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aace4b9-05b2-4d1b-9289-57dae2de2fc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:49.391979 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aace4b9-05b2-4d1b-9289-57dae2de2fc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:49.393458 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aace4b9-05b2-4d1b-9289-57dae2de2fc1 service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:49.403484 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1377/2787] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:09:49 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:09:49.705468 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526ab64-77ba-4b37-b14a-2d760b893ec8 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:49.715215 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526ab64-77ba-4b37-b14a-2d760b893ec8 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:49.719836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab474f-7e59-4b0e-abf3-1b662a1ff8fe tempest-VolumeQuotaClassesTest-1130747266 tempest-VolumeQuotaClassesTest-1130747266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa53eead725c43afa301c1fa9e16e6b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8b4e8b637f4c299e126a2d0be6f503', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:49.720437 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab474f-7e59-4b0e-abf3-1b662a1ff8fe tempest-VolumeQuotaClassesTest-1130747266 tempest-VolumeQuotaClassesTest-1130747266-project-admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:49.720722 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab474f-7e59-4b0e-abf3-1b662a1ff8fe tempest-VolumeQuotaClassesTest-1130747266 tempest-VolumeQuotaClassesTest-1130747266-project-admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:49.721036 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab474f-7e59-4b0e-abf3-1b662a1ff8fe tempest-VolumeQuotaClassesTest-1130747266 tempest-VolumeQuotaClassesTest-1130747266-project-admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:49.722107 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab474f-7e59-4b0e-abf3-1b662a1ff8fe tempest-VolumeQuotaClassesTest-1130747266 tempest-VolumeQuotaClassesTest-1130747266-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:09:49.722408 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab474f-7e59-4b0e-abf3-1b662a1ff8fe tempest-VolumeQuotaClassesTest-1130747266 tempest-VolumeQuotaClassesTest-1130747266-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:49.723987 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab474f-7e59-4b0e-abf3-1b662a1ff8fe tempest-VolumeQuotaClassesTest-1130747266 tempest-VolumeQuotaClassesTest-1130747266-project-admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:49.736522 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1411/2788] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 16:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:09:49.740566 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aace4b9-05b2-4d1b-9289-57dae2de2fc1 service cinder] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:49.750147 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aace4b9-05b2-4d1b-9289-57dae2de2fc1 service cinder] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:49.754725 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba615db1-f140-42e1-97fe-c1bf234d6c92 tempest-VolumeQuotaClassesTest-1130747266 tempest-VolumeQuotaClassesTest-1130747266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa53eead725c43afa301c1fa9e16e6b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8b4e8b637f4c299e126a2d0be6f503', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:49.755316 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba615db1-f140-42e1-97fe-c1bf234d6c92 tempest-VolumeQuotaClassesTest-1130747266 tempest-VolumeQuotaClassesTest-1130747266-project-admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:49.755601 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba615db1-f140-42e1-97fe-c1bf234d6c92 tempest-VolumeQuotaClassesTest-1130747266 tempest-VolumeQuotaClassesTest-1130747266-project-admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:49.755875 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba615db1-f140-42e1-97fe-c1bf234d6c92 tempest-VolumeQuotaClassesTest-1130747266 tempest-VolumeQuotaClassesTest-1130747266-project-admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:49.756509 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba615db1-f140-42e1-97fe-c1bf234d6c92 tempest-VolumeQuotaClassesTest-1130747266 tempest-VolumeQuotaClassesTest-1130747266-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:49.758456 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba615db1-f140-42e1-97fe-c1bf234d6c92 tempest-VolumeQuotaClassesTest-1130747266 tempest-VolumeQuotaClassesTest-1130747266-project-admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:49.784619 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1378/2789] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:09:49 2022] POST /identity/v3/projects => generated 353 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:09:49.788828 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab474f-7e59-4b0e-abf3-1b662a1ff8fe tempest-VolumeQuotaClassesTest-1130747266 tempest-VolumeQuotaClassesTest-1130747266-project-admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:49.799209 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab474f-7e59-4b0e-abf3-1b662a1ff8fe tempest-VolumeQuotaClassesTest-1130747266 tempest-VolumeQuotaClassesTest-1130747266-project-admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:49.824325 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:49.854327 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f3838-3678-466a-bb0b-534493cd0da8 tempest-VolumeQuotaClassesTest-1130747266 tempest-VolumeQuotaClassesTest-1130747266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa53eead725c43afa301c1fa9e16e6b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8b4e8b637f4c299e126a2d0be6f503', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:49.854925 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f3838-3678-466a-bb0b-534493cd0da8 tempest-VolumeQuotaClassesTest-1130747266 tempest-VolumeQuotaClassesTest-1130747266-project-admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:49.855211 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f3838-3678-466a-bb0b-534493cd0da8 tempest-VolumeQuotaClassesTest-1130747266 tempest-VolumeQuotaClassesTest-1130747266-project-admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:49.855481 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f3838-3678-466a-bb0b-534493cd0da8 tempest-VolumeQuotaClassesTest-1130747266 tempest-VolumeQuotaClassesTest-1130747266-project-admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:49.856109 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f3838-3678-466a-bb0b-534493cd0da8 tempest-VolumeQuotaClassesTest-1130747266 tempest-VolumeQuotaClassesTest-1130747266-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:09:49.856434 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f3838-3678-466a-bb0b-534493cd0da8 tempest-VolumeQuotaClassesTest-1130747266 tempest-VolumeQuotaClassesTest-1130747266-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:49.858044 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f3838-3678-466a-bb0b-534493cd0da8 tempest-VolumeQuotaClassesTest-1130747266 tempest-VolumeQuotaClassesTest-1130747266-project-admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:49.869592 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1412/2790] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 16:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:09:49.905702 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba615db1-f140-42e1-97fe-c1bf234d6c92 tempest-VolumeQuotaClassesTest-1130747266 tempest-VolumeQuotaClassesTest-1130747266-project-admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:49.916150 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba615db1-f140-42e1-97fe-c1bf234d6c92 tempest-VolumeQuotaClassesTest-1130747266 tempest-VolumeQuotaClassesTest-1130747266-project-admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:49.920631 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217b157-b416-409a-86e4-0645f0dcfe82 tempest-VolumeQuotaClassesTest-1130747266 tempest-VolumeQuotaClassesTest-1130747266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa53eead725c43afa301c1fa9e16e6b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8b4e8b637f4c299e126a2d0be6f503', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:49.921294 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217b157-b416-409a-86e4-0645f0dcfe82 tempest-VolumeQuotaClassesTest-1130747266 tempest-VolumeQuotaClassesTest-1130747266-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:49.921578 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217b157-b416-409a-86e4-0645f0dcfe82 tempest-VolumeQuotaClassesTest-1130747266 tempest-VolumeQuotaClassesTest-1130747266-project-admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:49.921866 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217b157-b416-409a-86e4-0645f0dcfe82 tempest-VolumeQuotaClassesTest-1130747266 tempest-VolumeQuotaClassesTest-1130747266-project-admin] PATH_INFO: `/v3/projects/ffe3d94399ec4898801de9554f222e67` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:49.922961 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217b157-b416-409a-86e4-0645f0dcfe82 tempest-VolumeQuotaClassesTest-1130747266 tempest-VolumeQuotaClassesTest-1130747266-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ffe3d94399ec4898801de9554f222e67)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:49.924880 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217b157-b416-409a-86e4-0645f0dcfe82 tempest-VolumeQuotaClassesTest-1130747266 tempest-VolumeQuotaClassesTest-1130747266-project-admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:49.971682 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-d217b157-b416-409a-86e4-0645f0dcfe82 tempest-VolumeQuotaClassesTest-1130747266 tempest-VolumeQuotaClassesTest-1130747266-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffe3d94399ec4898801de9554f222e67', 'request_id': 'req-d217b157-b416-409a-86e4-0645f0dcfe82'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:49.977402 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-d217b157-b416-409a-86e4-0645f0dcfe82 tempest-VolumeQuotaClassesTest-1130747266 tempest-VolumeQuotaClassesTest-1130747266-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffe3d94399ec4898801de9554f222e67', 'request_id': 'req-d217b157-b416-409a-86e4-0645f0dcfe82'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:49.981294 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:49.985836 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-d217b157-b416-409a-86e4-0645f0dcfe82 tempest-VolumeQuotaClassesTest-1130747266 tempest-VolumeQuotaClassesTest-1130747266-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffe3d94399ec4898801de9554f222e67', 'request_id': 'req-d217b157-b416-409a-86e4-0645f0dcfe82'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:49.999042 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-d217b157-b416-409a-86e4-0645f0dcfe82 tempest-VolumeQuotaClassesTest-1130747266 tempest-VolumeQuotaClassesTest-1130747266-project-admin] The token cache is being invalidate because project ffe3d94399ec4898801de9554f222e67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:09:49.999330 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-d217b157-b416-409a-86e4-0645f0dcfe82 tempest-VolumeQuotaClassesTest-1130747266 tempest-VolumeQuotaClassesTest-1130747266-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:49.999972 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-d217b157-b416-409a-86e4-0645f0dcfe82 tempest-VolumeQuotaClassesTest-1130747266 tempest-VolumeQuotaClassesTest-1130747266-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:50.001482 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1379/2791] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:09:49 2022] DELETE /identity/v3/projects/ffe3d94399ec4898801de9554f222e67 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:50.190398 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f3838-3678-466a-bb0b-534493cd0da8 tempest-VolumeQuotaClassesTest-1130747266 tempest-VolumeQuotaClassesTest-1130747266-project-admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:50.192294 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7d1f3838-3678-466a-bb0b-534493cd0da8 tempest-VolumeQuotaClassesTest-1130747266 tempest-VolumeQuotaClassesTest-1130747266-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:50.260636 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f3838-3678-466a-bb0b-534493cd0da8 tempest-VolumeQuotaClassesTest-1130747266 tempest-VolumeQuotaClassesTest-1130747266-project-admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:50.317875 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a92f8-ab89-40c7-8bc3-03fc3577cc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:50.318505 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a92f8-ab89-40c7-8bc3-03fc3577cc97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:50.318781 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a92f8-ab89-40c7-8bc3-03fc3577cc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:50.319047 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a92f8-ab89-40c7-8bc3-03fc3577cc97 admin admin] PATH_INFO: `/v3/users/bbfb6e51810946fc9255704d41d310c2` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:50.320167 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a92f8-ab89-40c7-8bc3-03fc3577cc97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbfb6e51810946fc9255704d41d310c2)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:50.323211 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a92f8-ab89-40c7-8bc3-03fc3577cc97 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:50.372814 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-257a92f8-ab89-40c7-8bc3-03fc3577cc97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbfb6e51810946fc9255704d41d310c2'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:50.373546 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-257a92f8-ab89-40c7-8bc3-03fc3577cc97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbfb6e51810946fc9255704d41d310c2'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:50.381942 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-257a92f8-ab89-40c7-8bc3-03fc3577cc97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbfb6e51810946fc9255704d41d310c2'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:50.395346 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-257a92f8-ab89-40c7-8bc3-03fc3577cc97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbfb6e51810946fc9255704d41d310c2'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:50.396508 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:50.404312 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-257a92f8-ab89-40c7-8bc3-03fc3577cc97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbfb6e51810946fc9255704d41d310c2'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:50.411003 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1413/2792] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:09:50 2022] DELETE /identity/v3/users/bbfb6e51810946fc9255704d41d310c2 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:09:50.415556 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ead248-bc41-4d4a-9bcf-669fe9a8dd96 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:50.416039 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ead248-bc41-4d4a-9bcf-669fe9a8dd96 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:50.416153 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ead248-bc41-4d4a-9bcf-669fe9a8dd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:50.435026 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-71ead248-bc41-4d4a-9bcf-669fe9a8dd96 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:50.436215 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-71ead248-bc41-4d4a-9bcf-669fe9a8dd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:50.492437 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1380/2793] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:09:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:50.503150 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a92f8-ab89-40c7-8bc3-03fc3577cc97 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:50.504558 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-257a92f8-ab89-40c7-8bc3-03fc3577cc97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:50.561392 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a92f8-ab89-40c7-8bc3-03fc3577cc97 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:50.564983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1dc24-14ae-4492-822b-7c6654275e48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:50.565580 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1dc24-14ae-4492-822b-7c6654275e48 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:50.565856 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1dc24-14ae-4492-822b-7c6654275e48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:50.566126 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1dc24-14ae-4492-822b-7c6654275e48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:50.575548 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1dc24-14ae-4492-822b-7c6654275e48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:50.577010 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1dc24-14ae-4492-822b-7c6654275e48 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:50.586246 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1414/2794] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:09:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:09:50.861874 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ead248-bc41-4d4a-9bcf-669fe9a8dd96 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:50.863302 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-71ead248-bc41-4d4a-9bcf-669fe9a8dd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:50.876037 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ead248-bc41-4d4a-9bcf-669fe9a8dd96 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:50.880632 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b835f3-5014-4fb0-8fd9-6eae50f55f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:50.881293 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b835f3-5014-4fb0-8fd9-6eae50f55f91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:50.881575 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b835f3-5014-4fb0-8fd9-6eae50f55f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:50.881844 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b835f3-5014-4fb0-8fd9-6eae50f55f91 admin admin] PATH_INFO: `/v3/projects/b4252958dc0e46c5a206c503f2d6a1f6` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:50.883317 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b835f3-5014-4fb0-8fd9-6eae50f55f91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4252958dc0e46c5a206c503f2d6a1f6)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:50.885496 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b835f3-5014-4fb0-8fd9-6eae50f55f91 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:50.935088 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-f1b835f3-5014-4fb0-8fd9-6eae50f55f91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4252958dc0e46c5a206c503f2d6a1f6', 'request_id': 'req-f1b835f3-5014-4fb0-8fd9-6eae50f55f91'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:50.940921 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-f1b835f3-5014-4fb0-8fd9-6eae50f55f91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4252958dc0e46c5a206c503f2d6a1f6', 'request_id': 'req-f1b835f3-5014-4fb0-8fd9-6eae50f55f91'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:50.948488 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-f1b835f3-5014-4fb0-8fd9-6eae50f55f91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4252958dc0e46c5a206c503f2d6a1f6', 'request_id': 'req-f1b835f3-5014-4fb0-8fd9-6eae50f55f91'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:50.959450 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-f1b835f3-5014-4fb0-8fd9-6eae50f55f91 admin admin] The token cache is being invalidate because project b4252958dc0e46c5a206c503f2d6a1f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:09:50.959733 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-f1b835f3-5014-4fb0-8fd9-6eae50f55f91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:50.960354 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-f1b835f3-5014-4fb0-8fd9-6eae50f55f91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:50.962742 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1381/2795] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:09:50 2022] DELETE /identity/v3/projects/b4252958dc0e46c5a206c503f2d6a1f6 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:50.966826 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1dc24-14ae-4492-822b-7c6654275e48 service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:50.976481 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1dc24-14ae-4492-822b-7c6654275e48 service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:51.032250 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6dff78-64f1-45bc-82a0-a8b8965cf2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:51.032922 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6dff78-64f1-45bc-82a0-a8b8965cf2fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:51.033206 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6dff78-64f1-45bc-82a0-a8b8965cf2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:51.033481 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6dff78-64f1-45bc-82a0-a8b8965cf2fd admin admin] PATH_INFO: `/v3/users/aa53eead725c43afa301c1fa9e16e6b5` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:51.034650 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6dff78-64f1-45bc-82a0-a8b8965cf2fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa53eead725c43afa301c1fa9e16e6b5)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:51.036661 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6dff78-64f1-45bc-82a0-a8b8965cf2fd admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:51.081996 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6e6dff78-64f1-45bc-82a0-a8b8965cf2fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa53eead725c43afa301c1fa9e16e6b5'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:51.082641 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6e6dff78-64f1-45bc-82a0-a8b8965cf2fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa53eead725c43afa301c1fa9e16e6b5'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:51.091466 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6e6dff78-64f1-45bc-82a0-a8b8965cf2fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa53eead725c43afa301c1fa9e16e6b5'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:51.104270 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6e6dff78-64f1-45bc-82a0-a8b8965cf2fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa53eead725c43afa301c1fa9e16e6b5'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:51.111088 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6e6dff78-64f1-45bc-82a0-a8b8965cf2fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa53eead725c43afa301c1fa9e16e6b5'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:51.116774 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1415/2796] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:09:50 2022] DELETE /identity/v3/users/aa53eead725c43afa301c1fa9e16e6b5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:51.380423 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b835f3-5014-4fb0-8fd9-6eae50f55f91 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:51.381859 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-f1b835f3-5014-4fb0-8fd9-6eae50f55f91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:51.396418 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b835f3-5014-4fb0-8fd9-6eae50f55f91 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:51.453919 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca752d-1854-45cd-894f-b3339665b25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:51.454552 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca752d-1854-45cd-894f-b3339665b25a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:51.454828 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca752d-1854-45cd-894f-b3339665b25a admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:51.455096 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca752d-1854-45cd-894f-b3339665b25a admin admin] PATH_INFO: `/v3/projects/4d8b4e8b637f4c299e126a2d0be6f503` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:51.456205 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca752d-1854-45cd-894f-b3339665b25a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d8b4e8b637f4c299e126a2d0be6f503)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:51.458113 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca752d-1854-45cd-894f-b3339665b25a admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:51.474779 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:51.506932 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-32ca752d-1854-45cd-894f-b3339665b25a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d8b4e8b637f4c299e126a2d0be6f503', 'request_id': 'req-32ca752d-1854-45cd-894f-b3339665b25a'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:51.513434 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-32ca752d-1854-45cd-894f-b3339665b25a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d8b4e8b637f4c299e126a2d0be6f503', 'request_id': 'req-32ca752d-1854-45cd-894f-b3339665b25a'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:51.521878 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-32ca752d-1854-45cd-894f-b3339665b25a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d8b4e8b637f4c299e126a2d0be6f503', 'request_id': 'req-32ca752d-1854-45cd-894f-b3339665b25a'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:51.534699 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-32ca752d-1854-45cd-894f-b3339665b25a admin admin] The token cache is being invalidate because project 4d8b4e8b637f4c299e126a2d0be6f503 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:09:51.534976 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-32ca752d-1854-45cd-894f-b3339665b25a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:51.535623 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-32ca752d-1854-45cd-894f-b3339665b25a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:51.537119 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1382/2797] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:09:51 2022] DELETE /identity/v3/projects/4d8b4e8b637f4c299e126a2d0be6f503 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:51.542238 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7aed2e-49e1-4f44-a1cf-fc07ad1b8100 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:51.542746 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7aed2e-49e1-4f44-a1cf-fc07ad1b8100 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:51.542859 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7aed2e-49e1-4f44-a1cf-fc07ad1b8100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:51.563299 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-1d7aed2e-49e1-4f44-a1cf-fc07ad1b8100 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:51.564728 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-1d7aed2e-49e1-4f44-a1cf-fc07ad1b8100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:51.570320 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:51.630797 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1416/2798] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:51.694933 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19538f2-3fbd-4165-b7bb-06f66a4e480e None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:51.695234 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19538f2-3fbd-4165-b7bb-06f66a4e480e None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:51.695511 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19538f2-3fbd-4165-b7bb-06f66a4e480e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:51.717911 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-d19538f2-3fbd-4165-b7bb-06f66a4e480e None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:51.719129 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-d19538f2-3fbd-4165-b7bb-06f66a4e480e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:51.728676 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1383/2799] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:09:51.733062 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7aed2e-49e1-4f44-a1cf-fc07ad1b8100 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:51.744537 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7aed2e-49e1-4f44-a1cf-fc07ad1b8100 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:51.749268 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b33104-fb2d-4e3f-b8ce-2dee90b0db7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:51.749877 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b33104-fb2d-4e3f-b8ce-2dee90b0db7c admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:51.750162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b33104-fb2d-4e3f-b8ce-2dee90b0db7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:51.750432 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b33104-fb2d-4e3f-b8ce-2dee90b0db7c admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:51.751124 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b33104-fb2d-4e3f-b8ce-2dee90b0db7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:09:51.751431 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b33104-fb2d-4e3f-b8ce-2dee90b0db7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:51.753059 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b33104-fb2d-4e3f-b8ce-2dee90b0db7c admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:51.767448 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1417/2800] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 16:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:09:51.771867 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19538f2-3fbd-4165-b7bb-06f66a4e480e None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:51.781292 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19538f2-3fbd-4165-b7bb-06f66a4e480e None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:51.785865 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c9a70c-8364-49fb-a5a4-01c3dd789e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:51.786450 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9a70c-8364-49fb-a5a4-01c3dd789e55 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:51.786813 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9a70c-8364-49fb-a5a4-01c3dd789e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:51.787011 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9a70c-8364-49fb-a5a4-01c3dd789e55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:51.787678 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c9a70c-8364-49fb-a5a4-01c3dd789e55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:51.789830 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c9a70c-8364-49fb-a5a4-01c3dd789e55 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:51.815593 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1384/2801] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:09:51 2022] POST /identity/v3/projects => generated 393 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:09:51.819659 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b33104-fb2d-4e3f-b8ce-2dee90b0db7c admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:51.830636 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b33104-fb2d-4e3f-b8ce-2dee90b0db7c admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:51.887560 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff08d0f-9a21-4ac3-ab8b-a78eb65fa17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:51.888092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff08d0f-9a21-4ac3-ab8b-a78eb65fa17d admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:51.888370 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff08d0f-9a21-4ac3-ab8b-a78eb65fa17d admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:51.888639 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff08d0f-9a21-4ac3-ab8b-a78eb65fa17d admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:51.889311 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff08d0f-9a21-4ac3-ab8b-a78eb65fa17d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:51.891209 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff08d0f-9a21-4ac3-ab8b-a78eb65fa17d admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:51.912119 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1418/2802] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:09:51 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:09:51.916185 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c9a70c-8364-49fb-a5a4-01c3dd789e55 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:51.926264 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c9a70c-8364-49fb-a5a4-01c3dd789e55 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:51.931427 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e38a2-2ccf-42c1-9d94-c3455ebb3dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:51.932168 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e38a2-2ccf-42c1-9d94-c3455ebb3dab admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:51.932445 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e38a2-2ccf-42c1-9d94-c3455ebb3dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:51.932713 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e38a2-2ccf-42c1-9d94-c3455ebb3dab admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:51.933379 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e38a2-2ccf-42c1-9d94-c3455ebb3dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:51.934959 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e38a2-2ccf-42c1-9d94-c3455ebb3dab admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:51.945162 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1385/2803] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:09:51.949712 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff08d0f-9a21-4ac3-ab8b-a78eb65fa17d admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:51.959540 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff08d0f-9a21-4ac3-ab8b-a78eb65fa17d admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:51.964484 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85f4ce-2c18-4550-a4d9-cf97642526da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:51.965113 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85f4ce-2c18-4550-a4d9-cf97642526da admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:51.965408 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85f4ce-2c18-4550-a4d9-cf97642526da admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:51.965665 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85f4ce-2c18-4550-a4d9-cf97642526da admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:51.966301 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85f4ce-2c18-4550-a4d9-cf97642526da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:51.967873 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85f4ce-2c18-4550-a4d9-cf97642526da admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:51.978257 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1419/2804] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:09:51.982115 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e38a2-2ccf-42c1-9d94-c3455ebb3dab admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:51.991809 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e38a2-2ccf-42c1-9d94-c3455ebb3dab admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:51.997179 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af115d40-2558-4ca2-b2c4-3ed7f11b8dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:51.997812 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af115d40-2558-4ca2-b2c4-3ed7f11b8dfb admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:51.998087 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af115d40-2558-4ca2-b2c4-3ed7f11b8dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:51.998353 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af115d40-2558-4ca2-b2c4-3ed7f11b8dfb admin admin] PATH_INFO: `/v3/projects/f28652e930f4421f83c63aa7a0134ad5/users/afb50e787a984fb188d81b05baf3e2cb/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:52.013211 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af115d40-2558-4ca2-b2c4-3ed7f11b8dfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f28652e930f4421f83c63aa7a0134ad5, user_id=afb50e787a984fb188d81b05baf3e2cb, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:52.015839 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af115d40-2558-4ca2-b2c4-3ed7f11b8dfb admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:52.028865 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1386/2805] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:09:51 2022] PUT /identity/v3/projects/f28652e930f4421f83c63aa7a0134ad5/users/afb50e787a984fb188d81b05baf3e2cb/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:09:52.038676 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28357c-2637-45bc-b04f-d5f0e4fe9f5d None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:52.038960 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28357c-2637-45bc-b04f-d5f0e4fe9f5d None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:52.039232 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28357c-2637-45bc-b04f-d5f0e4fe9f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:52.070205 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-fb28357c-2637-45bc-b04f-d5f0e4fe9f5d None None] MFA Rules not processed for user `afb50e787a984fb188d81b05baf3e2cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:52.072136 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-fb28357c-2637-45bc-b04f-d5f0e4fe9f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:52.138804 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1420/2806] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:09:52 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:52.143129 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af115d40-2558-4ca2-b2c4-3ed7f11b8dfb admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:52.217010 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af115d40-2558-4ca2-b2c4-3ed7f11b8dfb admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:52.221896 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3a021-7b33-4118-aeb7-6b624a7a4a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:52.223368 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3a021-7b33-4118-aeb7-6b624a7a4a5e admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:52.223645 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3a021-7b33-4118-aeb7-6b624a7a4a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:52.223913 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3a021-7b33-4118-aeb7-6b624a7a4a5e admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:52.224543 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3a021-7b33-4118-aeb7-6b624a7a4a5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:52.226532 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3a021-7b33-4118-aeb7-6b624a7a4a5e admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:52.253749 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1387/2807] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:09:52 2022] POST /identity/v3/projects => generated 393 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:09:52.257809 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28357c-2637-45bc-b04f-d5f0e4fe9f5d None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:52.268762 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28357c-2637-45bc-b04f-d5f0e4fe9f5d None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:52.272247 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:52.326074 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff3263-da11-4a27-a1b0-6eee1a1b9ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:52.326682 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff3263-da11-4a27-a1b0-6eee1a1b9ba3 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:52.326959 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff3263-da11-4a27-a1b0-6eee1a1b9ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:52.327226 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff3263-da11-4a27-a1b0-6eee1a1b9ba3 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:52.327862 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff3263-da11-4a27-a1b0-6eee1a1b9ba3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:52.329798 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff3263-da11-4a27-a1b0-6eee1a1b9ba3 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:52.350472 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1421/2808] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:09:52 2022] POST /identity/v3/users => generated 303 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:09:52.355379 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3a021-7b33-4118-aeb7-6b624a7a4a5e admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:52.365757 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3a021-7b33-4118-aeb7-6b624a7a4a5e admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:52.371361 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777c9b0-73a6-4bc3-868f-c4cca023b2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:52.371962 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777c9b0-73a6-4bc3-868f-c4cca023b2cd admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:52.372240 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777c9b0-73a6-4bc3-868f-c4cca023b2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:52.372507 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777c9b0-73a6-4bc3-868f-c4cca023b2cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:52.373210 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777c9b0-73a6-4bc3-868f-c4cca023b2cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:52.374818 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777c9b0-73a6-4bc3-868f-c4cca023b2cd admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:52.385156 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1388/2809] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:09:52.389206 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff3263-da11-4a27-a1b0-6eee1a1b9ba3 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:52.399055 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff3263-da11-4a27-a1b0-6eee1a1b9ba3 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:52.403751 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec7821-ea7c-4097-9609-f82ae11fcc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:52.404397 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec7821-ea7c-4097-9609-f82ae11fcc2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:52.404674 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec7821-ea7c-4097-9609-f82ae11fcc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:52.404983 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec7821-ea7c-4097-9609-f82ae11fcc2b admin admin] PATH_INFO: `/v3/projects/e5fd73961a1e4a1ca47be7f72d4cfeff/users/50f98b90bd334ade837a135e0a08a230/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:52.419651 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec7821-ea7c-4097-9609-f82ae11fcc2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5fd73961a1e4a1ca47be7f72d4cfeff, user_id=50f98b90bd334ade837a135e0a08a230, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:52.422322 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec7821-ea7c-4097-9609-f82ae11fcc2b admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:52.435872 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1422/2810] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:09:52 2022] PUT /identity/v3/projects/e5fd73961a1e4a1ca47be7f72d4cfeff/users/50f98b90bd334ade837a135e0a08a230/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:52.439850 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777c9b0-73a6-4bc3-868f-c4cca023b2cd admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:52.451616 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777c9b0-73a6-4bc3-868f-c4cca023b2cd admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:52.463509 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:52.509763 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ab16d-116a-412a-addc-84f7ceb5cbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:52.510367 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ab16d-116a-412a-addc-84f7ceb5cbea admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:52.510649 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ab16d-116a-412a-addc-84f7ceb5cbea admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:52.510928 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ab16d-116a-412a-addc-84f7ceb5cbea admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:52.511566 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ab16d-116a-412a-addc-84f7ceb5cbea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:52.513203 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ab16d-116a-412a-addc-84f7ceb5cbea admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:52.522908 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1389/2811] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:09:52.527565 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec7821-ea7c-4097-9609-f82ae11fcc2b admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:52.537724 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec7821-ea7c-4097-9609-f82ae11fcc2b admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:52.542999 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e875db-ff9d-4a7e-8971-f1235d6c56c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:52.543646 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e875db-ff9d-4a7e-8971-f1235d6c56c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:52.543927 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e875db-ff9d-4a7e-8971-f1235d6c56c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:52.544204 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e875db-ff9d-4a7e-8971-f1235d6c56c0 admin admin] PATH_INFO: `/v3/projects/e5fd73961a1e4a1ca47be7f72d4cfeff/users/50f98b90bd334ade837a135e0a08a230/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:52.546295 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e875db-ff9d-4a7e-8971-f1235d6c56c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5fd73961a1e4a1ca47be7f72d4cfeff, user_id=50f98b90bd334ade837a135e0a08a230, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:52.548948 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e875db-ff9d-4a7e-8971-f1235d6c56c0 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:52.558969 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1423/2812] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:09:52 2022] PUT /identity/v3/projects/e5fd73961a1e4a1ca47be7f72d4cfeff/users/50f98b90bd334ade837a135e0a08a230/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:52.569037 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab9605-5c0d-45b8-bb50-070cb4c6c814 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:52.569329 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab9605-5c0d-45b8-bb50-070cb4c6c814 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:52.569608 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab9605-5c0d-45b8-bb50-070cb4c6c814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:52.597335 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-67ab9605-5c0d-45b8-bb50-070cb4c6c814 None None] MFA Rules not processed for user `50f98b90bd334ade837a135e0a08a230`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:52.598538 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-67ab9605-5c0d-45b8-bb50-070cb4c6c814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:52.667464 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1390/2813] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:09:52 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:52.677799 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e875db-ff9d-4a7e-8971-f1235d6c56c0 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:52.679495 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-f7e875db-ff9d-4a7e-8971-f1235d6c56c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:52.688013 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab9605-5c0d-45b8-bb50-070cb4c6c814 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:52.689408 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-67ab9605-5c0d-45b8-bb50-070cb4c6c814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:52.743069 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e875db-ff9d-4a7e-8971-f1235d6c56c0 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:52.747042 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aee40f-0db1-4da4-ae89-29db7a95e14c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:52.747653 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aee40f-0db1-4da4-ae89-29db7a95e14c service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:52.747933 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aee40f-0db1-4da4-ae89-29db7a95e14c service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:52.748203 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aee40f-0db1-4da4-ae89-29db7a95e14c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:52.757797 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aee40f-0db1-4da4-ae89-29db7a95e14c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:52.759390 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aee40f-0db1-4da4-ae89-29db7a95e14c service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:52.763284 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab9605-5c0d-45b8-bb50-070cb4c6c814 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:52.767920 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfc337-02e6-4cde-a2a6-feb7d97a9d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:52.768545 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfc337-02e6-4cde-a2a6-feb7d97a9d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:52.768871 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfc337-02e6-4cde-a2a6-feb7d97a9d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:52.768988 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1424/2814] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:09:52 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:09:52.769117 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfc337-02e6-4cde-a2a6-feb7d97a9d5e admin admin] PATH_INFO: `/v3/users/234fd6282a954edd908f938f9e0c26aa` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:52.770243 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cfc337-02e6-4cde-a2a6-feb7d97a9d5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=234fd6282a954edd908f938f9e0c26aa)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:52.772159 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cfc337-02e6-4cde-a2a6-feb7d97a9d5e admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:52.815772 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:52.816872 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aee40f-0db1-4da4-ae89-29db7a95e14c service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:52.818443 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-01aee40f-0db1-4da4-ae89-29db7a95e14c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:52.822751 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-66cfc337-02e6-4cde-a2a6-feb7d97a9d5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '234fd6282a954edd908f938f9e0c26aa'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:52.830254 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aee40f-0db1-4da4-ae89-29db7a95e14c service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:52.834103 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b159a57-ae2d-4f7c-906a-c02a143d2ad7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:52.834714 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b159a57-ae2d-4f7c-906a-c02a143d2ad7 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:52.835156 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b159a57-ae2d-4f7c-906a-c02a143d2ad7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:52.835445 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b159a57-ae2d-4f7c-906a-c02a143d2ad7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:52.835868 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-66cfc337-02e6-4cde-a2a6-feb7d97a9d5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '234fd6282a954edd908f938f9e0c26aa'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:52.836541 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-66cfc337-02e6-4cde-a2a6-feb7d97a9d5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '234fd6282a954edd908f938f9e0c26aa'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:52.837854 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-66cfc337-02e6-4cde-a2a6-feb7d97a9d5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '234fd6282a954edd908f938f9e0c26aa'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:52.846069 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-66cfc337-02e6-4cde-a2a6-feb7d97a9d5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '234fd6282a954edd908f938f9e0c26aa'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:52.858909 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1391/2815] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:09:52 2022] DELETE /identity/v3/users/234fd6282a954edd908f938f9e0c26aa => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:09:52.863166 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e50dbd-1983-43c2-8bf5-67604f3b4dd2 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:52.863455 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e50dbd-1983-43c2-8bf5-67604f3b4dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:52.863730 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e50dbd-1983-43c2-8bf5-67604f3b4dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:52.882744 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-33e50dbd-1983-43c2-8bf5-67604f3b4dd2 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:52.884435 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-33e50dbd-1983-43c2-8bf5-67604f3b4dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:52.896263 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b159a57-ae2d-4f7c-906a-c02a143d2ad7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:52.897747 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b159a57-ae2d-4f7c-906a-c02a143d2ad7 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:52.903802 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:52.909324 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1425/2816] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:09:52 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:09:52.944357 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1392/2817] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:09:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:52.954456 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b159a57-ae2d-4f7c-906a-c02a143d2ad7 service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:52.955960 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-3b159a57-ae2d-4f7c-906a-c02a143d2ad7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:53.013516 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b159a57-ae2d-4f7c-906a-c02a143d2ad7 service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:53.068196 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639cde09-9bb3-4185-9a27-a6dab0afe1a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:53.068808 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639cde09-9bb3-4185-9a27-a6dab0afe1a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:53.069238 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639cde09-9bb3-4185-9a27-a6dab0afe1a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:53.069515 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639cde09-9bb3-4185-9a27-a6dab0afe1a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:53.080028 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639cde09-9bb3-4185-9a27-a6dab0afe1a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:53.081674 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639cde09-9bb3-4185-9a27-a6dab0afe1a9 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:53.093277 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1426/2818] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:09:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:09:53.382095 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e50dbd-1983-43c2-8bf5-67604f3b4dd2 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:53.383728 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-33e50dbd-1983-43c2-8bf5-67604f3b4dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:53.396589 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e50dbd-1983-43c2-8bf5-67604f3b4dd2 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:53.401244 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f067c8-830e-4c3b-8e15-764819e4b206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:53.401861 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f067c8-830e-4c3b-8e15-764819e4b206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:53.402138 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f067c8-830e-4c3b-8e15-764819e4b206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:53.402407 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f067c8-830e-4c3b-8e15-764819e4b206 admin admin] PATH_INFO: `/v3/projects/f134c0e44bc64d10b83eb74cd197185f` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:53.403535 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f067c8-830e-4c3b-8e15-764819e4b206 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f134c0e44bc64d10b83eb74cd197185f)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:53.405472 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f067c8-830e-4c3b-8e15-764819e4b206 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:53.453371 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-82f067c8-830e-4c3b-8e15-764819e4b206 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f134c0e44bc64d10b83eb74cd197185f', 'request_id': 'req-82f067c8-830e-4c3b-8e15-764819e4b206'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:53.458693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-82f067c8-830e-4c3b-8e15-764819e4b206 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f134c0e44bc64d10b83eb74cd197185f', 'request_id': 'req-82f067c8-830e-4c3b-8e15-764819e4b206'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:53.466145 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-82f067c8-830e-4c3b-8e15-764819e4b206 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f134c0e44bc64d10b83eb74cd197185f', 'request_id': 'req-82f067c8-830e-4c3b-8e15-764819e4b206'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:53.476967 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-82f067c8-830e-4c3b-8e15-764819e4b206 admin admin] The token cache is being invalidate because project f134c0e44bc64d10b83eb74cd197185f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:09:53.477253 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-82f067c8-830e-4c3b-8e15-764819e4b206 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:53.478008 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-82f067c8-830e-4c3b-8e15-764819e4b206 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:53.479516 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1393/2819] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:09:53 2022] DELETE /identity/v3/projects/f134c0e44bc64d10b83eb74cd197185f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:53.483446 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639cde09-9bb3-4185-9a27-a6dab0afe1a9 service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:53.493768 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639cde09-9bb3-4185-9a27-a6dab0afe1a9 service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:53.548310 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87590c1f-5fb1-4da9-9c22-961519b961f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:53.549076 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87590c1f-5fb1-4da9-9c22-961519b961f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:53.549353 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87590c1f-5fb1-4da9-9c22-961519b961f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:53.549700 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87590c1f-5fb1-4da9-9c22-961519b961f1 admin admin] PATH_INFO: `/v3/users/bf6252efd0b042d3bd605ce324583161` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:53.550853 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87590c1f-5fb1-4da9-9c22-961519b961f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf6252efd0b042d3bd605ce324583161)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:53.552740 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87590c1f-5fb1-4da9-9c22-961519b961f1 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:53.598341 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-87590c1f-5fb1-4da9-9c22-961519b961f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf6252efd0b042d3bd605ce324583161'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:53.599010 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-87590c1f-5fb1-4da9-9c22-961519b961f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf6252efd0b042d3bd605ce324583161'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:53.606574 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-87590c1f-5fb1-4da9-9c22-961519b961f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf6252efd0b042d3bd605ce324583161'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:53.612625 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:53.621363 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-87590c1f-5fb1-4da9-9c22-961519b961f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf6252efd0b042d3bd605ce324583161'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:53.628326 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-87590c1f-5fb1-4da9-9c22-961519b961f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf6252efd0b042d3bd605ce324583161'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:53.634305 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1427/2820] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:09:53 2022] DELETE /identity/v3/users/bf6252efd0b042d3bd605ce324583161 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:53.896550 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f067c8-830e-4c3b-8e15-764819e4b206 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:53.898044 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-82f067c8-830e-4c3b-8e15-764819e4b206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:53.910998 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f067c8-830e-4c3b-8e15-764819e4b206 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:53.949850 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:53.970245 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b033c-fe1c-4ff5-80dd-597cd971f6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:53.971198 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b033c-fe1c-4ff5-80dd-597cd971f6f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:53.971198 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b033c-fe1c-4ff5-80dd-597cd971f6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:53.971428 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b033c-fe1c-4ff5-80dd-597cd971f6f0 admin admin] PATH_INFO: `/v3/projects/866151cbf7e442a59a8ca380c93725eb` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:53.972573 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b033c-fe1c-4ff5-80dd-597cd971f6f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=866151cbf7e442a59a8ca380c93725eb)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:53.974812 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b033c-fe1c-4ff5-80dd-597cd971f6f0 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:54.021955 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-245b033c-fe1c-4ff5-80dd-597cd971f6f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '866151cbf7e442a59a8ca380c93725eb', 'request_id': 'req-245b033c-fe1c-4ff5-80dd-597cd971f6f0'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:54.027983 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-245b033c-fe1c-4ff5-80dd-597cd971f6f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '866151cbf7e442a59a8ca380c93725eb', 'request_id': 'req-245b033c-fe1c-4ff5-80dd-597cd971f6f0'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:54.035293 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-245b033c-fe1c-4ff5-80dd-597cd971f6f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '866151cbf7e442a59a8ca380c93725eb', 'request_id': 'req-245b033c-fe1c-4ff5-80dd-597cd971f6f0'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:54.047278 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-245b033c-fe1c-4ff5-80dd-597cd971f6f0 admin admin] The token cache is being invalidate because project 866151cbf7e442a59a8ca380c93725eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:09:54.047565 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-245b033c-fe1c-4ff5-80dd-597cd971f6f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:54.048224 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-245b033c-fe1c-4ff5-80dd-597cd971f6f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:54.049740 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1394/2821] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:09:53 2022] DELETE /identity/v3/projects/866151cbf7e442a59a8ca380c93725eb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:54.055638 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb8075-2ba5-47f9-8640-9b3bb2956138 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:54.055979 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb8075-2ba5-47f9-8640-9b3bb2956138 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:54.056239 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb8075-2ba5-47f9-8640-9b3bb2956138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:54.076042 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-e3eb8075-2ba5-47f9-8640-9b3bb2956138 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:54.077259 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-e3eb8075-2ba5-47f9-8640-9b3bb2956138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:54.137291 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1428/2822] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:09:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:54.145015 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdf240-b255-4720-b936-f2090bcd7bec None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:54.145297 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdf240-b255-4720-b936-f2090bcd7bec None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:54.145565 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdf240-b255-4720-b936-f2090bcd7bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:54.166767 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-2ebdf240-b255-4720-b936-f2090bcd7bec None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:54.167959 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-2ebdf240-b255-4720-b936-f2090bcd7bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:54.175792 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1395/2823] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:09:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:54.179944 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb8075-2ba5-47f9-8640-9b3bb2956138 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:54.191218 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb8075-2ba5-47f9-8640-9b3bb2956138 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:54.195892 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502cc044-6558-426a-a2a2-ec1918766c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:54.197045 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cc044-6558-426a-a2a2-ec1918766c33 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:54.197339 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cc044-6558-426a-a2a2-ec1918766c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:54.197627 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cc044-6558-426a-a2a2-ec1918766c33 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:54.198268 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502cc044-6558-426a-a2a2-ec1918766c33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:09:54.198570 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502cc044-6558-426a-a2a2-ec1918766c33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:54.200148 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502cc044-6558-426a-a2a2-ec1918766c33 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:54.212871 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1429/2824] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 16:09:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:09:54.217307 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebdf240-b255-4720-b936-f2090bcd7bec None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:54.235079 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebdf240-b255-4720-b936-f2090bcd7bec None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:54.240931 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2ff20-d41e-4fac-8823-afe477105d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:54.241537 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2ff20-d41e-4fac-8823-afe477105d09 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:54.241811 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2ff20-d41e-4fac-8823-afe477105d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:54.242076 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2ff20-d41e-4fac-8823-afe477105d09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:54.242704 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f2ff20-d41e-4fac-8823-afe477105d09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:54.244920 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f2ff20-d41e-4fac-8823-afe477105d09 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:54.272173 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1396/2825] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:09:54 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:09:54.277166 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502cc044-6558-426a-a2a2-ec1918766c33 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:54.288607 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502cc044-6558-426a-a2a2-ec1918766c33 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:54.348047 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b958e-a1eb-470c-b462-2ea1003f37da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:54.348684 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b958e-a1eb-470c-b462-2ea1003f37da admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:54.349006 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b958e-a1eb-470c-b462-2ea1003f37da admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:54.349280 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b958e-a1eb-470c-b462-2ea1003f37da admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:54.349909 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b958e-a1eb-470c-b462-2ea1003f37da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:54.351819 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b958e-a1eb-470c-b462-2ea1003f37da admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:54.373022 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1430/2826] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:09:54 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:09:54.377145 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2ff20-d41e-4fac-8823-afe477105d09 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:54.389091 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2ff20-d41e-4fac-8823-afe477105d09 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:54.393591 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052738a6-0b32-4c81-8dec-ded4aa36b5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:54.394285 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052738a6-0b32-4c81-8dec-ded4aa36b5ae admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:54.394453 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052738a6-0b32-4c81-8dec-ded4aa36b5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:54.394720 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052738a6-0b32-4c81-8dec-ded4aa36b5ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:54.395394 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052738a6-0b32-4c81-8dec-ded4aa36b5ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:54.397007 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052738a6-0b32-4c81-8dec-ded4aa36b5ae admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:54.408088 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1397/2827] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:09:54.411974 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b958e-a1eb-470c-b462-2ea1003f37da admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:54.421810 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b958e-a1eb-470c-b462-2ea1003f37da admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:54.426555 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d811e-c4d9-4a4f-8d79-9d62cb77bb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:54.427153 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d811e-c4d9-4a4f-8d79-9d62cb77bb17 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:54.427430 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d811e-c4d9-4a4f-8d79-9d62cb77bb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:54.427699 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d811e-c4d9-4a4f-8d79-9d62cb77bb17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:54.428336 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d811e-c4d9-4a4f-8d79-9d62cb77bb17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:54.429929 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d811e-c4d9-4a4f-8d79-9d62cb77bb17 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:54.440629 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1431/2828] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:09:54.444974 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052738a6-0b32-4c81-8dec-ded4aa36b5ae admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:54.456750 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052738a6-0b32-4c81-8dec-ded4aa36b5ae admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:54.461420 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f14b6-9656-463c-9424-486f8b4819fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:54.462721 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f14b6-9656-463c-9424-486f8b4819fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:54.463004 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f14b6-9656-463c-9424-486f8b4819fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:54.463277 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f14b6-9656-463c-9424-486f8b4819fb admin admin] PATH_INFO: `/v3/projects/f518d3364296499f9b04105e065e084b/users/49f18d68b7d0406fa548729167ebb0a3/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:54.479945 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f14b6-9656-463c-9424-486f8b4819fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f518d3364296499f9b04105e065e084b, user_id=49f18d68b7d0406fa548729167ebb0a3, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:54.482842 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f14b6-9656-463c-9424-486f8b4819fb admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:54.497429 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1398/2829] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:09:54 2022] PUT /identity/v3/projects/f518d3364296499f9b04105e065e084b/users/49f18d68b7d0406fa548729167ebb0a3/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:54.506902 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b49553-3261-457b-824c-91e06739797d None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:54.507264 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b49553-3261-457b-824c-91e06739797d None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:54.507577 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b49553-3261-457b-824c-91e06739797d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:54.536571 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-b2b49553-3261-457b-824c-91e06739797d None None] MFA Rules not processed for user `49f18d68b7d0406fa548729167ebb0a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:54.537615 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-b2b49553-3261-457b-824c-91e06739797d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:54.570142 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:54.606611 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1432/2830] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:09:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:54.618685 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f14b6-9656-463c-9424-486f8b4819fb admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:54.620487 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-f33f14b6-9656-463c-9424-486f8b4819fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:54.682417 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f14b6-9656-463c-9424-486f8b4819fb admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:54.686196 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a907d3-8d30-4c75-a546-c481ed312bff service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9bd815f8fe54d7d99e00a47212ad9ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:54.686910 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a907d3-8d30-4c75-a546-c481ed312bff service glance] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:54.687290 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a907d3-8d30-4c75-a546-c481ed312bff service glance] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:54.687638 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a907d3-8d30-4c75-a546-c481ed312bff service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:54.696935 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a907d3-8d30-4c75-a546-c481ed312bff service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:54.698389 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a907d3-8d30-4c75-a546-c481ed312bff service glance] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:54.707527 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1399/2831] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:09:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:09:56.249026 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b49553-3261-457b-824c-91e06739797d None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:56.250522 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-b2b49553-3261-457b-824c-91e06739797d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:56.314786 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b49553-3261-457b-824c-91e06739797d None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:56.319359 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a1edb-6703-48d7-8671-8c84be020ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:56.319932 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a1edb-6703-48d7-8671-8c84be020ea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:56.320210 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a1edb-6703-48d7-8671-8c84be020ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:56.320479 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a1edb-6703-48d7-8671-8c84be020ea6 admin admin] PATH_INFO: `/v3/users/afb50e787a984fb188d81b05baf3e2cb` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:56.321676 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a1edb-6703-48d7-8671-8c84be020ea6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afb50e787a984fb188d81b05baf3e2cb)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:56.323579 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a1edb-6703-48d7-8671-8c84be020ea6 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:56.370117 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-249a1edb-6703-48d7-8671-8c84be020ea6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afb50e787a984fb188d81b05baf3e2cb'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:56.370754 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-249a1edb-6703-48d7-8671-8c84be020ea6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afb50e787a984fb188d81b05baf3e2cb'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:56.377595 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-249a1edb-6703-48d7-8671-8c84be020ea6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afb50e787a984fb188d81b05baf3e2cb'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:56.389689 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-249a1edb-6703-48d7-8671-8c84be020ea6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afb50e787a984fb188d81b05baf3e2cb'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:56.396566 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-249a1edb-6703-48d7-8671-8c84be020ea6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afb50e787a984fb188d81b05baf3e2cb'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:56.403136 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1433/2832] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:09:56 2022] DELETE /identity/v3/users/afb50e787a984fb188d81b05baf3e2cb => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:56.407592 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aef8ac-5e83-49e4-831d-ea72ff0895d5 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:56.408053 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aef8ac-5e83-49e4-831d-ea72ff0895d5 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:56.408173 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aef8ac-5e83-49e4-831d-ea72ff0895d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:56.430894 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-36aef8ac-5e83-49e4-831d-ea72ff0895d5 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:56.432301 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-36aef8ac-5e83-49e4-831d-ea72ff0895d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:56.437028 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:56.495635 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1400/2833] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:09:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:56.505434 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a1edb-6703-48d7-8671-8c84be020ea6 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:56.506847 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-249a1edb-6703-48d7-8671-8c84be020ea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:56.562733 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a1edb-6703-48d7-8671-8c84be020ea6 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:56.566320 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef62a2-64ec-4a5a-9103-b62e0ccccf89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:56.566915 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef62a2-64ec-4a5a-9103-b62e0ccccf89 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:56.567190 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef62a2-64ec-4a5a-9103-b62e0ccccf89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:56.567457 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef62a2-64ec-4a5a-9103-b62e0ccccf89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:56.574887 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:56.577114 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ef62a2-64ec-4a5a-9103-b62e0ccccf89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:56.578991 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ef62a2-64ec-4a5a-9103-b62e0ccccf89 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:56.590554 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1434/2834] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:09:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:09:56.862343 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aef8ac-5e83-49e4-831d-ea72ff0895d5 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:56.863931 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-36aef8ac-5e83-49e4-831d-ea72ff0895d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:56.876927 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aef8ac-5e83-49e4-831d-ea72ff0895d5 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:56.881516 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26cd21c-a938-4035-9879-23490654375e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:56.882620 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26cd21c-a938-4035-9879-23490654375e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:56.882620 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26cd21c-a938-4035-9879-23490654375e admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:56.882965 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26cd21c-a938-4035-9879-23490654375e admin admin] PATH_INFO: `/v3/projects/f28652e930f4421f83c63aa7a0134ad5` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:56.884716 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26cd21c-a938-4035-9879-23490654375e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f28652e930f4421f83c63aa7a0134ad5)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:56.886846 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26cd21c-a938-4035-9879-23490654375e admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:56.940215 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-a26cd21c-a938-4035-9879-23490654375e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f28652e930f4421f83c63aa7a0134ad5', 'request_id': 'req-a26cd21c-a938-4035-9879-23490654375e'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:56.948185 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-a26cd21c-a938-4035-9879-23490654375e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f28652e930f4421f83c63aa7a0134ad5', 'request_id': 'req-a26cd21c-a938-4035-9879-23490654375e'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:56.954939 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-a26cd21c-a938-4035-9879-23490654375e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f28652e930f4421f83c63aa7a0134ad5', 'request_id': 'req-a26cd21c-a938-4035-9879-23490654375e'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:56.966156 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-a26cd21c-a938-4035-9879-23490654375e admin admin] The token cache is being invalidate because project f28652e930f4421f83c63aa7a0134ad5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:09:56.966451 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-a26cd21c-a938-4035-9879-23490654375e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:56.967074 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-a26cd21c-a938-4035-9879-23490654375e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:56.968587 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1401/2835] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:09:56 2022] DELETE /identity/v3/projects/f28652e930f4421f83c63aa7a0134ad5 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:56.972639 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef62a2-64ec-4a5a-9103-b62e0ccccf89 service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:56.982350 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef62a2-64ec-4a5a-9103-b62e0ccccf89 service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:57.041572 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237a255-0bcb-449f-b630-44f8c8cccaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:57.042198 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237a255-0bcb-449f-b630-44f8c8cccaf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:57.042470 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237a255-0bcb-449f-b630-44f8c8cccaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:57.042738 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237a255-0bcb-449f-b630-44f8c8cccaf2 admin admin] PATH_INFO: `/v3/users/50f98b90bd334ade837a135e0a08a230` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:57.043829 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2237a255-0bcb-449f-b630-44f8c8cccaf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50f98b90bd334ade837a135e0a08a230)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:57.045782 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2237a255-0bcb-449f-b630-44f8c8cccaf2 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:57.090991 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2237a255-0bcb-449f-b630-44f8c8cccaf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50f98b90bd334ade837a135e0a08a230'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:57.091633 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2237a255-0bcb-449f-b630-44f8c8cccaf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50f98b90bd334ade837a135e0a08a230'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:57.098888 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2237a255-0bcb-449f-b630-44f8c8cccaf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50f98b90bd334ade837a135e0a08a230'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:57.111890 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2237a255-0bcb-449f-b630-44f8c8cccaf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50f98b90bd334ade837a135e0a08a230'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:57.119466 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2237a255-0bcb-449f-b630-44f8c8cccaf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50f98b90bd334ade837a135e0a08a230'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:57.125435 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1435/2836] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:09:56 2022] DELETE /identity/v3/users/50f98b90bd334ade837a135e0a08a230 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:57.405381 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26cd21c-a938-4035-9879-23490654375e admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:57.406866 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-a26cd21c-a938-4035-9879-23490654375e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:57.421360 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26cd21c-a938-4035-9879-23490654375e admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:57.482926 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6da8d-938f-43ae-8f06-f34d6a0845c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:57.483553 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6da8d-938f-43ae-8f06-f34d6a0845c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:57.483831 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6da8d-938f-43ae-8f06-f34d6a0845c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:57.484097 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6da8d-938f-43ae-8f06-f34d6a0845c0 admin admin] PATH_INFO: `/v3/projects/e5fd73961a1e4a1ca47be7f72d4cfeff` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:57.485224 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a6da8d-938f-43ae-8f06-f34d6a0845c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5fd73961a1e4a1ca47be7f72d4cfeff)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:57.487151 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a6da8d-938f-43ae-8f06-f34d6a0845c0 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:57.523820 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:57.535143 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-19a6da8d-938f-43ae-8f06-f34d6a0845c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5fd73961a1e4a1ca47be7f72d4cfeff', 'request_id': 'req-19a6da8d-938f-43ae-8f06-f34d6a0845c0'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:57.541149 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-19a6da8d-938f-43ae-8f06-f34d6a0845c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5fd73961a1e4a1ca47be7f72d4cfeff', 'request_id': 'req-19a6da8d-938f-43ae-8f06-f34d6a0845c0'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:57.547888 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-19a6da8d-938f-43ae-8f06-f34d6a0845c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5fd73961a1e4a1ca47be7f72d4cfeff', 'request_id': 'req-19a6da8d-938f-43ae-8f06-f34d6a0845c0'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:57.559510 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-19a6da8d-938f-43ae-8f06-f34d6a0845c0 admin admin] The token cache is being invalidate because project e5fd73961a1e4a1ca47be7f72d4cfeff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:09:57.559800 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-19a6da8d-938f-43ae-8f06-f34d6a0845c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:57.560431 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-19a6da8d-938f-43ae-8f06-f34d6a0845c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:09:57.561931 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1402/2837] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:09:57 2022] DELETE /identity/v3/projects/e5fd73961a1e4a1ca47be7f72d4cfeff => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:57.566787 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4b453-545b-4661-a2d5-15c4ac6e4b97 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:57.567302 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4b453-545b-4661-a2d5-15c4ac6e4b97 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:57.567415 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4b453-545b-4661-a2d5-15c4ac6e4b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:57.586533 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-97d4b453-545b-4661-a2d5-15c4ac6e4b97 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:57.588045 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-97d4b453-545b-4661-a2d5-15c4ac6e4b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:57.646748 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1436/2838] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:09:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:57.654387 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ed8fd-8da3-4a0f-a2d6-d19d1c68b076 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:57.654609 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ed8fd-8da3-4a0f-a2d6-d19d1c68b076 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:57.654875 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ed8fd-8da3-4a0f-a2d6-d19d1c68b076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:57.675481 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-f20ed8fd-8da3-4a0f-a2d6-d19d1c68b076 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:57.676660 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-f20ed8fd-8da3-4a0f-a2d6-d19d1c68b076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:57.685331 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1403/2839] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:09:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:57.689931 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4b453-545b-4661-a2d5-15c4ac6e4b97 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:57.701536 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4b453-545b-4661-a2d5-15c4ac6e4b97 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:57.706405 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b6464-59b9-42e2-86c6-c8a29abbde6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:57.707041 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b6464-59b9-42e2-86c6-c8a29abbde6b admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:57.707320 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b6464-59b9-42e2-86c6-c8a29abbde6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:57.707592 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b6464-59b9-42e2-86c6-c8a29abbde6b admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:57.708332 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20b6464-59b9-42e2-86c6-c8a29abbde6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:09:57.708651 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20b6464-59b9-42e2-86c6-c8a29abbde6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:57.710371 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20b6464-59b9-42e2-86c6-c8a29abbde6b admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:57.723922 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1437/2840] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 16:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:09:57.727476 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ed8fd-8da3-4a0f-a2d6-d19d1c68b076 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:57.737507 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ed8fd-8da3-4a0f-a2d6-d19d1c68b076 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:57.742113 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbcc77-8982-4407-a8a6-9e5e431d40b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:57.742701 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbcc77-8982-4407-a8a6-9e5e431d40b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:57.742976 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbcc77-8982-4407-a8a6-9e5e431d40b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:57.743550 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbcc77-8982-4407-a8a6-9e5e431d40b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:57.744177 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbcc77-8982-4407-a8a6-9e5e431d40b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:57.746081 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbcc77-8982-4407-a8a6-9e5e431d40b9 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:57.772304 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1404/2841] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:09:57 2022] POST /identity/v3/projects => generated 409 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:09:57.777463 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b6464-59b9-42e2-86c6-c8a29abbde6b admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:57.782600 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:57.789028 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b6464-59b9-42e2-86c6-c8a29abbde6b admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:57.845688 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d868c-2db3-4150-a4bb-da16b15a4fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:57.846293 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d868c-2db3-4150-a4bb-da16b15a4fb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:57.846573 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d868c-2db3-4150-a4bb-da16b15a4fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:57.846844 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d868c-2db3-4150-a4bb-da16b15a4fb4 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:57.847482 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d868c-2db3-4150-a4bb-da16b15a4fb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:57.849428 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d868c-2db3-4150-a4bb-da16b15a4fb4 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:57.870476 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1438/2842] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:09:57 2022] POST /identity/v3/users => generated 305 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:09:57.874761 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbcc77-8982-4407-a8a6-9e5e431d40b9 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:57.885204 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbcc77-8982-4407-a8a6-9e5e431d40b9 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:57.889726 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae688fed-7730-493b-a76d-2f3ef274b222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:57.890317 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae688fed-7730-493b-a76d-2f3ef274b222 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:57.890587 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae688fed-7730-493b-a76d-2f3ef274b222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:57.890853 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae688fed-7730-493b-a76d-2f3ef274b222 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:57.891513 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae688fed-7730-493b-a76d-2f3ef274b222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:57.893138 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae688fed-7730-493b-a76d-2f3ef274b222 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:57.903826 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1405/2843] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:09:57.907700 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d868c-2db3-4150-a4bb-da16b15a4fb4 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:57.918074 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d868c-2db3-4150-a4bb-da16b15a4fb4 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:57.922766 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b437d-69a1-42f0-98ba-97855cf17d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:57.923365 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b437d-69a1-42f0-98ba-97855cf17d5a admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:57.923644 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b437d-69a1-42f0-98ba-97855cf17d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:57.923919 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b437d-69a1-42f0-98ba-97855cf17d5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:57.924564 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01b437d-69a1-42f0-98ba-97855cf17d5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:57.926187 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01b437d-69a1-42f0-98ba-97855cf17d5a admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:57.937750 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1439/2844] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:09:57.941869 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae688fed-7730-493b-a76d-2f3ef274b222 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:57.952700 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae688fed-7730-493b-a76d-2f3ef274b222 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:57.958191 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a81db9-631d-43b0-9c8d-935a6e66fd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:57.958897 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a81db9-631d-43b0-9c8d-935a6e66fd18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:57.959217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a81db9-631d-43b0-9c8d-935a6e66fd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:57.959422 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a81db9-631d-43b0-9c8d-935a6e66fd18 admin admin] PATH_INFO: `/v3/projects/34cff2a3823b469c9f0d02eefd0f8b41/users/4a040282babf41be993efa2794c63c22/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:57.976229 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a81db9-631d-43b0-9c8d-935a6e66fd18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34cff2a3823b469c9f0d02eefd0f8b41, user_id=4a040282babf41be993efa2794c63c22, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:57.979581 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a81db9-631d-43b0-9c8d-935a6e66fd18 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:57.991384 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1406/2845] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:09:57 2022] PUT /identity/v3/projects/34cff2a3823b469c9f0d02eefd0f8b41/users/4a040282babf41be993efa2794c63c22/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:58.002338 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb01b6-cb97-47a3-97dd-8c94b21eb595 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:58.002627 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb01b6-cb97-47a3-97dd-8c94b21eb595 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:58.002908 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb01b6-cb97-47a3-97dd-8c94b21eb595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:58.030995 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-89eb01b6-cb97-47a3-97dd-8c94b21eb595 None None] MFA Rules not processed for user `4a040282babf41be993efa2794c63c22`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:58.032201 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-89eb01b6-cb97-47a3-97dd-8c94b21eb595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:58.095387 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1440/2846] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:09:58 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:09:58.099789 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a81db9-631d-43b0-9c8d-935a6e66fd18 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:58.160019 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a81db9-631d-43b0-9c8d-935a6e66fd18 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:58.164615 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926036b-14b2-48d7-b5a2-f67ddbf89af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:58.165250 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926036b-14b2-48d7-b5a2-f67ddbf89af6 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:58.165638 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926036b-14b2-48d7-b5a2-f67ddbf89af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:58.165857 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926036b-14b2-48d7-b5a2-f67ddbf89af6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:58.166486 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926036b-14b2-48d7-b5a2-f67ddbf89af6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:58.168390 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926036b-14b2-48d7-b5a2-f67ddbf89af6 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:58.197624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1407/2847] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:09:58 2022] POST /identity/v3/projects => generated 407 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:09:58.201675 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb01b6-cb97-47a3-97dd-8c94b21eb595 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:58.216428 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb01b6-cb97-47a3-97dd-8c94b21eb595 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:58.277797 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d2e40-b6d7-42fb-8184-30fc20fd742a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:58.278410 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d2e40-b6d7-42fb-8184-30fc20fd742a admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:58.278689 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d2e40-b6d7-42fb-8184-30fc20fd742a admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:58.278959 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d2e40-b6d7-42fb-8184-30fc20fd742a admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:58.279587 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d2e40-b6d7-42fb-8184-30fc20fd742a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:58.281592 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d2e40-b6d7-42fb-8184-30fc20fd742a admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:58.298556 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:58.307244 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1441/2848] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:09:58 2022] POST /identity/v3/users => generated 310 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:09:58.308451 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926036b-14b2-48d7-b5a2-f67ddbf89af6 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:58.319058 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926036b-14b2-48d7-b5a2-f67ddbf89af6 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:58.324532 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac502837-363a-4b46-8880-4dd18141397f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:58.325164 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac502837-363a-4b46-8880-4dd18141397f admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:58.325444 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac502837-363a-4b46-8880-4dd18141397f admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:58.325712 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac502837-363a-4b46-8880-4dd18141397f admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:58.326354 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac502837-363a-4b46-8880-4dd18141397f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:58.327931 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac502837-363a-4b46-8880-4dd18141397f admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:58.344555 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1408/2849] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:09:58.348638 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d2e40-b6d7-42fb-8184-30fc20fd742a admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:58.358743 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d2e40-b6d7-42fb-8184-30fc20fd742a admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:58.363261 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61317650-b13c-46fa-8b2a-6c6ea0310632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:58.363903 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61317650-b13c-46fa-8b2a-6c6ea0310632 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:58.364177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61317650-b13c-46fa-8b2a-6c6ea0310632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:58.364447 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61317650-b13c-46fa-8b2a-6c6ea0310632 admin admin] PATH_INFO: `/v3/projects/a28c573b18c440febab18deed9ec9806/users/b4f8e023a1dc47fca87ed490f3967d94/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:58.379691 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61317650-b13c-46fa-8b2a-6c6ea0310632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a28c573b18c440febab18deed9ec9806, user_id=b4f8e023a1dc47fca87ed490f3967d94, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:58.382366 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61317650-b13c-46fa-8b2a-6c6ea0310632 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:58.394931 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1442/2850] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:09:58 2022] PUT /identity/v3/projects/a28c573b18c440febab18deed9ec9806/users/b4f8e023a1dc47fca87ed490f3967d94/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:58.398886 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac502837-363a-4b46-8880-4dd18141397f admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:58.409614 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac502837-363a-4b46-8880-4dd18141397f admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:58.439136 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:58.466255 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92296a-7a23-425b-8acd-990782573449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:58.466856 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92296a-7a23-425b-8acd-990782573449 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:58.467131 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92296a-7a23-425b-8acd-990782573449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:58.467399 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92296a-7a23-425b-8acd-990782573449 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:58.468031 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec92296a-7a23-425b-8acd-990782573449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:58.469650 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec92296a-7a23-425b-8acd-990782573449 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:58.483332 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1409/2851] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:09:58.488761 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61317650-b13c-46fa-8b2a-6c6ea0310632 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:58.501298 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61317650-b13c-46fa-8b2a-6c6ea0310632 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:58.506112 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4ebe6-210e-4d1d-8ae8-271252e51209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:58.506774 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4ebe6-210e-4d1d-8ae8-271252e51209 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:58.507049 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4ebe6-210e-4d1d-8ae8-271252e51209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:58.507318 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4ebe6-210e-4d1d-8ae8-271252e51209 admin admin] PATH_INFO: `/v3/projects/a28c573b18c440febab18deed9ec9806/users/b4f8e023a1dc47fca87ed490f3967d94/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:58.510176 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c4ebe6-210e-4d1d-8ae8-271252e51209 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a28c573b18c440febab18deed9ec9806, user_id=b4f8e023a1dc47fca87ed490f3967d94, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:58.512844 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c4ebe6-210e-4d1d-8ae8-271252e51209 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:58.523268 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1443/2852] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:09:58 2022] PUT /identity/v3/projects/a28c573b18c440febab18deed9ec9806/users/b4f8e023a1dc47fca87ed490f3967d94/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:09:58.534295 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c39a2a-226e-41c4-ac5f-e26ee14252fc None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:58.534582 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c39a2a-226e-41c4-ac5f-e26ee14252fc None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:58.534854 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c39a2a-226e-41c4-ac5f-e26ee14252fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:58.563259 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-b4c39a2a-226e-41c4-ac5f-e26ee14252fc None None] MFA Rules not processed for user `b4f8e023a1dc47fca87ed490f3967d94`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:58.564481 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-b4c39a2a-226e-41c4-ac5f-e26ee14252fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:58.632663 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1410/2853] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:09:58 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:58.644064 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4ebe6-210e-4d1d-8ae8-271252e51209 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:58.645909 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-55c4ebe6-210e-4d1d-8ae8-271252e51209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:58.703018 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4ebe6-210e-4d1d-8ae8-271252e51209 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:58.706600 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df294180-5fb3-44ec-8fc5-8673c82dd707 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:58.707209 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df294180-5fb3-44ec-8fc5-8673c82dd707 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:58.707487 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df294180-5fb3-44ec-8fc5-8673c82dd707 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:58.707759 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df294180-5fb3-44ec-8fc5-8673c82dd707 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:58.716646 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df294180-5fb3-44ec-8fc5-8673c82dd707 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:58.718117 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df294180-5fb3-44ec-8fc5-8673c82dd707 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:58.739226 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1444/2854] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:09:58 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:09:58.887068 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c39a2a-226e-41c4-ac5f-e26ee14252fc None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:58.896481 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c39a2a-226e-41c4-ac5f-e26ee14252fc None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:58.900136 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef11d26-270e-47ed-a9d2-99237c5d95b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:58.900725 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef11d26-270e-47ed-a9d2-99237c5d95b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:58.901041 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef11d26-270e-47ed-a9d2-99237c5d95b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:58.901311 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef11d26-270e-47ed-a9d2-99237c5d95b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:58.956186 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef11d26-270e-47ed-a9d2-99237c5d95b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:58.957578 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef11d26-270e-47ed-a9d2-99237c5d95b9 service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:58.966485 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1411/2855] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:09:58 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:10:04.232151 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df294180-5fb3-44ec-8fc5-8673c82dd707 service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:04.295805 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df294180-5fb3-44ec-8fc5-8673c82dd707 service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:04.300347 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c000be-36ff-46f8-9fc8-11aa6275eea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:04.301002 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c000be-36ff-46f8-9fc8-11aa6275eea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:04.301282 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c000be-36ff-46f8-9fc8-11aa6275eea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:04.301589 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c000be-36ff-46f8-9fc8-11aa6275eea9 admin admin] PATH_INFO: `/v3/users/4a040282babf41be993efa2794c63c22` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:04.302698 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c000be-36ff-46f8-9fc8-11aa6275eea9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a040282babf41be993efa2794c63c22)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:04.304591 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c000be-36ff-46f8-9fc8-11aa6275eea9 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:04.350865 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-41c000be-36ff-46f8-9fc8-11aa6275eea9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a040282babf41be993efa2794c63c22'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:04.351506 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-41c000be-36ff-46f8-9fc8-11aa6275eea9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a040282babf41be993efa2794c63c22'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:04.359403 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-41c000be-36ff-46f8-9fc8-11aa6275eea9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a040282babf41be993efa2794c63c22'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:04.369843 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:04.372452 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-41c000be-36ff-46f8-9fc8-11aa6275eea9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a040282babf41be993efa2794c63c22'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:04.380843 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-41c000be-36ff-46f8-9fc8-11aa6275eea9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a040282babf41be993efa2794c63c22'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:04.386820 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1445/2856] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:10:04 2022] DELETE /identity/v3/users/4a040282babf41be993efa2794c63c22 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:10:04.391788 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f25dd-04af-4f79-bf9d-ebef2526e344 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:04.392279 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f25dd-04af-4f79-bf9d-ebef2526e344 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:04.392380 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f25dd-04af-4f79-bf9d-ebef2526e344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:04.414028 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-504f25dd-04af-4f79-bf9d-ebef2526e344 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:10:04.415269 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-504f25dd-04af-4f79-bf9d-ebef2526e344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:04.462549 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:04.475339 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1412/2857] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:10:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:10:04.485052 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c000be-36ff-46f8-9fc8-11aa6275eea9 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:04.486542 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-41c000be-36ff-46f8-9fc8-11aa6275eea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:04.543038 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c000be-36ff-46f8-9fc8-11aa6275eea9 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:04.546836 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6c92e-5a2a-4cf5-b7f4-7ce3ac1178b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:04.547437 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6c92e-5a2a-4cf5-b7f4-7ce3ac1178b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:04.547707 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6c92e-5a2a-4cf5-b7f4-7ce3ac1178b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:04.547969 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6c92e-5a2a-4cf5-b7f4-7ce3ac1178b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:04.556643 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6c92e-5a2a-4cf5-b7f4-7ce3ac1178b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:04.558114 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6c92e-5a2a-4cf5-b7f4-7ce3ac1178b8 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:04.567619 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1446/2858] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:10:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:10:04.844387 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f25dd-04af-4f79-bf9d-ebef2526e344 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:04.845958 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-504f25dd-04af-4f79-bf9d-ebef2526e344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:04.859443 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f25dd-04af-4f79-bf9d-ebef2526e344 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:04.864268 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af28e274-f74c-4942-9994-30651e2f3e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:04.864901 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28e274-f74c-4942-9994-30651e2f3e27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:04.865233 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28e274-f74c-4942-9994-30651e2f3e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:04.865507 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28e274-f74c-4942-9994-30651e2f3e27 admin admin] PATH_INFO: `/v3/projects/34cff2a3823b469c9f0d02eefd0f8b41` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:04.866623 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af28e274-f74c-4942-9994-30651e2f3e27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34cff2a3823b469c9f0d02eefd0f8b41)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:04.868941 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af28e274-f74c-4942-9994-30651e2f3e27 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:04.917674 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-af28e274-f74c-4942-9994-30651e2f3e27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34cff2a3823b469c9f0d02eefd0f8b41', 'request_id': 'req-af28e274-f74c-4942-9994-30651e2f3e27'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:04.925472 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-af28e274-f74c-4942-9994-30651e2f3e27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34cff2a3823b469c9f0d02eefd0f8b41', 'request_id': 'req-af28e274-f74c-4942-9994-30651e2f3e27'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:04.935215 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-af28e274-f74c-4942-9994-30651e2f3e27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34cff2a3823b469c9f0d02eefd0f8b41', 'request_id': 'req-af28e274-f74c-4942-9994-30651e2f3e27'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:04.947300 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-af28e274-f74c-4942-9994-30651e2f3e27 admin admin] The token cache is being invalidate because project 34cff2a3823b469c9f0d02eefd0f8b41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:10:04.947582 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-af28e274-f74c-4942-9994-30651e2f3e27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:04.948244 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-af28e274-f74c-4942-9994-30651e2f3e27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:04.949780 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1413/2859] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:10:04 2022] DELETE /identity/v3/projects/34cff2a3823b469c9f0d02eefd0f8b41 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:10:04.954277 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6c92e-5a2a-4cf5-b7f4-7ce3ac1178b8 service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:04.963646 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6c92e-5a2a-4cf5-b7f4-7ce3ac1178b8 service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:05.018266 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c993f5-d298-4e56-9e07-a17a76406e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:05.018909 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c993f5-d298-4e56-9e07-a17a76406e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:05.019192 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c993f5-d298-4e56-9e07-a17a76406e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:05.019523 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c993f5-d298-4e56-9e07-a17a76406e9b admin admin] PATH_INFO: `/v3/users/b4f8e023a1dc47fca87ed490f3967d94` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:05.020665 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c993f5-d298-4e56-9e07-a17a76406e9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4f8e023a1dc47fca87ed490f3967d94)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:05.022632 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c993f5-d298-4e56-9e07-a17a76406e9b admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:05.067460 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-00c993f5-d298-4e56-9e07-a17a76406e9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4f8e023a1dc47fca87ed490f3967d94'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:05.068105 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-00c993f5-d298-4e56-9e07-a17a76406e9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4f8e023a1dc47fca87ed490f3967d94'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:05.074840 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-00c993f5-d298-4e56-9e07-a17a76406e9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4f8e023a1dc47fca87ed490f3967d94'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:05.087591 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-00c993f5-d298-4e56-9e07-a17a76406e9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4f8e023a1dc47fca87ed490f3967d94'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:05.094821 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-00c993f5-d298-4e56-9e07-a17a76406e9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4f8e023a1dc47fca87ed490f3967d94'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:05.100533 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1447/2860] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:10:04 2022] DELETE /identity/v3/users/b4f8e023a1dc47fca87ed490f3967d94 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:10:05.374235 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af28e274-f74c-4942-9994-30651e2f3e27 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:05.375724 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-af28e274-f74c-4942-9994-30651e2f3e27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:05.388629 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af28e274-f74c-4942-9994-30651e2f3e27 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:05.453826 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e1698-0df9-4f63-8c4e-babbe236ec84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:05.454497 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e1698-0df9-4f63-8c4e-babbe236ec84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:05.454729 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e1698-0df9-4f63-8c4e-babbe236ec84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:05.454993 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e1698-0df9-4f63-8c4e-babbe236ec84 admin admin] PATH_INFO: `/v3/projects/a28c573b18c440febab18deed9ec9806` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:05.456133 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e1698-0df9-4f63-8c4e-babbe236ec84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a28c573b18c440febab18deed9ec9806)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:05.458103 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e1698-0df9-4f63-8c4e-babbe236ec84 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:05.504740 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-887e1698-0df9-4f63-8c4e-babbe236ec84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a28c573b18c440febab18deed9ec9806', 'request_id': 'req-887e1698-0df9-4f63-8c4e-babbe236ec84'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:05.510570 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-887e1698-0df9-4f63-8c4e-babbe236ec84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a28c573b18c440febab18deed9ec9806', 'request_id': 'req-887e1698-0df9-4f63-8c4e-babbe236ec84'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:05.517317 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-887e1698-0df9-4f63-8c4e-babbe236ec84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a28c573b18c440febab18deed9ec9806', 'request_id': 'req-887e1698-0df9-4f63-8c4e-babbe236ec84'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:05.529011 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-887e1698-0df9-4f63-8c4e-babbe236ec84 admin admin] The token cache is being invalidate because project a28c573b18c440febab18deed9ec9806 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:10:05.529385 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-887e1698-0df9-4f63-8c4e-babbe236ec84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:05.530026 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-887e1698-0df9-4f63-8c4e-babbe236ec84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:05.531503 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1414/2861] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:10:05 2022] DELETE /identity/v3/projects/a28c573b18c440febab18deed9ec9806 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:10:05.536381 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb489a-9920-4d6e-a218-2d4b57d887cc None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:05.536958 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb489a-9920-4d6e-a218-2d4b57d887cc None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:05.536958 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb489a-9920-4d6e-a218-2d4b57d887cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:05.550913 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:05.557990 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-45cb489a-9920-4d6e-a218-2d4b57d887cc None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:10:05.560288 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-45cb489a-9920-4d6e-a218-2d4b57d887cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:05.618841 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1448/2862] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:10:05.626822 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ca857-0f38-45a8-8fa4-738c115fba3e None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:05.627044 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ca857-0f38-45a8-8fa4-738c115fba3e None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:05.627313 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ca857-0f38-45a8-8fa4-738c115fba3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:05.641211 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:05.646811 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-a53ca857-0f38-45a8-8fa4-738c115fba3e None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:10:05.648626 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-a53ca857-0f38-45a8-8fa4-738c115fba3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:05.657558 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1415/2863] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:10:05.661765 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb489a-9920-4d6e-a218-2d4b57d887cc None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:05.672201 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb489a-9920-4d6e-a218-2d4b57d887cc None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:05.676767 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa275dc8-5a61-4a31-9d5a-3ad1b2c5013b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:05.677400 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa275dc8-5a61-4a31-9d5a-3ad1b2c5013b admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:05.677674 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa275dc8-5a61-4a31-9d5a-3ad1b2c5013b admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:05.677940 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa275dc8-5a61-4a31-9d5a-3ad1b2c5013b admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:05.678710 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa275dc8-5a61-4a31-9d5a-3ad1b2c5013b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:10:05.679008 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa275dc8-5a61-4a31-9d5a-3ad1b2c5013b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:05.680582 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa275dc8-5a61-4a31-9d5a-3ad1b2c5013b admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:05.697834 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1449/2864] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 16:10:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:10:05.703339 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ca857-0f38-45a8-8fa4-738c115fba3e None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:05.714943 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ca857-0f38-45a8-8fa4-738c115fba3e None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:05.720358 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645cbb0-ad51-4351-b949-f3bee590b04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:05.721116 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645cbb0-ad51-4351-b949-f3bee590b04c admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:05.721499 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645cbb0-ad51-4351-b949-f3bee590b04c admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:05.721858 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645cbb0-ad51-4351-b949-f3bee590b04c admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:05.722589 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645cbb0-ad51-4351-b949-f3bee590b04c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:05.724581 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645cbb0-ad51-4351-b949-f3bee590b04c admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:05.752574 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1416/2865] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:10:05 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:10:05.756690 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa275dc8-5a61-4a31-9d5a-3ad1b2c5013b admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:05.767158 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa275dc8-5a61-4a31-9d5a-3ad1b2c5013b admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:05.822298 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3d64b-8d08-4ccd-b72c-0a79df721b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:05.822894 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3d64b-8d08-4ccd-b72c-0a79df721b6c admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:05.823169 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3d64b-8d08-4ccd-b72c-0a79df721b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:05.823435 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3d64b-8d08-4ccd-b72c-0a79df721b6c admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:05.824046 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f3d64b-8d08-4ccd-b72c-0a79df721b6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:05.826007 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f3d64b-8d08-4ccd-b72c-0a79df721b6c admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:05.846795 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1450/2866] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:10:05 2022] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:10:05.850894 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645cbb0-ad51-4351-b949-f3bee590b04c admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:05.861579 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645cbb0-ad51-4351-b949-f3bee590b04c admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:05.866347 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff61568f-1d42-465a-872a-1e4373749df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:05.866947 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61568f-1d42-465a-872a-1e4373749df5 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:05.867220 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61568f-1d42-465a-872a-1e4373749df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:05.867511 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61568f-1d42-465a-872a-1e4373749df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:05.868174 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff61568f-1d42-465a-872a-1e4373749df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:05.870052 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff61568f-1d42-465a-872a-1e4373749df5 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:05.879843 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1417/2867] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:10:05.883467 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3d64b-8d08-4ccd-b72c-0a79df721b6c admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:05.894383 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3d64b-8d08-4ccd-b72c-0a79df721b6c admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:05.899028 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c14da7-4d8d-488f-aaf3-abbde5b24681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:05.899620 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c14da7-4d8d-488f-aaf3-abbde5b24681 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:05.899897 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c14da7-4d8d-488f-aaf3-abbde5b24681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:05.900169 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c14da7-4d8d-488f-aaf3-abbde5b24681 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:05.900826 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c14da7-4d8d-488f-aaf3-abbde5b24681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:05.902390 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c14da7-4d8d-488f-aaf3-abbde5b24681 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:05.913593 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1451/2868] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:10:05.917861 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff61568f-1d42-465a-872a-1e4373749df5 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:05.927852 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff61568f-1d42-465a-872a-1e4373749df5 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:05.932382 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a9dfd-9d12-40a4-bc63-e2c2bd841801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:05.933045 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a9dfd-9d12-40a4-bc63-e2c2bd841801 admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:05.933314 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a9dfd-9d12-40a4-bc63-e2c2bd841801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:05.933586 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a9dfd-9d12-40a4-bc63-e2c2bd841801 admin admin] PATH_INFO: `/v3/projects/294f1d9d11cf434aa9bce1000cc4b957/users/4d88a777e6c34a50bd22d1cd558d70c4/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:05.953917 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a9dfd-9d12-40a4-bc63-e2c2bd841801 admin admin] RBAC: Authorizing `identity:create_grant(project_id=294f1d9d11cf434aa9bce1000cc4b957, user_id=4d88a777e6c34a50bd22d1cd558d70c4, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:05.956649 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a9dfd-9d12-40a4-bc63-e2c2bd841801 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:05.970101 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1418/2869] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:10:05 2022] PUT /identity/v3/projects/294f1d9d11cf434aa9bce1000cc4b957/users/4d88a777e6c34a50bd22d1cd558d70c4/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:10:05.980269 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd1b4f-42ec-46a1-975a-502cf157d4d6 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:05.980557 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd1b4f-42ec-46a1-975a-502cf157d4d6 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:05.980868 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd1b4f-42ec-46a1-975a-502cf157d4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:06.008636 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-18bd1b4f-42ec-46a1-975a-502cf157d4d6 None None] MFA Rules not processed for user `4d88a777e6c34a50bd22d1cd558d70c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:10:06.009874 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-18bd1b4f-42ec-46a1-975a-502cf157d4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:06.073413 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1452/2870] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:10:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:10:06.078772 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a9dfd-9d12-40a4-bc63-e2c2bd841801 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:06.140135 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a9dfd-9d12-40a4-bc63-e2c2bd841801 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:06.144685 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b63bb-f9f2-49cc-83dc-192f4d7ab815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:06.145315 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b63bb-f9f2-49cc-83dc-192f4d7ab815 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:06.145596 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b63bb-f9f2-49cc-83dc-192f4d7ab815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:06.145867 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b63bb-f9f2-49cc-83dc-192f4d7ab815 admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:06.146504 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b63bb-f9f2-49cc-83dc-192f4d7ab815 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:06.148387 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b63bb-f9f2-49cc-83dc-192f4d7ab815 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:06.174467 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1419/2871] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:10:06 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:10:06.178593 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd1b4f-42ec-46a1-975a-502cf157d4d6 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:06.184005 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:06.191606 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd1b4f-42ec-46a1-975a-502cf157d4d6 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:06.249308 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790036f6-be72-4a4f-a671-ff7c0e2c0e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:06.249912 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790036f6-be72-4a4f-a671-ff7c0e2c0e8d admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:06.250191 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790036f6-be72-4a4f-a671-ff7c0e2c0e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:06.250458 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790036f6-be72-4a4f-a671-ff7c0e2c0e8d admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:06.251117 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790036f6-be72-4a4f-a671-ff7c0e2c0e8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:06.253107 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790036f6-be72-4a4f-a671-ff7c0e2c0e8d admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:06.274313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1453/2872] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:10:06 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:10:06.280278 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b63bb-f9f2-49cc-83dc-192f4d7ab815 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:06.290498 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b63bb-f9f2-49cc-83dc-192f4d7ab815 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:06.295751 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987e675-a43f-44ef-b5cf-a675b5462b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:06.296355 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987e675-a43f-44ef-b5cf-a675b5462b35 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:06.296636 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987e675-a43f-44ef-b5cf-a675b5462b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:06.296954 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987e675-a43f-44ef-b5cf-a675b5462b35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:06.297601 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987e675-a43f-44ef-b5cf-a675b5462b35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:06.299206 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987e675-a43f-44ef-b5cf-a675b5462b35 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:06.309937 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1420/2873] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:10:06.314444 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790036f6-be72-4a4f-a671-ff7c0e2c0e8d admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:06.324204 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790036f6-be72-4a4f-a671-ff7c0e2c0e8d admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:06.328763 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c66a2-17de-4d82-94f9-37909a7d8b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:06.329433 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c66a2-17de-4d82-94f9-37909a7d8b5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:06.329824 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c66a2-17de-4d82-94f9-37909a7d8b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:06.330157 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c66a2-17de-4d82-94f9-37909a7d8b5e admin admin] PATH_INFO: `/v3/projects/8f43ec606eab47a3b605d35a2cab4a57/users/bc5d2a7cfeef4f5dba6a0428b7a35748/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:06.350613 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c66a2-17de-4d82-94f9-37909a7d8b5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f43ec606eab47a3b605d35a2cab4a57, user_id=bc5d2a7cfeef4f5dba6a0428b7a35748, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:06.353395 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c66a2-17de-4d82-94f9-37909a7d8b5e admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:06.368143 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1454/2874] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:10:06 2022] PUT /identity/v3/projects/8f43ec606eab47a3b605d35a2cab4a57/users/bc5d2a7cfeef4f5dba6a0428b7a35748/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:10:06.372433 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987e675-a43f-44ef-b5cf-a675b5462b35 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:06.382317 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987e675-a43f-44ef-b5cf-a675b5462b35 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:06.438763 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31369063-46d2-4d03-8903-672f4602adea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:06.439290 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31369063-46d2-4d03-8903-672f4602adea admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:06.439578 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31369063-46d2-4d03-8903-672f4602adea admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:06.439849 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31369063-46d2-4d03-8903-672f4602adea admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:06.440482 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31369063-46d2-4d03-8903-672f4602adea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:06.442154 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31369063-46d2-4d03-8903-672f4602adea admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:06.452031 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1421/2875] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:10:06.456301 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c66a2-17de-4d82-94f9-37909a7d8b5e admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:06.467571 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c66a2-17de-4d82-94f9-37909a7d8b5e admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:06.472163 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60db30-f292-4d90-9196-6899e0091ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:06.472822 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60db30-f292-4d90-9196-6899e0091ffb admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:06.473105 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60db30-f292-4d90-9196-6899e0091ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:06.473375 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60db30-f292-4d90-9196-6899e0091ffb admin admin] PATH_INFO: `/v3/projects/8f43ec606eab47a3b605d35a2cab4a57/users/bc5d2a7cfeef4f5dba6a0428b7a35748/roles/676938e69210499ca11ee75dd572d0dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:06.475263 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60db30-f292-4d90-9196-6899e0091ffb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f43ec606eab47a3b605d35a2cab4a57, user_id=bc5d2a7cfeef4f5dba6a0428b7a35748, role_id=676938e69210499ca11ee75dd572d0dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:06.477898 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60db30-f292-4d90-9196-6899e0091ffb admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:06.488759 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1455/2876] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:10:06 2022] PUT /identity/v3/projects/8f43ec606eab47a3b605d35a2cab4a57/users/bc5d2a7cfeef4f5dba6a0428b7a35748/roles/676938e69210499ca11ee75dd572d0dc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:10:06.501309 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219025ad-65ba-480d-87c0-14cd72f0d82b None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:06.501794 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219025ad-65ba-480d-87c0-14cd72f0d82b None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:06.501912 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219025ad-65ba-480d-87c0-14cd72f0d82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:06.528615 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:06.532519 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-219025ad-65ba-480d-87c0-14cd72f0d82b None None] MFA Rules not processed for user `bc5d2a7cfeef4f5dba6a0428b7a35748`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:10:06.534364 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-219025ad-65ba-480d-87c0-14cd72f0d82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:06.603395 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1422/2877] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:10:06 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:10:06.615645 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60db30-f292-4d90-9196-6899e0091ffb admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:06.617520 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-9a60db30-f292-4d90-9196-6899e0091ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:06.676649 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60db30-f292-4d90-9196-6899e0091ffb admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:06.680356 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878ba5f-9407-4a8e-96b4-e72928fab499 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:06.680978 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878ba5f-9407-4a8e-96b4-e72928fab499 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:06.681256 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878ba5f-9407-4a8e-96b4-e72928fab499 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:06.681521 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878ba5f-9407-4a8e-96b4-e72928fab499 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:06.691493 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9878ba5f-9407-4a8e-96b4-e72928fab499 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:06.692881 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9878ba5f-9407-4a8e-96b4-e72928fab499 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:06.702712 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1456/2878] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:10:06 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:10:06.779352 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219025ad-65ba-480d-87c0-14cd72f0d82b None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:06.790224 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219025ad-65ba-480d-87c0-14cd72f0d82b None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:06.795137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc7e8d1-17c6-4dc0-af0a-cfe7ca827593 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:06.795749 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7e8d1-17c6-4dc0-af0a-cfe7ca827593 service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:06.796024 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7e8d1-17c6-4dc0-af0a-cfe7ca827593 service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:06.796309 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7e8d1-17c6-4dc0-af0a-cfe7ca827593 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:06.855148 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc7e8d1-17c6-4dc0-af0a-cfe7ca827593 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:06.857677 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc7e8d1-17c6-4dc0-af0a-cfe7ca827593 service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:06.867163 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1423/2879] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:10:06 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:10:07.126412 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878ba5f-9407-4a8e-96b4-e72928fab499 service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:07.186025 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:07.190618 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878ba5f-9407-4a8e-96b4-e72928fab499 service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:07.195978 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5f003-1d13-49c4-bdbc-d23160d1946a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:07.196549 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5f003-1d13-49c4-bdbc-d23160d1946a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:07.196851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5f003-1d13-49c4-bdbc-d23160d1946a admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:07.197125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5f003-1d13-49c4-bdbc-d23160d1946a admin admin] PATH_INFO: `/v3/users/4d88a777e6c34a50bd22d1cd558d70c4` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:07.198243 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5f003-1d13-49c4-bdbc-d23160d1946a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d88a777e6c34a50bd22d1cd558d70c4)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:07.200216 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5f003-1d13-49c4-bdbc-d23160d1946a admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:07.246588 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f1a5f003-1d13-49c4-bdbc-d23160d1946a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d88a777e6c34a50bd22d1cd558d70c4'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:07.247766 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f1a5f003-1d13-49c4-bdbc-d23160d1946a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d88a777e6c34a50bd22d1cd558d70c4'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:07.255157 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f1a5f003-1d13-49c4-bdbc-d23160d1946a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d88a777e6c34a50bd22d1cd558d70c4'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:07.267084 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f1a5f003-1d13-49c4-bdbc-d23160d1946a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d88a777e6c34a50bd22d1cd558d70c4'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:07.273723 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f1a5f003-1d13-49c4-bdbc-d23160d1946a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d88a777e6c34a50bd22d1cd558d70c4'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:07.280045 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1457/2880] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:10:07 2022] DELETE /identity/v3/users/4d88a777e6c34a50bd22d1cd558d70c4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:10:07.284978 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36caa3d2-e245-4d73-aaef-febb7b0a0264 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:07.285268 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36caa3d2-e245-4d73-aaef-febb7b0a0264 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:07.285544 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36caa3d2-e245-4d73-aaef-febb7b0a0264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:07.305095 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-36caa3d2-e245-4d73-aaef-febb7b0a0264 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:10:07.306291 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-36caa3d2-e245-4d73-aaef-febb7b0a0264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:07.364197 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1424/2881] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:10:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:10:07.374390 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5f003-1d13-49c4-bdbc-d23160d1946a admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:07.375790 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-f1a5f003-1d13-49c4-bdbc-d23160d1946a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:07.431577 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5f003-1d13-49c4-bdbc-d23160d1946a admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:07.435391 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec33e5-8e3d-4d4a-afc1-b37a735d090f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:07.435991 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec33e5-8e3d-4d4a-afc1-b37a735d090f service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:07.436269 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec33e5-8e3d-4d4a-afc1-b37a735d090f service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:07.436540 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec33e5-8e3d-4d4a-afc1-b37a735d090f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:07.445353 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec33e5-8e3d-4d4a-afc1-b37a735d090f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:07.446822 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec33e5-8e3d-4d4a-afc1-b37a735d090f service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:07.456988 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1458/2882] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:10:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:10:07.727612 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36caa3d2-e245-4d73-aaef-febb7b0a0264 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:07.730318 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-36caa3d2-e245-4d73-aaef-febb7b0a0264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:07.742397 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36caa3d2-e245-4d73-aaef-febb7b0a0264 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:07.747817 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647eb3ae-d752-47c4-8402-8bc2966901ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:07.748449 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647eb3ae-d752-47c4-8402-8bc2966901ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:07.748727 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647eb3ae-d752-47c4-8402-8bc2966901ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:07.749070 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647eb3ae-d752-47c4-8402-8bc2966901ce admin admin] PATH_INFO: `/v3/projects/294f1d9d11cf434aa9bce1000cc4b957` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:07.750377 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647eb3ae-d752-47c4-8402-8bc2966901ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=294f1d9d11cf434aa9bce1000cc4b957)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:07.752196 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647eb3ae-d752-47c4-8402-8bc2966901ce admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:07.787951 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:07.802081 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-647eb3ae-d752-47c4-8402-8bc2966901ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '294f1d9d11cf434aa9bce1000cc4b957', 'request_id': 'req-647eb3ae-d752-47c4-8402-8bc2966901ce'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:07.810620 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-647eb3ae-d752-47c4-8402-8bc2966901ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '294f1d9d11cf434aa9bce1000cc4b957', 'request_id': 'req-647eb3ae-d752-47c4-8402-8bc2966901ce'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:07.818192 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-647eb3ae-d752-47c4-8402-8bc2966901ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '294f1d9d11cf434aa9bce1000cc4b957', 'request_id': 'req-647eb3ae-d752-47c4-8402-8bc2966901ce'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:07.831166 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-647eb3ae-d752-47c4-8402-8bc2966901ce admin admin] The token cache is being invalidate because project 294f1d9d11cf434aa9bce1000cc4b957 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:10:07.831455 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-647eb3ae-d752-47c4-8402-8bc2966901ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:07.832137 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-647eb3ae-d752-47c4-8402-8bc2966901ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:07.833759 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1425/2883] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:10:07 2022] DELETE /identity/v3/projects/294f1d9d11cf434aa9bce1000cc4b957 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:10:07.837458 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec33e5-8e3d-4d4a-afc1-b37a735d090f service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:07.847888 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec33e5-8e3d-4d4a-afc1-b37a735d090f service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:07.902916 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e20c2d-7fd0-4e26-977d-6d21675eac94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:07.904092 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e20c2d-7fd0-4e26-977d-6d21675eac94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:07.904410 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e20c2d-7fd0-4e26-977d-6d21675eac94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:07.904683 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e20c2d-7fd0-4e26-977d-6d21675eac94 admin admin] PATH_INFO: `/v3/users/bc5d2a7cfeef4f5dba6a0428b7a35748` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:07.905835 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e20c2d-7fd0-4e26-977d-6d21675eac94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc5d2a7cfeef4f5dba6a0428b7a35748)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:07.907764 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e20c2d-7fd0-4e26-977d-6d21675eac94 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:07.929022 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:07.952875 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-36e20c2d-7fd0-4e26-977d-6d21675eac94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc5d2a7cfeef4f5dba6a0428b7a35748'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:07.953530 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-36e20c2d-7fd0-4e26-977d-6d21675eac94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc5d2a7cfeef4f5dba6a0428b7a35748'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:07.960864 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-36e20c2d-7fd0-4e26-977d-6d21675eac94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc5d2a7cfeef4f5dba6a0428b7a35748'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:07.973275 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-36e20c2d-7fd0-4e26-977d-6d21675eac94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc5d2a7cfeef4f5dba6a0428b7a35748'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:07.980678 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-36e20c2d-7fd0-4e26-977d-6d21675eac94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc5d2a7cfeef4f5dba6a0428b7a35748'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:07.988021 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1459/2884] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:10:07 2022] DELETE /identity/v3/users/bc5d2a7cfeef4f5dba6a0428b7a35748 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:10:08.258090 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647eb3ae-d752-47c4-8402-8bc2966901ce admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:08.260194 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-647eb3ae-d752-47c4-8402-8bc2966901ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:08.275278 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647eb3ae-d752-47c4-8402-8bc2966901ce admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:08.338275 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5fbf3-d960-47df-9018-ba4000746d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:08.338911 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5fbf3-d960-47df-9018-ba4000746d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:08.339190 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5fbf3-d960-47df-9018-ba4000746d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:08.339459 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5fbf3-d960-47df-9018-ba4000746d51 admin admin] PATH_INFO: `/v3/projects/8f43ec606eab47a3b605d35a2cab4a57` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:08.340569 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5fbf3-d960-47df-9018-ba4000746d51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f43ec606eab47a3b605d35a2cab4a57)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:08.343127 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5fbf3-d960-47df-9018-ba4000746d51 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:08.391701 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-52a5fbf3-d960-47df-9018-ba4000746d51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f43ec606eab47a3b605d35a2cab4a57', 'request_id': 'req-52a5fbf3-d960-47df-9018-ba4000746d51'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:08.397060 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-52a5fbf3-d960-47df-9018-ba4000746d51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f43ec606eab47a3b605d35a2cab4a57', 'request_id': 'req-52a5fbf3-d960-47df-9018-ba4000746d51'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:08.404039 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-52a5fbf3-d960-47df-9018-ba4000746d51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f43ec606eab47a3b605d35a2cab4a57', 'request_id': 'req-52a5fbf3-d960-47df-9018-ba4000746d51'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:08.415288 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-52a5fbf3-d960-47df-9018-ba4000746d51 admin admin] The token cache is being invalidate because project 8f43ec606eab47a3b605d35a2cab4a57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:10:08.415574 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-52a5fbf3-d960-47df-9018-ba4000746d51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:08.416196 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-52a5fbf3-d960-47df-9018-ba4000746d51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:08.417725 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1426/2885] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:10:08 2022] DELETE /identity/v3/projects/8f43ec606eab47a3b605d35a2cab4a57 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:10:08.423071 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f6bb9-a2bd-4ec5-a1b3-7bab4d1d66b9 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:08.423361 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f6bb9-a2bd-4ec5-a1b3-7bab4d1d66b9 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:08.423638 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f6bb9-a2bd-4ec5-a1b3-7bab4d1d66b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:08.443493 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-7f3f6bb9-a2bd-4ec5-a1b3-7bab4d1d66b9 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:10:08.444724 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7f3f6bb9-a2bd-4ec5-a1b3-7bab4d1d66b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:08.503258 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1460/2886] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:10:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:10:08.510798 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ac160-ef01-4873-8958-44cf0d4daebc None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:08.511078 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ac160-ef01-4873-8958-44cf0d4daebc None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:08.511347 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ac160-ef01-4873-8958-44cf0d4daebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:08.531504 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-ac0ac160-ef01-4873-8958-44cf0d4daebc None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:10:08.533426 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-ac0ac160-ef01-4873-8958-44cf0d4daebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:08.541440 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1427/2887] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:10:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:10:08.546040 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f6bb9-a2bd-4ec5-a1b3-7bab4d1d66b9 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:08.555371 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f6bb9-a2bd-4ec5-a1b3-7bab4d1d66b9 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:08.560155 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c9915-5191-484f-98fb-e62e6987d7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:08.560745 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c9915-5191-484f-98fb-e62e6987d7a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:08.561052 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c9915-5191-484f-98fb-e62e6987d7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:08.561322 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c9915-5191-484f-98fb-e62e6987d7a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:08.561959 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c9915-5191-484f-98fb-e62e6987d7a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:10:08.562255 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c9915-5191-484f-98fb-e62e6987d7a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:08.563824 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c9915-5191-484f-98fb-e62e6987d7a3 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:08.574916 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1461/2888] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 16:10:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:10:08.579044 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ac160-ef01-4873-8958-44cf0d4daebc None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:08.588086 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ac160-ef01-4873-8958-44cf0d4daebc None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:08.593483 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a5332-4c99-40ef-88f4-bf58656378d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:08.594074 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a5332-4c99-40ef-88f4-bf58656378d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:08.594356 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a5332-4c99-40ef-88f4-bf58656378d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:08.594629 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a5332-4c99-40ef-88f4-bf58656378d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:08.595255 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a5332-4c99-40ef-88f4-bf58656378d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:08.597215 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a5332-4c99-40ef-88f4-bf58656378d7 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:08.626476 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1428/2889] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:10:08 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:10:08.630636 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c9915-5191-484f-98fb-e62e6987d7a3 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:08.640967 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c9915-5191-484f-98fb-e62e6987d7a3 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:08.709643 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319bb63-084f-4f42-84b6-f3c3e4b173c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:08.710284 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319bb63-084f-4f42-84b6-f3c3e4b173c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:08.710567 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319bb63-084f-4f42-84b6-f3c3e4b173c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:08.710871 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319bb63-084f-4f42-84b6-f3c3e4b173c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:08.711557 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b319bb63-084f-4f42-84b6-f3c3e4b173c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:08.713672 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b319bb63-084f-4f42-84b6-f3c3e4b173c9 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:08.740691 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1462/2890] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:10:08 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:10:08.745016 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a5332-4c99-40ef-88f4-bf58656378d7 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:08.755291 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a5332-4c99-40ef-88f4-bf58656378d7 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:08.759761 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf51bf8-0d44-4198-90bc-120f3da43d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:08.760357 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf51bf8-0d44-4198-90bc-120f3da43d3e admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:08.760633 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf51bf8-0d44-4198-90bc-120f3da43d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:08.760938 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf51bf8-0d44-4198-90bc-120f3da43d3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:08.761575 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf51bf8-0d44-4198-90bc-120f3da43d3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:08.763786 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf51bf8-0d44-4198-90bc-120f3da43d3e admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:08.773727 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1429/2891] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:10:08.777639 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319bb63-084f-4f42-84b6-f3c3e4b173c9 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:08.788188 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319bb63-084f-4f42-84b6-f3c3e4b173c9 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:08.792832 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf20c3-9d17-40cf-b408-c628df58e98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:08.793434 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf20c3-9d17-40cf-b408-c628df58e98f admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:08.793819 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf20c3-9d17-40cf-b408-c628df58e98f admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:08.794595 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf20c3-9d17-40cf-b408-c628df58e98f admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:08.795239 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf20c3-9d17-40cf-b408-c628df58e98f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:08.796912 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf20c3-9d17-40cf-b408-c628df58e98f admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:08.807523 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1463/2892] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:10:08.811770 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf51bf8-0d44-4198-90bc-120f3da43d3e admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:08.821904 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf51bf8-0d44-4198-90bc-120f3da43d3e admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:08.826715 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e359cf1-255a-4d37-ae09-535c6c3bd4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:08.827362 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e359cf1-255a-4d37-ae09-535c6c3bd4ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:08.827639 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e359cf1-255a-4d37-ae09-535c6c3bd4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:08.827914 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e359cf1-255a-4d37-ae09-535c6c3bd4ee admin admin] PATH_INFO: `/v3/projects/be2418618a3441299ba73d023d525958/users/54e00a0456e24bd78604ae7598854045/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:08.836274 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:08.843883 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e359cf1-255a-4d37-ae09-535c6c3bd4ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=be2418618a3441299ba73d023d525958, user_id=54e00a0456e24bd78604ae7598854045, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:08.848662 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e359cf1-255a-4d37-ae09-535c6c3bd4ee admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:08.864658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1430/2893] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:10:08 2022] PUT /identity/v3/projects/be2418618a3441299ba73d023d525958/users/54e00a0456e24bd78604ae7598854045/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:10:08.878343 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b70a4f-5536-4e13-b9c1-7152714dbe9d None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:08.878818 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b70a4f-5536-4e13-b9c1-7152714dbe9d None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:08.879048 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b70a4f-5536-4e13-b9c1-7152714dbe9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:08.888432 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:08.911665 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-a9b70a4f-5536-4e13-b9c1-7152714dbe9d None None] MFA Rules not processed for user `54e00a0456e24bd78604ae7598854045`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:10:08.913134 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-a9b70a4f-5536-4e13-b9c1-7152714dbe9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:08.979525 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1464/2894] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:10:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:10:08.991374 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e359cf1-255a-4d37-ae09-535c6c3bd4ee admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:08.993172 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-0e359cf1-255a-4d37-ae09-535c6c3bd4ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:09.051151 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e359cf1-255a-4d37-ae09-535c6c3bd4ee admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:09.054662 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631a94c-bbf6-4733-acb6-5340d5316e1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:09.055268 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631a94c-bbf6-4733-acb6-5340d5316e1c service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:09.055546 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631a94c-bbf6-4733-acb6-5340d5316e1c service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:09.055813 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631a94c-bbf6-4733-acb6-5340d5316e1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:09.064021 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f631a94c-bbf6-4733-acb6-5340d5316e1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:09.065537 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f631a94c-bbf6-4733-acb6-5340d5316e1c service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:09.075729 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1431/2895] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:10:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:10:09.097851 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b70a4f-5536-4e13-b9c1-7152714dbe9d None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:09.160582 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b70a4f-5536-4e13-b9c1-7152714dbe9d None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:09.165285 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e97d0e-f724-40a9-ad0a-b40d59ef442b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:09.165916 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e97d0e-f724-40a9-ad0a-b40d59ef442b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:09.166196 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e97d0e-f724-40a9-ad0a-b40d59ef442b admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:09.166470 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e97d0e-f724-40a9-ad0a-b40d59ef442b admin admin] PATH_INFO: `/v3/users/54e00a0456e24bd78604ae7598854045` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:09.167639 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e97d0e-f724-40a9-ad0a-b40d59ef442b admin admin] RBAC: Authorizing `identity:delete_user(user_id=54e00a0456e24bd78604ae7598854045)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:09.170119 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e97d0e-f724-40a9-ad0a-b40d59ef442b admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:09.216326 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-41e97d0e-f724-40a9-ad0a-b40d59ef442b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54e00a0456e24bd78604ae7598854045'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:09.217009 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-41e97d0e-f724-40a9-ad0a-b40d59ef442b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54e00a0456e24bd78604ae7598854045'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:09.224185 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-41e97d0e-f724-40a9-ad0a-b40d59ef442b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54e00a0456e24bd78604ae7598854045'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:09.237066 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-41e97d0e-f724-40a9-ad0a-b40d59ef442b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54e00a0456e24bd78604ae7598854045'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:09.244244 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-41e97d0e-f724-40a9-ad0a-b40d59ef442b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54e00a0456e24bd78604ae7598854045'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:09.251071 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1465/2896] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:10:09 2022] DELETE /identity/v3/users/54e00a0456e24bd78604ae7598854045 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:10:09.255658 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4009b56-b9a2-44ac-9386-352f271677f3 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:09.255950 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4009b56-b9a2-44ac-9386-352f271677f3 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:09.256227 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4009b56-b9a2-44ac-9386-352f271677f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:09.275904 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-c4009b56-b9a2-44ac-9386-352f271677f3 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:10:09.277150 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-c4009b56-b9a2-44ac-9386-352f271677f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:09.335986 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1432/2897] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:10:09.346316 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e97d0e-f724-40a9-ad0a-b40d59ef442b admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:09.347699 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-41e97d0e-f724-40a9-ad0a-b40d59ef442b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:09.362330 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:09.404975 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e97d0e-f724-40a9-ad0a-b40d59ef442b admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:09.408578 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b6235-30c4-4394-b411-5152d105ae4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:09.409206 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b6235-30c4-4394-b411-5152d105ae4e service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:09.409479 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b6235-30c4-4394-b411-5152d105ae4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:09.409744 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b6235-30c4-4394-b411-5152d105ae4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:09.418461 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b6235-30c4-4394-b411-5152d105ae4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:09.420502 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b6235-30c4-4394-b411-5152d105ae4e service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:09.429645 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1466/2898] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:10:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:10:09.692447 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4009b56-b9a2-44ac-9386-352f271677f3 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:09.693929 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-c4009b56-b9a2-44ac-9386-352f271677f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:09.708248 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4009b56-b9a2-44ac-9386-352f271677f3 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:09.713079 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ddd3aa-5be8-447a-b86c-d79338ee5539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:09.713815 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddd3aa-5be8-447a-b86c-d79338ee5539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:09.714355 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddd3aa-5be8-447a-b86c-d79338ee5539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:09.714765 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddd3aa-5be8-447a-b86c-d79338ee5539 admin admin] PATH_INFO: `/v3/projects/be2418618a3441299ba73d023d525958` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:09.715774 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ddd3aa-5be8-447a-b86c-d79338ee5539 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be2418618a3441299ba73d023d525958)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:09.720822 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ddd3aa-5be8-447a-b86c-d79338ee5539 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:09.765827 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-b8ddd3aa-5be8-447a-b86c-d79338ee5539 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be2418618a3441299ba73d023d525958', 'request_id': 'req-b8ddd3aa-5be8-447a-b86c-d79338ee5539'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:09.771356 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-b8ddd3aa-5be8-447a-b86c-d79338ee5539 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be2418618a3441299ba73d023d525958', 'request_id': 'req-b8ddd3aa-5be8-447a-b86c-d79338ee5539'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:09.778594 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-b8ddd3aa-5be8-447a-b86c-d79338ee5539 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be2418618a3441299ba73d023d525958', 'request_id': 'req-b8ddd3aa-5be8-447a-b86c-d79338ee5539'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:09.789319 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-b8ddd3aa-5be8-447a-b86c-d79338ee5539 admin admin] The token cache is being invalidate because project be2418618a3441299ba73d023d525958 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:10:09.789601 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-b8ddd3aa-5be8-447a-b86c-d79338ee5539 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:09.790216 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-b8ddd3aa-5be8-447a-b86c-d79338ee5539 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:09.791676 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1433/2899] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:10:09 2022] DELETE /identity/v3/projects/be2418618a3441299ba73d023d525958 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:10:11.325806 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b6235-30c4-4394-b411-5152d105ae4e service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:11.327192 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-f32b6235-30c4-4394-b411-5152d105ae4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:11.339498 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b6235-30c4-4394-b411-5152d105ae4e service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:11.393758 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c1fee-0cfe-41a3-b6de-511b4297a59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:11.394370 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c1fee-0cfe-41a3-b6de-511b4297a59d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:11.394646 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c1fee-0cfe-41a3-b6de-511b4297a59d admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:11.394913 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c1fee-0cfe-41a3-b6de-511b4297a59d admin admin] PATH_INFO: `/v3/users/49f18d68b7d0406fa548729167ebb0a3` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:11.396023 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c1fee-0cfe-41a3-b6de-511b4297a59d admin admin] RBAC: Authorizing `identity:delete_user(user_id=49f18d68b7d0406fa548729167ebb0a3)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:11.397941 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c1fee-0cfe-41a3-b6de-511b4297a59d admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:11.445763 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2b6c1fee-0cfe-41a3-b6de-511b4297a59d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49f18d68b7d0406fa548729167ebb0a3'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:11.446409 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2b6c1fee-0cfe-41a3-b6de-511b4297a59d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49f18d68b7d0406fa548729167ebb0a3'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:11.453502 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2b6c1fee-0cfe-41a3-b6de-511b4297a59d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49f18d68b7d0406fa548729167ebb0a3'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:11.464998 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2b6c1fee-0cfe-41a3-b6de-511b4297a59d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49f18d68b7d0406fa548729167ebb0a3'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:11.471620 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2b6c1fee-0cfe-41a3-b6de-511b4297a59d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49f18d68b7d0406fa548729167ebb0a3'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:11.477268 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1467/2900] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:10:11 2022] DELETE /identity/v3/users/49f18d68b7d0406fa548729167ebb0a3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:10:11.482268 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a945c22-d547-4583-82ad-c6d6d64c603b None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:11.482801 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a945c22-d547-4583-82ad-c6d6d64c603b None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:11.482801 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a945c22-d547-4583-82ad-c6d6d64c603b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:11.502614 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-5a945c22-d547-4583-82ad-c6d6d64c603b None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:10:11.503819 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-5a945c22-d547-4583-82ad-c6d6d64c603b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:11.511830 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:11.565571 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1434/2901] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:10:11.575198 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c1fee-0cfe-41a3-b6de-511b4297a59d admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:11.576596 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-2b6c1fee-0cfe-41a3-b6de-511b4297a59d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:11.616856 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:11.635476 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c1fee-0cfe-41a3-b6de-511b4297a59d admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:11.639435 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b5834-818f-410b-a5fa-64fb92b81114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:11.640037 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b5834-818f-410b-a5fa-64fb92b81114 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:11.640337 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b5834-818f-410b-a5fa-64fb92b81114 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:11.640604 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b5834-818f-410b-a5fa-64fb92b81114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:11.649343 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4b5834-818f-410b-a5fa-64fb92b81114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:11.650749 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4b5834-818f-410b-a5fa-64fb92b81114 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:11.660516 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1468/2902] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:10:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:10:11.929497 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a945c22-d547-4583-82ad-c6d6d64c603b None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:11.931033 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-5a945c22-d547-4583-82ad-c6d6d64c603b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:11.944265 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a945c22-d547-4583-82ad-c6d6d64c603b None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:11.948936 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d86ea-c601-4d8e-9bde-3a37d81d1c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:11.949575 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d86ea-c601-4d8e-9bde-3a37d81d1c9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:11.949886 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d86ea-c601-4d8e-9bde-3a37d81d1c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:11.950663 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d86ea-c601-4d8e-9bde-3a37d81d1c9f admin admin] PATH_INFO: `/v3/projects/f518d3364296499f9b04105e065e084b` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:11.951803 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d86ea-c601-4d8e-9bde-3a37d81d1c9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f518d3364296499f9b04105e065e084b)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:11.953861 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d86ea-c601-4d8e-9bde-3a37d81d1c9f admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:11.999782 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-0b0d86ea-c601-4d8e-9bde-3a37d81d1c9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f518d3364296499f9b04105e065e084b', 'request_id': 'req-0b0d86ea-c601-4d8e-9bde-3a37d81d1c9f'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:12.005217 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-0b0d86ea-c601-4d8e-9bde-3a37d81d1c9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f518d3364296499f9b04105e065e084b', 'request_id': 'req-0b0d86ea-c601-4d8e-9bde-3a37d81d1c9f'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:12.013937 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-0b0d86ea-c601-4d8e-9bde-3a37d81d1c9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f518d3364296499f9b04105e065e084b', 'request_id': 'req-0b0d86ea-c601-4d8e-9bde-3a37d81d1c9f'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:12.025095 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-0b0d86ea-c601-4d8e-9bde-3a37d81d1c9f admin admin] The token cache is being invalidate because project f518d3364296499f9b04105e065e084b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:10:12.025385 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-0b0d86ea-c601-4d8e-9bde-3a37d81d1c9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:12.026012 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-0b0d86ea-c601-4d8e-9bde-3a37d81d1c9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:12.027526 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1435/2903] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:10:11 2022] DELETE /identity/v3/projects/f518d3364296499f9b04105e065e084b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:10:12.033565 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621c854-338c-4a8f-9970-2d296295945f None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:12.033881 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621c854-338c-4a8f-9970-2d296295945f None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:12.034153 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621c854-338c-4a8f-9970-2d296295945f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:12.053468 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-3621c854-338c-4a8f-9970-2d296295945f None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:10:12.054663 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-3621c854-338c-4a8f-9970-2d296295945f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:12.112943 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1469/2904] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:10:12.122354 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ea1f7-c20d-40f5-a120-7c9fdf7627e6 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:12.122772 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ea1f7-c20d-40f5-a120-7c9fdf7627e6 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:12.123072 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ea1f7-c20d-40f5-a120-7c9fdf7627e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:12.143335 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-741ea1f7-c20d-40f5-a120-7c9fdf7627e6 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:10:12.144532 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-741ea1f7-c20d-40f5-a120-7c9fdf7627e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:12.152436 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1436/2905] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:10:12.157279 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621c854-338c-4a8f-9970-2d296295945f None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:12.167210 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621c854-338c-4a8f-9970-2d296295945f None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:12.171791 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069b31b-2d0a-4779-89fd-d4d16117f3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:12.172384 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069b31b-2d0a-4779-89fd-d4d16117f3f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:12.172665 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069b31b-2d0a-4779-89fd-d4d16117f3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:12.172973 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069b31b-2d0a-4779-89fd-d4d16117f3f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:12.173610 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069b31b-2d0a-4779-89fd-d4d16117f3f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:10:12.173905 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069b31b-2d0a-4779-89fd-d4d16117f3f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:12.175507 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069b31b-2d0a-4779-89fd-d4d16117f3f2 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:12.186739 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1470/2906] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 16:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:10:12.190981 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ea1f7-c20d-40f5-a120-7c9fdf7627e6 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:12.200657 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ea1f7-c20d-40f5-a120-7c9fdf7627e6 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:12.205346 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fec2bb-9994-44a1-9181-de2571da1375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:12.205940 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fec2bb-9994-44a1-9181-de2571da1375 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:12.206221 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fec2bb-9994-44a1-9181-de2571da1375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:12.206494 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fec2bb-9994-44a1-9181-de2571da1375 admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:12.207141 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fec2bb-9994-44a1-9181-de2571da1375 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:12.209861 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fec2bb-9994-44a1-9181-de2571da1375 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:12.242982 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1437/2907] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:10:12 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:10:12.244338 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069b31b-2d0a-4779-89fd-d4d16117f3f2 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:12.255992 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069b31b-2d0a-4779-89fd-d4d16117f3f2 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:12.311077 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9a344-b923-4077-aad9-927b39cadc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:12.311690 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9a344-b923-4077-aad9-927b39cadc00 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:12.311968 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9a344-b923-4077-aad9-927b39cadc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:12.312238 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9a344-b923-4077-aad9-927b39cadc00 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:12.312904 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf9a344-b923-4077-aad9-927b39cadc00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:12.315026 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf9a344-b923-4077-aad9-927b39cadc00 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:12.336445 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1471/2908] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:10:12 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:10:12.340547 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fec2bb-9994-44a1-9181-de2571da1375 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:12.350934 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fec2bb-9994-44a1-9181-de2571da1375 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:12.355624 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3f8c8-6940-43e8-93b1-8f618d49f92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:12.356216 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3f8c8-6940-43e8-93b1-8f618d49f92c admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:12.356615 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3f8c8-6940-43e8-93b1-8f618d49f92c admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:12.356928 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3f8c8-6940-43e8-93b1-8f618d49f92c admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:12.357572 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3f8c8-6940-43e8-93b1-8f618d49f92c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:12.359154 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3f8c8-6940-43e8-93b1-8f618d49f92c admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:12.369159 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1438/2909] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:10:12.373945 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9a344-b923-4077-aad9-927b39cadc00 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:12.383826 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9a344-b923-4077-aad9-927b39cadc00 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:12.389337 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6965367-8d84-4af0-b295-34e1d79443b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:12.389933 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6965367-8d84-4af0-b295-34e1d79443b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:12.390247 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6965367-8d84-4af0-b295-34e1d79443b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:12.390522 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6965367-8d84-4af0-b295-34e1d79443b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:12.391165 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6965367-8d84-4af0-b295-34e1d79443b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:12.392745 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6965367-8d84-4af0-b295-34e1d79443b6 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:12.403021 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1472/2910] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:10:12.407044 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3f8c8-6940-43e8-93b1-8f618d49f92c admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:12.416690 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3f8c8-6940-43e8-93b1-8f618d49f92c admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:12.421291 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32385d-1017-4168-82d2-63e34865adad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:12.421926 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32385d-1017-4168-82d2-63e34865adad admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:12.422332 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32385d-1017-4168-82d2-63e34865adad admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:12.422519 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32385d-1017-4168-82d2-63e34865adad admin admin] PATH_INFO: `/v3/projects/7a0f19c845cc475aa5a0b89f7f014d7f/users/f3da05d0bebf473e862e3b8bd4548b69/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:12.437236 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a32385d-1017-4168-82d2-63e34865adad admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a0f19c845cc475aa5a0b89f7f014d7f, user_id=f3da05d0bebf473e862e3b8bd4548b69, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:12.439860 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a32385d-1017-4168-82d2-63e34865adad admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:12.455014 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1439/2911] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:10:12 2022] PUT /identity/v3/projects/7a0f19c845cc475aa5a0b89f7f014d7f/users/f3da05d0bebf473e862e3b8bd4548b69/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:10:12.465313 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c21f8a-95ef-4cd2-952b-81fac0768997 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:12.465602 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c21f8a-95ef-4cd2-952b-81fac0768997 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:12.465903 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c21f8a-95ef-4cd2-952b-81fac0768997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:12.494438 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-83c21f8a-95ef-4cd2-952b-81fac0768997 None None] MFA Rules not processed for user `f3da05d0bebf473e862e3b8bd4548b69`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:10:12.495642 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-83c21f8a-95ef-4cd2-952b-81fac0768997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:12.533153 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:12.566192 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1473/2912] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:10:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:10:12.578015 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32385d-1017-4168-82d2-63e34865adad admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:12.579764 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-1a32385d-1017-4168-82d2-63e34865adad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:12.613660 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:12.637102 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32385d-1017-4168-82d2-63e34865adad admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:12.641283 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888aeaf5-abc6-4d4f-92ac-dadd4e6e6475 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:12.641883 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888aeaf5-abc6-4d4f-92ac-dadd4e6e6475 service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:12.642158 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888aeaf5-abc6-4d4f-92ac-dadd4e6e6475 service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:12.642425 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888aeaf5-abc6-4d4f-92ac-dadd4e6e6475 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:12.650392 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888aeaf5-abc6-4d4f-92ac-dadd4e6e6475 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:12.651809 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888aeaf5-abc6-4d4f-92ac-dadd4e6e6475 service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:12.660429 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1440/2913] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:10:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:10:12.686602 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c21f8a-95ef-4cd2-952b-81fac0768997 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:12.748376 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c21f8a-95ef-4cd2-952b-81fac0768997 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:12.752976 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d5957-8cf6-4656-96fc-d4a0aad6d303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:12.753613 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d5957-8cf6-4656-96fc-d4a0aad6d303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:12.753890 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d5957-8cf6-4656-96fc-d4a0aad6d303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:12.754161 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d5957-8cf6-4656-96fc-d4a0aad6d303 admin admin] PATH_INFO: `/v3/users/f3da05d0bebf473e862e3b8bd4548b69` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:12.755289 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d5957-8cf6-4656-96fc-d4a0aad6d303 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3da05d0bebf473e862e3b8bd4548b69)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:12.757276 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d5957-8cf6-4656-96fc-d4a0aad6d303 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:12.801575 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-8e1d5957-8cf6-4656-96fc-d4a0aad6d303 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3da05d0bebf473e862e3b8bd4548b69'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:12.802241 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-8e1d5957-8cf6-4656-96fc-d4a0aad6d303 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3da05d0bebf473e862e3b8bd4548b69'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:12.809177 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-8e1d5957-8cf6-4656-96fc-d4a0aad6d303 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3da05d0bebf473e862e3b8bd4548b69'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:12.821086 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-8e1d5957-8cf6-4656-96fc-d4a0aad6d303 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3da05d0bebf473e862e3b8bd4548b69'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:12.828302 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-8e1d5957-8cf6-4656-96fc-d4a0aad6d303 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3da05d0bebf473e862e3b8bd4548b69'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:12.834050 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1474/2914] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:10:12 2022] DELETE /identity/v3/users/f3da05d0bebf473e862e3b8bd4548b69 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:10:12.838675 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e889aa-41b6-4451-9b15-60aeea3213a7 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:12.838957 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e889aa-41b6-4451-9b15-60aeea3213a7 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:12.839225 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e889aa-41b6-4451-9b15-60aeea3213a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:12.859674 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-b9e889aa-41b6-4451-9b15-60aeea3213a7 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:10:12.860914 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-b9e889aa-41b6-4451-9b15-60aeea3213a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:12.919173 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1441/2915] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:10:12.928072 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d5957-8cf6-4656-96fc-d4a0aad6d303 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:12.929558 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-8e1d5957-8cf6-4656-96fc-d4a0aad6d303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:12.985304 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d5957-8cf6-4656-96fc-d4a0aad6d303 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:12.988880 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06cf9a-5709-4368-803f-c57e2c469e64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:12.989477 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06cf9a-5709-4368-803f-c57e2c469e64 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:12.989749 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06cf9a-5709-4368-803f-c57e2c469e64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:12.990016 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06cf9a-5709-4368-803f-c57e2c469e64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:12.997632 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:13.000481 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06cf9a-5709-4368-803f-c57e2c469e64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:13.002587 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06cf9a-5709-4368-803f-c57e2c469e64 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:13.014366 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1475/2916] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:10:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:10:13.287841 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e889aa-41b6-4451-9b15-60aeea3213a7 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:13.289289 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-b9e889aa-41b6-4451-9b15-60aeea3213a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:13.301007 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e889aa-41b6-4451-9b15-60aeea3213a7 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:13.305539 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925d7ca-5caa-45fc-96a9-0381c915be43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:13.306164 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925d7ca-5caa-45fc-96a9-0381c915be43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:13.306438 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925d7ca-5caa-45fc-96a9-0381c915be43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:13.306706 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925d7ca-5caa-45fc-96a9-0381c915be43 admin admin] PATH_INFO: `/v3/projects/7a0f19c845cc475aa5a0b89f7f014d7f` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:13.307804 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0925d7ca-5caa-45fc-96a9-0381c915be43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a0f19c845cc475aa5a0b89f7f014d7f)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:13.310401 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0925d7ca-5caa-45fc-96a9-0381c915be43 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:13.356914 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-0925d7ca-5caa-45fc-96a9-0381c915be43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a0f19c845cc475aa5a0b89f7f014d7f', 'request_id': 'req-0925d7ca-5caa-45fc-96a9-0381c915be43'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:13.362562 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-0925d7ca-5caa-45fc-96a9-0381c915be43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a0f19c845cc475aa5a0b89f7f014d7f', 'request_id': 'req-0925d7ca-5caa-45fc-96a9-0381c915be43'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:13.370693 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-0925d7ca-5caa-45fc-96a9-0381c915be43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a0f19c845cc475aa5a0b89f7f014d7f', 'request_id': 'req-0925d7ca-5caa-45fc-96a9-0381c915be43'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:13.382203 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-0925d7ca-5caa-45fc-96a9-0381c915be43 admin admin] The token cache is being invalidate because project 7a0f19c845cc475aa5a0b89f7f014d7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:10:13.382493 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-0925d7ca-5caa-45fc-96a9-0381c915be43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:13.383120 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-0925d7ca-5caa-45fc-96a9-0381c915be43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:13.384626 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1442/2917] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:10:13 2022] DELETE /identity/v3/projects/7a0f19c845cc475aa5a0b89f7f014d7f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:10:13.390277 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d6e62-c1be-4f7a-8b4c-fabe9869c4a0 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:13.390750 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d6e62-c1be-4f7a-8b4c-fabe9869c4a0 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:13.390847 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d6e62-c1be-4f7a-8b4c-fabe9869c4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:13.410278 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-be5d6e62-c1be-4f7a-8b4c-fabe9869c4a0 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:10:13.411482 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-be5d6e62-c1be-4f7a-8b4c-fabe9869c4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:13.469652 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1476/2918] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:10:13.477313 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4b6ee-22fc-4541-8d42-7e631b3783c4 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:13.477604 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4b6ee-22fc-4541-8d42-7e631b3783c4 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:13.477880 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4b6ee-22fc-4541-8d42-7e631b3783c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:13.498735 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-90e4b6ee-22fc-4541-8d42-7e631b3783c4 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:10:13.499924 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-90e4b6ee-22fc-4541-8d42-7e631b3783c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:13.507938 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1443/2919] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:10:13.511929 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d6e62-c1be-4f7a-8b4c-fabe9869c4a0 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:13.521529 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d6e62-c1be-4f7a-8b4c-fabe9869c4a0 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:13.526167 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1680ef2-8f7c-4ca5-86ee-42f1f42b13b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:13.526755 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1680ef2-8f7c-4ca5-86ee-42f1f42b13b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:13.527036 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1680ef2-8f7c-4ca5-86ee-42f1f42b13b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:13.527310 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1680ef2-8f7c-4ca5-86ee-42f1f42b13b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:13.527956 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1680ef2-8f7c-4ca5-86ee-42f1f42b13b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:10:13.528305 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1680ef2-8f7c-4ca5-86ee-42f1f42b13b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:13.529929 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1680ef2-8f7c-4ca5-86ee-42f1f42b13b9 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:13.541160 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1477/2920] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 30 16:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:10:13.545837 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4b6ee-22fc-4541-8d42-7e631b3783c4 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:13.554930 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4b6ee-22fc-4541-8d42-7e631b3783c4 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:13.560211 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1142aa4-1fea-4963-9771-062c84263f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:13.560911 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1142aa4-1fea-4963-9771-062c84263f0a admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:13.561195 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1142aa4-1fea-4963-9771-062c84263f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:13.561469 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1142aa4-1fea-4963-9771-062c84263f0a admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:13.562114 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1142aa4-1fea-4963-9771-062c84263f0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:13.564012 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1142aa4-1fea-4963-9771-062c84263f0a admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:13.590878 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1444/2921] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 30 16:10:13 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:10:13.594932 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1680ef2-8f7c-4ca5-86ee-42f1f42b13b9 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:13.604679 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1680ef2-8f7c-4ca5-86ee-42f1f42b13b9 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:13.664565 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faab6eb-a060-459a-bb6f-72ed5651ef51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:13.665191 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faab6eb-a060-459a-bb6f-72ed5651ef51 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:13.665468 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faab6eb-a060-459a-bb6f-72ed5651ef51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:13.665736 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faab6eb-a060-459a-bb6f-72ed5651ef51 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:13.666365 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faab6eb-a060-459a-bb6f-72ed5651ef51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:13.668247 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faab6eb-a060-459a-bb6f-72ed5651ef51 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:13.688245 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1478/2922] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 30 16:10:13 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:10:13.692305 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1142aa4-1fea-4963-9771-062c84263f0a admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:13.702979 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1142aa4-1fea-4963-9771-062c84263f0a admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:13.707712 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056eb12-d9bd-41c9-b123-caaf326bae7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:13.708337 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056eb12-d9bd-41c9-b123-caaf326bae7e admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:13.708644 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056eb12-d9bd-41c9-b123-caaf326bae7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:13.709046 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056eb12-d9bd-41c9-b123-caaf326bae7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:13.709753 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056eb12-d9bd-41c9-b123-caaf326bae7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:13.711353 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056eb12-d9bd-41c9-b123-caaf326bae7e admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:13.721809 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1445/2923] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:10:13.725700 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faab6eb-a060-459a-bb6f-72ed5651ef51 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:13.736291 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faab6eb-a060-459a-bb6f-72ed5651ef51 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:13.740942 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94503f77-14dd-4737-bb70-9318625df57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:13.741546 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94503f77-14dd-4737-bb70-9318625df57a admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:13.741827 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94503f77-14dd-4737-bb70-9318625df57a admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:13.742099 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94503f77-14dd-4737-bb70-9318625df57a admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:13.742762 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94503f77-14dd-4737-bb70-9318625df57a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:13.744577 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94503f77-14dd-4737-bb70-9318625df57a admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:13.755562 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1479/2924] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 16:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:10:13.759523 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056eb12-d9bd-41c9-b123-caaf326bae7e admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:13.769510 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056eb12-d9bd-41c9-b123-caaf326bae7e admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:13.774067 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8351153-eaa0-4417-990d-7ba8b381a373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:13.774709 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8351153-eaa0-4417-990d-7ba8b381a373 admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:13.774990 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8351153-eaa0-4417-990d-7ba8b381a373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:13.775262 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8351153-eaa0-4417-990d-7ba8b381a373 admin admin] PATH_INFO: `/v3/projects/2a48bea46103480492bf62370249223a/users/b186f142218d41f4812741cdac164ecd/roles/a82e6f447c1b4b56b530dacfae06dee1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:13.790189 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8351153-eaa0-4417-990d-7ba8b381a373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a48bea46103480492bf62370249223a, user_id=b186f142218d41f4812741cdac164ecd, role_id=a82e6f447c1b4b56b530dacfae06dee1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:13.792862 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8351153-eaa0-4417-990d-7ba8b381a373 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:13.796596 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:13.807937 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1446/2925] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 30 16:10:13 2022] PUT /identity/v3/projects/2a48bea46103480492bf62370249223a/users/b186f142218d41f4812741cdac164ecd/roles/a82e6f447c1b4b56b530dacfae06dee1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:10:13.819416 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4713aad-3408-49f0-abc1-9beab490ee09 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:13.819702 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4713aad-3408-49f0-abc1-9beab490ee09 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:13.819973 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4713aad-3408-49f0-abc1-9beab490ee09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:13.847554 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-d4713aad-3408-49f0-abc1-9beab490ee09 None None] MFA Rules not processed for user `b186f142218d41f4812741cdac164ecd`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:10:13.848756 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-d4713aad-3408-49f0-abc1-9beab490ee09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:13.894239 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:13.912102 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1480/2926] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:10:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:10:13.923176 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8351153-eaa0-4417-990d-7ba8b381a373 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:13.924938 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-a8351153-eaa0-4417-990d-7ba8b381a373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:13.984524 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8351153-eaa0-4417-990d-7ba8b381a373 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:13.988177 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97bf13a-2d3e-4ddf-bbdf-690d9be327ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '130166ecc884456d94dbf6c6905168fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:13.988810 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bf13a-2d3e-4ddf-bbdf-690d9be327ef service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:13.989101 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bf13a-2d3e-4ddf-bbdf-690d9be327ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:13.989369 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bf13a-2d3e-4ddf-bbdf-690d9be327ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:13.998066 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97bf13a-2d3e-4ddf-bbdf-690d9be327ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:13.999503 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97bf13a-2d3e-4ddf-bbdf-690d9be327ef service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:14.008219 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1447/2927] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:10:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:10:23.909228 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=4 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:23.957162 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4713aad-3408-49f0-abc1-9beab490ee09 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:24.004255 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=28 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:24.021254 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4713aad-3408-49f0-abc1-9beab490ee09 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:24.025982 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78c159-6fec-4f94-b9f3-c87d50feb77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:24.026612 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78c159-6fec-4f94-b9f3-c87d50feb77f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:24.026890 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78c159-6fec-4f94-b9f3-c87d50feb77f admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:24.027160 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78c159-6fec-4f94-b9f3-c87d50feb77f admin admin] PATH_INFO: `/v3/users/b186f142218d41f4812741cdac164ecd` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:24.028274 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c78c159-6fec-4f94-b9f3-c87d50feb77f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b186f142218d41f4812741cdac164ecd)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:24.030871 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c78c159-6fec-4f94-b9f3-c87d50feb77f admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:24.076125 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-1c78c159-6fec-4f94-b9f3-c87d50feb77f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b186f142218d41f4812741cdac164ecd'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:24.076765 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-1c78c159-6fec-4f94-b9f3-c87d50feb77f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b186f142218d41f4812741cdac164ecd'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:24.084725 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-1c78c159-6fec-4f94-b9f3-c87d50feb77f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b186f142218d41f4812741cdac164ecd'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:24.097196 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-1c78c159-6fec-4f94-b9f3-c87d50feb77f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b186f142218d41f4812741cdac164ecd'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:24.103947 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-1c78c159-6fec-4f94-b9f3-c87d50feb77f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b186f142218d41f4812741cdac164ecd'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:24.110409 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1481/2928] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 16:10:23 2022] DELETE /identity/v3/users/b186f142218d41f4812741cdac164ecd => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:10:24.115041 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13f52e-4525-4107-8aa4-83989089f768 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:24.115325 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13f52e-4525-4107-8aa4-83989089f768 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:24.115595 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13f52e-4525-4107-8aa4-83989089f768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:24.135821 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-fd13f52e-4525-4107-8aa4-83989089f768 None None] MFA Rules not processed for user `a8dbd7798b3b4a6f882f197a7c25237a`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:10:24.137076 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-fd13f52e-4525-4107-8aa4-83989089f768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:24.193760 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1448/2929] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 30 16:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:10:24.203350 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78c159-6fec-4f94-b9f3-c87d50feb77f admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:24.204806 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-1c78c159-6fec-4f94-b9f3-c87d50feb77f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:24.262300 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78c159-6fec-4f94-b9f3-c87d50feb77f admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:24.265998 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80988a-b630-46f2-939c-af864365e4f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48c49f6751d14526a0954797d9ab6a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:24.266610 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80988a-b630-46f2-939c-af864365e4f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:24.266889 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80988a-b630-46f2-939c-af864365e4f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:24.267160 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80988a-b630-46f2-939c-af864365e4f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:24.276573 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80988a-b630-46f2-939c-af864365e4f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:24.278024 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80988a-b630-46f2-939c-af864365e4f5 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:24.288251 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1482/2930] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:10:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:10:24.551251 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13f52e-4525-4107-8aa4-83989089f768 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:24.552715 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-fd13f52e-4525-4107-8aa4-83989089f768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:24.564576 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13f52e-4525-4107-8aa4-83989089f768 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:24.569064 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ea4a1-d208-4ad8-b10b-1a6b1b94b6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dbd7798b3b4a6f882f197a7c25237a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68dd5aaf111a41b0974c3035d437038b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:24.569804 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ea4a1-d208-4ad8-b10b-1a6b1b94b6f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:24.570084 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ea4a1-d208-4ad8-b10b-1a6b1b94b6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:24.570348 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ea4a1-d208-4ad8-b10b-1a6b1b94b6f9 admin admin] PATH_INFO: `/v3/projects/2a48bea46103480492bf62370249223a` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:24.571463 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ea4a1-d208-4ad8-b10b-1a6b1b94b6f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a48bea46103480492bf62370249223a)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:24.573411 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ea4a1-d208-4ad8-b10b-1a6b1b94b6f9 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:24.620504 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-1b4ea4a1-d208-4ad8-b10b-1a6b1b94b6f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a48bea46103480492bf62370249223a', 'request_id': 'req-1b4ea4a1-d208-4ad8-b10b-1a6b1b94b6f9'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:24.625885 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-1b4ea4a1-d208-4ad8-b10b-1a6b1b94b6f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a48bea46103480492bf62370249223a', 'request_id': 'req-1b4ea4a1-d208-4ad8-b10b-1a6b1b94b6f9'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:24.633068 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-1b4ea4a1-d208-4ad8-b10b-1a6b1b94b6f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a48bea46103480492bf62370249223a', 'request_id': 'req-1b4ea4a1-d208-4ad8-b10b-1a6b1b94b6f9'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:24.644531 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-1b4ea4a1-d208-4ad8-b10b-1a6b1b94b6f9 admin admin] The token cache is being invalidate because project 2a48bea46103480492bf62370249223a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:10:24.644849 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-1b4ea4a1-d208-4ad8-b10b-1a6b1b94b6f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:24.645501 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-1b4ea4a1-d208-4ad8-b10b-1a6b1b94b6f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:10:24.646972 dv-cinder-855058-1-smb devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1449/2931] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 16:10:24 2022] DELETE /identity/v3/projects/2a48bea46103480492bf62370249223a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:10:34.284146 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:34.641591 dv-cinder-855058-1-smb devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:13:34.493340 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80988a-b630-46f2-939c-af864365e4f5 service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:13:34.494753 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-6f80988a-b630-46f2-939c-af864365e4f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:13:34.563221 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80988a-b630-46f2-939c-af864365e4f5 service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:13:34.620418 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b69051-37a5-46be-93b8-d437132c0fab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bba851e1a0d4601b5d4841662f645dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51f312b4cd8b449aa2971993f68de9af', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:13:34.620977 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b69051-37a5-46be-93b8-d437132c0fab service placement] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:13:34.621254 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b69051-37a5-46be-93b8-d437132c0fab service placement] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:13:34.621521 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b69051-37a5-46be-93b8-d437132c0fab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:13:34.623916 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-38b69051-37a5-46be-93b8-d437132c0fab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:13:34.635122 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b69051-37a5-46be-93b8-d437132c0fab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:13:34.636705 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b69051-37a5-46be-93b8-d437132c0fab service placement] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:13:34.647090 dv-cinder-855058-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1483/2932] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 30 16:13:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:13:44.642932 dv-cinder-855058-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=58 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}